carrotquest/django-clickhouse
1
1
Fork 0
mirror of https://github.com/carrotquest/django-clickhouse.git synced 2025-10-31 16:07:56 +03:00
Code Issues Packages Projects Releases Wiki Activity
215 Commits 3 Branches 11 Tags 462 KiB
b1dff734b9
Commit Graph

215 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
M1ha
16dce3d047 Changed library to using generators instead of lists 
and namedtuple instead of infi Model instance, for been more efficient.
Problems with sync_test
 2019-02-03 14:24:21 +05:00
M1ha
27c9ca4dfc Added namedtuple with defaults compatible. 2019-02-02 23:02:22 +05:00
M1ha
29a251b892 Fix bug in version column if it is renamed 2019-01-30 10:03:38 +05:00
M1ha
7034f165ac Changed RedisLock blocking alogrythm, so it doesn't wait, 
if sync takes a little more than sync period
 2019-01-25 13:47:26 +05:00
M1ha
b03b829ed9 Speed up get_final_versions 2019-01-24 17:47:52 +05:00
M1ha
cc76166ae1 Fixed problem for single lock for multiple models 2019-01-24 11:31:16 +05:00
M1ha
13a226501f Fix need_sync period 2019-01-24 11:14:19 +05:00
M1ha
2d2ec9c055 Added debug logs for need_sync 2019-01-24 11:02:44 +05:00
M1ha
c2a1ecc688 Trying to understand invalid sync period 2019-01-24 10:53:54 +05:00
M1ha
da21e9939a Moved sync start mark to the beggining of the task 2019-01-24 10:40:09 +05:00
M1ha
75fcdeeec0 Made redis storage a singleton in order to reduce number of connections 2019-01-23 17:01:10 +05:00
M1ha
ed3b3909ef Fix 2019-01-23 16:30:04 +05:00
M1ha
fae4247e79 Added lock timeouts monitoring 2019-01-23 16:28:27 +05:00
M1ha
42f823d3a5 Fixed a bug in many_init 2019-01-23 15:51:35 +05:00
M1ha
6db5f2b5bb Speed up init of multiple clickhouse models in a row 2019-01-23 15:43:46 +05:00
M1ha
e8549b9509 Removed not needed lock to speed up 2019-01-23 13:47:34 +05:00
M1ha
1a4ed0ddf6 Trying to speed up getting objects from multiple databases 2019-01-23 13:32:18 +05:00
M1ha
241618d8ca Test if post_save is called 2019-01-23 12:48:18 +05:00
M1ha
cac5fe9d52 Removed monitoring, as it has strange avg results for all queries 
and models
 2019-01-23 10:40:37 +05:00
M1ha
c934ff4df5 Bugfix 2019-01-23 10:34:27 +05:00
M1ha
882930a3a8 Added query time statsd timer 2019-01-23 10:32:11 +05:00
M1ha
780b13a42e Optimization 2019-01-22 11:58:41 +05:00
M1ha
056aa0c5f1 Removed infi.clickhouse_orm insert batching 2019-01-22 11:40:24 +05:00
M1ha
de25af223a Added statsd counters for ClickHouse insert batch size 2019-01-22 09:57:59 +05:00
M1ha
6517c087a0 Added statsd counters for ClickHouse insert batch size 2019-01-22 09:52:05 +05:00
M1ha
69c2c5504b MultiModelConverter now processes sub_models in parallel threads 2019-01-21 14:32:12 +05:00
M1ha
480a857fe8 Fix error on migration, 
if MigrationHistory database is readonly and has not been created yet
 2019-01-21 12:35:44 +05:00
M1ha
59f92d5b6e Fix in counter 2019-01-18 18:26:28 +05:00
M1ha
d8dccf209d Fix in counter 2019-01-18 18:01:18 +05:00
M1ha
9bc6c6154b Changed post operation guage, as sometimes statsd can "skip" metrics 
and graph holds invalid counters
 2019-01-18 17:59:46 +05:00
M1ha
6a4bf14ea6 1) Fixed get_final_versions statsd timer key 
2) Added individual model operations statsd monitoring for ClickHouseMultiModel
 2019-01-18 10:47:26 +05:00
M1ha
96b625ecff Speed up of get_sync_objects (parallel execution on multiple databases) 2019-01-18 10:36:48 +05:00
M1ha
073e002125 Багфикс в версиях вставки данных в кликхаус 2019-01-16 17:17:48 +05:00
M1ha
43815723df Added tests for get_final_versions on date and datetime 2019-01-14 12:45:46 +05:00
M1ha
ec72e31986 Tests written for get_final_version 2019-01-14 11:32:21 +05:00
M1ha
ba3f2f6c1b Fixed getting final versions if DateTimeField is used 2019-01-14 10:56:54 +05:00
M1ha
1f3dcedf55 Added ability to get final rows version with the help of version_col 2019-01-11 13:00:42 +05:00
M1ha
ec2f71fc78 Refactoring 2019-01-10 17:29:41 +05:00
M1ha
aed0928ba8 Added tests on syncing data to non default database 2019-01-10 17:02:58 +05:00
M1ha
96300761a7 Сделал создание стандартных типов при создании app-а. 
Сделал галочку active у EventType.
 2019-01-10 15:05:16 +05:00
M1ha
33dea53aa2 Bugfix in getting empty sync models 2019-01-09 15:36:56 +05:00
M1ha
682c004ba4 Bugfix in getting sync models 2019-01-09 15:14:53 +05:00
M1ha
dbe54da5e3 Refactoring 2018-12-25 12:53:23 +05:00
M1ha
e8a15e4330 Fixed statsd counters 2018-12-19 16:15:17 +05:00
M1ha
6a1ffbadd3 Divided separate get_sync_query_set method for easy reusage 2018-12-19 15:11:17 +05:00
M1ha
76b01c13de Fix multiple model registration 2018-12-19 13:15:42 +05:00
M1ha
1a3d512c57 Fix statsd counters 2018-12-19 13:02:14 +05:00
M1ha
13b67ed77a Fix time between batches count 2018-12-19 12:58:34 +05:00
M1ha
36123db73e Fix time between batches count 2018-12-19 12:52:47 +05:00
M1ha
2dc8e7a270 Fix choosing connection on syncing 2018-12-19 12:37:05 +05:00