Commit Graph

51 Commits

Author SHA1 Message Date
M1ha
2798cbb602 Fixed bug with batched insert_tuple 2019-02-15 17:42:04 +05:00
M1ha
fc100fb066 Added tests on database tuples operations 2019-02-15 15:19:27 +05:00
M1ha
ef6fc46c5c Measure time for inserting tuples 2019-02-05 15:13:15 +05:00
M1ha
cc1502d4a4 Release lock if something goes wrong in sync 2019-02-04 13:27:12 +05:00
M1ha
056f2582d4 More optimization and fixed some bugs 2019-02-03 23:05:54 +05:00
M1ha
88c1b9a75c Merge branch 'master' into namedtuple 2019-02-03 21:20:08 +05:00
M1ha
0ddc31bc46 Added profiling test 2019-02-03 21:19:34 +05:00
M1ha
30b4b0568d Fixed sync test bugs 2019-02-03 21:05:01 +05:00
M1ha
16dce3d047 Changed library to using generators instead of lists
and namedtuple instead of infi Model instance, for been more efficient.
Problems with sync_test
2019-02-03 14:24:21 +05:00
M1ha
27c9ca4dfc Added namedtuple with defaults compatible. 2019-02-02 23:02:22 +05:00
M1ha
b03b829ed9 Speed up get_final_versions 2019-01-24 17:47:52 +05:00
M1ha
cc76166ae1 Fixed problem for single lock for multiple models 2019-01-24 11:31:16 +05:00
M1ha
75fcdeeec0 Made redis storage a singleton in order to reduce number of connections 2019-01-23 17:01:10 +05:00
M1ha
6db5f2b5bb Speed up init of multiple clickhouse models in a row 2019-01-23 15:43:46 +05:00
M1ha
96b625ecff Speed up of get_sync_objects (parallel execution on multiple databases) 2019-01-18 10:36:48 +05:00
M1ha
073e002125 Багфикс в версиях вставки данных в кликхаус 2019-01-16 17:17:48 +05:00
M1ha
43815723df Added tests for get_final_versions on date and datetime 2019-01-14 12:45:46 +05:00
M1ha
ec72e31986 Tests written for get_final_version 2019-01-14 11:32:21 +05:00
M1ha
1f3dcedf55 Added ability to get final rows version with the help of version_col 2019-01-11 13:00:42 +05:00
M1ha
aed0928ba8 Added tests on syncing data to non default database 2019-01-10 17:02:58 +05:00
M1ha
96300761a7 Сделал создание стандартных типов при создании app-а.
Сделал галочку active у EventType.
2019-01-10 15:05:16 +05:00
M1ha
682c004ba4 Bugfix in getting sync models 2019-01-09 15:14:53 +05:00
M1ha
13b67ed77a Fix time between batches count 2018-12-19 12:58:34 +05:00
M1ha
d830b74bcb Created separate from infi MigrationHistory in order to:
1) inherit it from this library models
2) Use some extra functionality
2018-12-18 18:28:23 +05:00
M1ha
66ec7dd5db Fixed error in migrate. Wrote tests 2018-12-18 17:33:34 +05:00
M1ha
2d4c8554cd Changed migrations routing, dividing it into replicated and not replicated operations 2018-12-18 15:45:10 +05:00
M1ha
7e502ee8a8 1) Fixed SyncKillTest
2) Added some logs
2018-12-03 16:41:34 +05:00
M1ha
b52bfaccae Fix in test 2018-11-29 19:15:27 +05:00
M1ha
762c1aa10d 1) Fixed SyncKillTest
2) Added some logs
2018-11-29 19:10:41 +05:00
M1ha
9742abbaec Added test for killing sync process safety.
Test is not passing =)
2018-11-29 15:19:25 +05:00
M1ha
166d23ca7c Refactoring 2018-11-28 15:33:01 +05:00
M1ha
abe0ae45c5 Added QuerySet that determines db with router help.
Added using(), create(), bulk_create(), all() methods to QuerySet
2018-11-28 15:30:19 +05:00
M1ha
d300d6e46e Фиксы по тестам 2018-11-26 19:17:58 +05:00
M1ha
745b7b7788 Fixed some bugs 2018-11-26 17:37:31 +05:00
M1ha
68914a20f0 Infi https://github.com/Infinidat/infi.clickhouse_orm/issues/89 fix
some refactoring
2018-11-23 11:04:31 +05:00
M1ha
e4b2958895 Changed serializer init to concrete model fields 2018-11-22 12:33:51 +05:00
M1ha
9b02a49bc9 Added all MergeTree engines supported in infi.clickhouse_orm 2018-11-22 11:09:38 +05:00
M1ha
0dbfa8fff1 Added tests on 2018-11-21 16:51:19 +05:00
M1ha
2dab8fcccb Added tests on 2018-11-21 16:50:54 +05:00
M1ha
6e0bc424d7 1) Finished sync celery tasks.
2) RedisStorage now prevents parallel sync with RedisLock
2018-11-20 17:24:15 +05:00
M1ha
61066e0ec7 statsd metrics set up 2018-11-16 17:41:54 +05:00
M1ha
d4e9a705d1 1) Refactoring
2) Bug fixes
3) Simple tests on syncing MergeTree and CollapsingMergeTree
2018-11-16 15:16:36 +05:00
M1ha
4480c1ae1d Added migration system. 2018-11-16 13:14:40 +05:00
M1ha
cdc8a2cd26 Added tests for utils and serializers 2018-11-15 17:41:18 +05:00
M1ha
235b690f35 Added tests for utils and serializers 2018-11-15 17:37:58 +05:00
M1ha
8e9963ad3b Added sync mechanism without tasks, but not tested as no migrations 2018-11-15 16:50:38 +05:00
M1ha
c6da379be7 1) Tests for ClickHouseSyncModel
2) Bugfixes in ClickHouseSyncModel
2018-11-15 13:02:05 +05:00
M1ha
0967614318 Django models and managers refactoring, but not tested 2018-11-14 15:18:06 +05:00
M1ha
4e340e6212 1) Some bugs fixed
2) Added test on RedisStorage.post_sync
2018-11-14 13:02:33 +05:00
M1ha
bac333d03a 1) RedisStorage and tests for it
2) Some fixes
2018-11-14 12:52:01 +05:00