Commit Graph

134 Commits

Author SHA1 Message Date
M1ha
ae253e0587 Багфиксы совместимости с python 3.7 2019-06-25 18:10:04 +05:00
M1ha
10fae9220c Added database parameters from infi.clickhouse_orm 1.0.4 2019-03-25 10:17:13 +05:00
M1ha
2798cbb602 Fixed bug with batched insert_tuple 2019-02-15 17:42:04 +05:00
M1ha
ab2fe24f74 Added request data logging in debug mode 2019-02-15 15:52:16 +05:00
M1ha
e436ae977b Fix for current clickhouse version 2019-02-15 15:43:59 +05:00
M1ha
fc100fb066 Added tests on database tuples operations 2019-02-15 15:19:27 +05:00
M1ha
90ec66f380 Changed model_to_dict, so it doesn't require _meta attribute,
if fields are given
2019-02-07 11:41:20 +05:00
M1ha
8d31209a58 Trying to fix queue monitoring increment bug 2019-02-06 17:47:54 +05:00
M1ha
4249b0e2b9 Measure time for inserting tuples 2019-02-05 15:17:37 +05:00
M1ha
ef6fc46c5c Measure time for inserting tuples 2019-02-05 15:13:15 +05:00
M1ha
df422d11f1 Disabled generators to monitor time better 2019-02-05 10:46:29 +05:00
M1ha
cc1502d4a4 Release lock if something goes wrong in sync 2019-02-04 13:27:12 +05:00
M1ha
bf69c29e4f Fixed serialization to tuple to_python converting 2019-02-04 13:07:45 +05:00
M1ha
a205b451a0 Chaned statsd key for inserted tuples 2019-02-04 12:52:21 +05:00
M1ha Shvn
2128dd0efc
Merge pull request #2 from carrotquest/namedtuple
Namedtuple
2019-02-04 11:13:22 +05:00
M1ha
056f2582d4 More optimization and fixed some bugs 2019-02-03 23:05:54 +05:00
M1ha
88c1b9a75c Merge branch 'master' into namedtuple 2019-02-03 21:20:08 +05:00
M1ha
0ddc31bc46 Added profiling test 2019-02-03 21:19:34 +05:00
M1ha
30b4b0568d Fixed sync test bugs 2019-02-03 21:05:01 +05:00
M1ha
16dce3d047 Changed library to using generators instead of lists
and namedtuple instead of infi Model instance, for been more efficient.
Problems with sync_test
2019-02-03 14:24:21 +05:00
M1ha
27c9ca4dfc Added namedtuple with defaults compatible. 2019-02-02 23:02:22 +05:00
M1ha
29a251b892 Fix bug in version column if it is renamed 2019-01-30 10:03:38 +05:00
M1ha
7034f165ac Changed RedisLock blocking alogrythm, so it doesn't wait,
if sync takes a little more than sync period
2019-01-25 13:47:26 +05:00
M1ha
b03b829ed9 Speed up get_final_versions 2019-01-24 17:47:52 +05:00
M1ha
cc76166ae1 Fixed problem for single lock for multiple models 2019-01-24 11:31:16 +05:00
M1ha
13a226501f Fix need_sync period 2019-01-24 11:14:19 +05:00
M1ha
2d2ec9c055 Added debug logs for need_sync 2019-01-24 11:02:44 +05:00
M1ha
c2a1ecc688 Trying to understand invalid sync period 2019-01-24 10:53:54 +05:00
M1ha
da21e9939a Moved sync start mark to the beggining of the task 2019-01-24 10:40:09 +05:00
M1ha
75fcdeeec0 Made redis storage a singleton in order to reduce number of connections 2019-01-23 17:01:10 +05:00
M1ha
ed3b3909ef Fix 2019-01-23 16:30:04 +05:00
M1ha
fae4247e79 Added lock timeouts monitoring 2019-01-23 16:28:27 +05:00
M1ha
42f823d3a5 Fixed a bug in many_init 2019-01-23 15:51:35 +05:00
M1ha
6db5f2b5bb Speed up init of multiple clickhouse models in a row 2019-01-23 15:43:46 +05:00
M1ha
e8549b9509 Removed not needed lock to speed up 2019-01-23 13:47:34 +05:00
M1ha
1a4ed0ddf6 Trying to speed up getting objects from multiple databases 2019-01-23 13:32:18 +05:00
M1ha
241618d8ca Test if post_save is called 2019-01-23 12:48:18 +05:00
M1ha
cac5fe9d52 Removed monitoring, as it has strange avg results for all queries
and models
2019-01-23 10:40:37 +05:00
M1ha
c934ff4df5 Bugfix 2019-01-23 10:34:27 +05:00
M1ha
882930a3a8 Added query time statsd timer 2019-01-23 10:32:11 +05:00
M1ha
780b13a42e Optimization 2019-01-22 11:58:41 +05:00
M1ha
056aa0c5f1 Removed infi.clickhouse_orm insert batching 2019-01-22 11:40:24 +05:00
M1ha
de25af223a Added statsd counters for ClickHouse insert batch size 2019-01-22 09:57:59 +05:00
M1ha
6517c087a0 Added statsd counters for ClickHouse insert batch size 2019-01-22 09:52:05 +05:00
M1ha
69c2c5504b MultiModelConverter now processes sub_models in parallel threads 2019-01-21 14:32:12 +05:00
M1ha
480a857fe8 Fix error on migration,
if MigrationHistory database is readonly and has not been created yet
2019-01-21 12:35:44 +05:00
M1ha
59f92d5b6e Fix in counter 2019-01-18 18:26:28 +05:00
M1ha
d8dccf209d Fix in counter 2019-01-18 18:01:18 +05:00
M1ha
9bc6c6154b Changed post operation guage, as sometimes statsd can "skip" metrics
and graph holds invalid counters
2019-01-18 17:59:46 +05:00
M1ha
6a4bf14ea6 1) Fixed get_final_versions statsd timer key
2) Added individual model operations statsd monitoring for ClickHouseMultiModel
2019-01-18 10:47:26 +05:00