1
0
Fork 0
mirror of https://github.com/dragonflydb/dragonfly.git synced 2024-12-14 11:58:02 +00:00
Commit graph

2221 commits

Author SHA1 Message Date
Roman Gershman
b02521cf51
chore: prevent Dispatch fiber to be launched during migration (#3123)
* chore: prevent Dispatch fiber to be launched during the connection migration
2024-06-04 14:13:48 +00:00
Shahar Mike
5b731f163c
feat(cluster_mgr): Fix migration action (#3124) 2024-06-04 13:27:42 +03:00
Borys
7606af706f
fix: fix RestoreStreamer to prevent buckets skipping #2830 (#3119)
* fix: fix RestoreStreamer to prevent bucket skipping #2830
2024-06-04 11:50:03 +03:00
Shahar Mike
bcbcc5a2c6
feat(cluster_mgr): Take over command (#3120) 2024-06-04 11:39:08 +03:00
adiholden
2a5a53f1d9
Revert "refactor client tracking, fix atomicity, squashing and multi/… (#3122)
Revert "refactor client tracking, fix atomicity, squashing and multi/exec (#2970)"

This reverts commit b1063f7823.
2024-06-04 10:34:32 +03:00
adiholden
6e33261402
fix(server): fix compatibility with rdb snapshot (#3121)
* fix server: fix compatibility with rdb snapshot


Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-06-04 06:28:18 +00:00
Kostas Kyrimis
b1063f7823
refactor client tracking, fix atomicity, squashing and multi/exec (#2970)
* add partial support for CLIENT CACHING TRUE (only to be used with TRACKING OPTIN)
* add OPTIN to CLIENT TRACKING command
* refactor client tracking to respect transactional atomicity
* fixed multi/exec and disabled squashing with client tracking
* add tests
2024-06-03 22:14:30 +03:00
Shahar Mike
6e6c91aeaf
feat(cluster_mgr): Improvements to cluster_mgr.py (#3118)
Make sure attached node is in right mode
Enable detaching nodes
2024-06-03 19:05:17 +00:00
Kostas Kyrimis
3924fcad68
chore: pull helio add test for tls deadlock (#3111)
* pull helio
* add test that covers tls deadlock
2024-06-03 14:13:47 +00:00
Shahar Mike
4a1831c911
feat(server): Pipeline and dispatch on /metrics (#3117) 2024-06-03 14:11:39 +03:00
Borys
4371fea436
fix: fix cluster_fuzzy_migration test (#3116) 2024-06-02 14:12:52 +03:00
Roman Gershman
0ab1c636f7
chore: minor fixes + remove redundant DCHECK (#3115)
* chore: minor fixes + remove redundant DCHECK

---------

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-06-02 12:22:05 +03:00
Borys
644dc3f139
New test for cluster migration: connection issue (#3102)
* test: update test_config_consistency, 
update test_cluster_data_migration, 
new cluster migration test for network issues
2024-06-02 09:16:03 +03:00
Vladislav
b3ca27068a
chore: zset error log (from 1.18 branch) (#3109) 2024-05-31 16:00:09 +03:00
Roman Gershman
0394387a5f
chore: export pipeline related metrics (#3104)
* chore: export pipeline related metrics

Export in /metrics
1. Total pipeline queue length
2. Total pipeline commands
3. Total pipelined duration

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

---------

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-30 19:10:35 +03:00
Vladislav
137bd313ef
fix(server): Sync FLUSH with tiering (#3098)
* fix(server): Sync FLUSH with tiering

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-30 16:50:12 +03:00
adiholden
ba0f2932e5
bug(server): fix replication stuck in full sync (#3103)
fix server: fix replication stuck in full sycn

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-30 12:34:15 +00:00
Shahar Mike
d1e3c82eaa
feat(cluster_mgr): Allow attaching replicas (#3105) 2024-05-30 15:29:58 +03:00
Hao.Dong
2fe39e8521
fix: bit shift of kTagMask (#3099)
fix: bit shift

update link
2024-05-30 06:28:50 +03:00
Vladislav
99949ca6cc
feat(tiering): Defragmentation (#3021)
* feat(tiering): Defragmentation
2024-05-29 20:31:52 +03:00
Vladislav
7910c7cb67
feat(streams): Stream optimizations (#3091)
Allows single shard xread to do all its work with a single hop
2024-05-29 15:55:26 +03:00
Kostas Kyrimis
b89997c5ba
chore: improve Migration() (#3033) 2024-05-28 18:14:48 +03:00
Borys
b02a789ebf
fix: add timeout for DFLYMIGRATE ACK to prevent deadlock (#3093)
* fix: add timeout for DFLYMIGRATE ACK to prevent deadlock
2024-05-28 17:41:51 +03:00
Borys
9360ee2768
fix: prevent crashing if error happened during snapshot moving (#3092) 2024-05-28 12:17:47 +03:00
Vladislav
68d1a8680c
fix(tiering): Async delete for small bins (#3068)
* fix(tiering): Async delete for small bins

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-28 12:08:59 +03:00
adiholden
b2213b05d1
fix(replication): fullsync phase write to sync on noop (#3084)
* fix replication: fullsync phase write to sync on noop

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-27 17:52:07 +03:00
adiholden
c45f7bfea5
feat(server): remove multi shard sync from replication (#3085)
feat server: remove multi shard sync from replication

Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-05-27 14:44:37 +03:00
Vladislav
3474eebbb7
chore(streams): Some refactoring (#3088)
* chore: small refactor

* chore: refactor replies

* chore: introduce HasEntries()
2024-05-27 13:36:48 +03:00
Shahar Mike
07b5e00424
feat(server): Expose serialization bytes via INFO and /metrics (#3087)
* feat(server): Expose serialization bytes via `INFO` and `/metrics`

* Also expose pipeline_cmd_cache_bytes via `/metrics` (it's already in `INFO`)
2024-05-27 07:15:51 +00:00
Kostas Kyrimis
2391f49e1c
fix(acl): return -NOPERM instead of response error (#3049) 2024-05-27 09:25:54 +03:00
Borys
0dea257f41
fix: fix cluster incorrect keys status (#3083)
* fix: fix cluster incorrect keys status
2024-05-26 15:10:01 +03:00
Roman Gershman
5534ee5c23
chore: minor fixes (#3082)
1. script errors are now logged continously but at most 5 per second.
2. "memory arena" is introduced - it prints the arena stats per thread.
   "memory malloc-stats" now only prints the global stats.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-26 10:14:02 +03:00
Roman Gershman
20c98c29c1
fix: increase lua stack limit to 8KB (#3080)
Before that 'lua_checkstack(lua(), 7000)' would not pass because we limited lua stack to 4KB.
7000 is the max limit used by bullmq, so we raising it to support this case.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-25 23:11:27 +03:00
Vladislav
fd5ece09fb
chore: small replayer fixes (#3081) 2024-05-25 22:48:29 +03:00
Vladislav
42500c3d1e
fix(tiering): wait for IO before test teardown (#3079)
* chore: wait for IO before test teardown

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>

---------

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-25 20:05:47 +03:00
Vladislav
82d8b02348
chore: bpop prints (#3076)
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-05-25 11:11:18 +03:00
Roman Gershman
8a0007d761
chore: add replication memory stats to the dashboard (#3065) 2024-05-22 08:11:54 +03:00
Jirapong Pansak
3babe99cf6
<chore>!: Update grafana panel (#3064)
update panel
2024-05-19 15:56:44 +00:00
Roman Gershman
fd74fd5b4b
chore: Export replication memory stats (#3062) 2024-05-18 22:40:14 +03:00
Roman Gershman
9d623d0f4b
chore: remove unneeded check-fails (#3054) 2024-05-16 18:45:26 +03:00
romange
d73ffc27b9 chore(helm-chart): update to v1.18.1 2024-05-16 13:22:25 +00:00
Roman Gershman
494ccdf2c6
chore: update deprecated actions (#3052) 2024-05-16 13:02:10 +03:00
Roman Gershman
73e44a941e
chore: reset enable_direct_fd to avoid socket leakage in kernel (#3051)
The leakage can be identified by checking /proc/net/sockstat
Fixes #3045

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-16 09:44:53 +03:00
Roman Gershman
6b8a8b6410
fix: header for oom_errors_total (#3043) 2024-05-13 14:00:47 +03:00
Roman Gershman
5bf7e3b146
chore: update helio together with new mimalloc version (#3040)
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-13 12:48:05 +03:00
Roman Gershman
8721ca7fca
chore: add half-range indices (#3041)
Add indices in form of [:end] or [start:]
Also, enable jsonpathv2 by default

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-13 10:30:58 +03:00
Roman Gershman
3e0a9e16cc
chore: prevent updating gcc on macos (#3037)
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-13 10:30:42 +03:00
Stepan Bagritsevich
d3a585113f
fix(set): fix random in SRANDMEMBER and SPOP commands (#3022)
Signed-off-by: Stepan Bagritsevich <sbagritsevich@quantumbrains.com>
2024-05-13 10:08:01 +03:00
Borys
4cd142d42c
fix: reduce delay when stop replica #3020 (#3028)
* fix: reduce delay when stop replica #3020
2024-05-12 17:30:06 +03:00
Roman Gershman
a9956e9723
feat: support subrange expressions in jsonpathv2 (#3036)
Support for expressions like `$.arr[1:-2]`.

The change applies to our own implementation of jsonpath,
jsoncons already supports this format.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-05-11 22:30:55 +03:00