mirrors/dragonflydb-dragonfly
1
0
Fork 0
mirror of https://github.com/dragonflydb/dragonfly.git synced 2024-12-14 11:58:02 +00:00
Code Activity
796 commits 52 branches 82 tags 81 MiB
Commit graph

796 commits

This branch
This branch
All branches
Author SHA1 Message Date
Roman Gershman
69b00b9cdd feat(server): Integrate set_map into hset_family 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-24 17:21:57 +02:00
Roman Gershman
5d34f271e9 feat(server): Extend string_map api, fix AddOrSet method. 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-24 17:21:57 +02:00
Roman Gershman
9375a48f71 feat(core): Add StringMap data structure. 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-24 17:21:57 +02:00
Roman Gershman
adb3266825
feat(server): Redesign and simplify tiered storage module. (#589) 
1. Allow offloading blobs larger than 2KB.
2. Totally redesign the offloading algorithm for blobs smaller than 2KB.
3. Fix bugs around IO request cancelations.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-22 03:58:58 +02:00
Philipp B
b5f6629d55
fix(chart): probe indentation (#590) 
No idea why it worked before.. Fixes #588

Signed-off-by: Philipp Born <git@pborn.eu>

Signed-off-by: Philipp Born <git@pborn.eu>
 2022-12-21 22:03:12 +02:00
Vladislav
2386b02234
feat(server): Use new journal format (#563) 2022-12-20 16:38:19 +03:00
Roman Gershman
cdc31fc98c
fix: handle corner case when comitted memory is negative (#570) 
Set mem_defrag_threshold so that defrag will be trigerred when memory grows.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-19 13:56:20 +02:00
Roman Gershman
5f572f00f1
fix: choose an appropriate SIMD implementation for aarch64 (#579) 2022-12-19 12:18:41 +02:00
Roman Gershman
69d9ef2c03
chore: Improve the implementation of simd based packing (#577) 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-18 19:59:34 +02:00
adiholden
d11b0d10da
bug(rdb load): Rdb loader tasks stop running on failure #567 (#576) 
Signed-off-by: adi_holden <adi@dragonflydb.io>

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-18 18:25:13 +02:00
Roman Gershman
c18cb8208e
feat: implement ascii_unpack using SIMD instructions (#573) 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-18 17:27:30 +02:00
Roman Gershman
bcafd7e25d
feat: introduce simd algorithm for bitpacking (#568) 
My benchmark shows a x3.5 improvement when compressing a 1KB string.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-17 19:22:40 +02:00
Roman Gershman
adc89c7592
chore: Adding a mpsc intrusive queue based on Vyukov's design (#562) 
feat(server): Speed up rdb load by using object pool for parsing objects.

1. Add a mpsc intrusive queue based on Vyukov's design.
2. Use it as a object pool when we pull from the queue to reuse the existing object
   and push into it in order to return the object back to the pool.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-16 17:54:55 +02:00
Roman Gershman
d4cad11f86
chore: Refactor RdbLoad (#564) 
Specifically, pass OpaqueObj to parsing routines so that they could fill it instead of creating it.
In addition, this change improves the interface between generic_family and RdbLoad code:
it removes reliance on the internal Item class.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-16 16:41:47 +02:00
Vladislav
08803e664c
feat(server): New auto-journal types/read/write (#560) 2022-12-15 23:42:00 +03:00
Boaz Sade
3d610ee2d7
feat(server): JSON family using JSON type (#561) 
feat(server): json family using json type

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-12-14 19:25:10 +02:00
Boaz Sade
dba4c6bd54
feat(server): active memory defrag test application (#552) 
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-12-13 14:34:32 +02:00
Roman Gershman
444f7e3f03
Support offloading of blobs longer than 2KB (#559) 
feat: Support offloading of blobs longer than 2KB
 2022-12-13 04:30:03 +02:00
Tomato6966
0efa1c92c4
added example of start script (#557) 
* added example of start script

+ removed duplicated explanation

Signed-off-by: Tomato6966 <chris.pre03@gmail.com>
 2022-12-11 17:52:42 +02:00
adiholden
53e18673a9
feat(ci test): add build and test on release mode (#556) 2022-12-11 13:52:45 +02:00
Vladislav
f98d6f3357
feat(server): Implement robust error & cancellation on replica (#531) 2022-12-11 12:11:25 +03:00
Vladislav
a0fe3c3dcc
chore: Update helio dependency (#555) 
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2022-12-10 18:02:28 +02:00
Roman Gershman
23c902d8e9
chore: Update helio dependency (#553) 
Switch to using fibers_ext::Fiber.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-09 16:43:41 +02:00
Boaz Sade
c34270c02d
feat(server): json set type support (#546) 
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-12-08 15:32:58 +02:00
adiholden
ae9e3c45d9
Support lz4 compression (#545) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-08 09:41:55 +02:00
Philipp B
2a67dc307e
feat: add healtcheck for container (#544) 
feat: add netcat based healtcheck

(similar to `redis-cli ping`)

Signed-off-by: Philipp Born <git@pborn.eu>
 2022-12-07 16:44:07 +02:00
arukiidou
c698e9c25e
fix(helm): Chart.yaml - Add home, keywords, sources, kubeVersion (#542) 
fix(helm): Chart.yaml - add home, keywords, sources, kubeVersion

Signed-off-by: junya koyama <arukiidou@yahoo.co.jp>
 2022-12-07 12:37:35 +02:00
adiholden
90bc3ab8b8
feat(rdb save): Create compressor interface (#538) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-07 10:12:18 +02:00
romange
9aa9a78ea5 chore(helm-chart): update to v0.12.0 2022-12-07 04:23:34 +00:00
Roman Gershman
2d83aa995e
fix(github): add libzstd-dev dep to aarch64 release pipeline (#539) 2022-12-06 21:19:15 +02:00
adiholden
e21a212688
feat(rdb save): add Lz4Compressor (#536) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-06 15:46:06 +02:00
Boaz Sade
5aabc965ba
feat(server): defrag memory counter for total memory access (#537) 
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-12-06 15:27:18 +02:00
adiholden
d74b076e18
feat(rdb save): refactor move zstd serializer under rdb serializer (#533) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-06 13:28:19 +02:00
Boaz Sade
3efc5642bc
feat(server): adding matrices for memory defrag (#535) 
feat(server): adding marices for memory defrag

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-12-06 10:18:23 +02:00
Roman Gershman
7f89c5ddec
feat: add defrag support for small strings (#534) 
Complements #448.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-05 14:58:28 +02:00
adiholden
e803432e88
bug(rdb save): snapshot: on push data to channel check serializer len (#532) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-05 14:05:42 +02:00
adiholden
4a3bb0db19
bug(debug cmd): debug populate support random value population (#527) 
* bug(debug cmd): debug populate support random value population

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-04 16:07:16 +02:00
Boaz Sade
6ec4cf078c
feat(server): memory defrag support - unit tests added to verify #448 (#523) 
feat(server): active memory defrag task #448

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-12-04 16:00:12 +02:00
Roman Gershman
8bff194f83
chore: Add lz4 to the source dependency (#528) 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-12-04 15:59:27 +02:00
Vladislav
20e4e189c7
refactor(server): Refactor snapshot (#520) 
* refactor(server): Refactor snapshot
Signed-off-by: Vladislav <vlad@dragonflydb.io>
 2022-12-04 14:55:26 +02:00
adiholden
c7974a4e80
bug(rdb loader): When reading from zstd uncompressed buf skip ensure … (#525) 
* bug(rdb loader): When reading from zstd uncompressed buf skip ensure read flow

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-04 11:14:24 +02:00
adiholden
74d1839f97
feat(regression test): add timeout cpu info and inc frequecy (#524) 
Signed-off-by: adi_holden <adi@dragonflydb.io>

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-12-01 14:04:26 +02:00
Roman Gershman
cd40bd76e4 fix: Use dev image for running regression tests (#521) 2022-11-30 15:43:17 +02:00
Boaz Sade
26b03145f9 feat(server): acrtive memory defrag high level flow 
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
 2022-11-30 14:27:59 +02:00
adiholden
574afe0143
feat(rdb save): serializer flush to sink only on flush call (#519) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-11-30 11:01:12 +02:00
adiholden
cf2ba8eb84
feat(rdb save): add unit test to save df with all compression levels (#517) 
feat(rdb save): add unit test to save df with all comression levels

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-11-29 15:14:43 +02:00
adiholden
685b4411e8
feat(rdb save): add blob compression on snapshot (#505) 
Signed-off-by: adi_holden <adi@dragonflydb.io>

Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-11-29 11:12:51 +02:00
adiholden
f57bf0dfe0
bug(server): exit not crash when port in use (#516) 
Signed-off-by: adi_holden <adi@dragonflydb.io>
 2022-11-29 10:42:57 +02:00
Vladislav
2493434b23
fix(server): Fix replication bug, add gdb opt to pytest (#513) 
fix(server): Fix small bugs, add gdb opt to pytest

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
 2022-11-28 16:28:14 +02:00
Roman Gershman
e43032842e
chore: tiered_storage - cleanups and refactorings. (#515) 
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
 2022-11-26 19:49:18 +02:00