1
0
Fork 0
mirror of https://github.com/dragonflydb/dragonfly.git synced 2024-12-14 11:58:02 +00:00
Commit graph

806 commits

Author SHA1 Message Date
Vladislav
7eff61c9ab
feat(server): Buffered streamer + use on stable state (#639) 2023-01-15 12:17:04 +03:00
Vladislav
7b7e3ea9d4
test(rdb): Add json dump & restore test (#678) 2023-01-15 12:00:47 +03:00
adiholden
cee7a9e67d
test(replication_test) : add replica flushall test (#669)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-15 09:28:30 +02:00
Vladislav
4d97918c7b
fix(server): Fix replication on a single thread (#676)
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-01-15 08:02:30 +02:00
Vladislav
861d12cdf5
fix(tests): Small pytest fixes (#673) 2023-01-14 23:49:24 +03:00
Roman Gershman
77550e1774
feat(server): disable EvictObjects that is too agressive
EvictObjects is trigerred when Dragonfly uses more memory than it is supposed to.
However, it decreases the quality of the original eviction policy, and since
Dragonfly does not use much memory than required, I decided to disable it.

A regular eviction policy (DashCache) was not changed.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-14 21:10:02 +02:00
Roman Gershman
613e3b8741
fix(server): Fix a bug with brpoplpush (#677)
fix(server): Fix a bug when an expired transaction stays in watched queue.

Now we remove the transaction from the watched queues in a consistent manner based on the
keys it was assigned to watch.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-14 20:18:28 +02:00
Vladislav
dd218fa037
feat(server): Json rdb support (#674) 2023-01-14 14:53:43 +03:00
Vladislav
9de347b66c
fix(server): Fix shutdown order (#675) 2023-01-14 10:01:35 +03:00
adiholden
50e14db6c7
bug(snapshot): on journal write entry with opcode COMMAND and MULTI_C… (#662)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-12 13:38:05 +02:00
Roman Gershman
16a3e557ae feat(server): Support brpoplpush for two shard case.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-12 12:00:10 +02:00
Roman Gershman
9ca636e49d feat(server): Implement brpoplpush for single shard case.
A simple case where both src and dest keys are located in the same shard.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-12 12:00:10 +02:00
Roman Gershman
fe2a491824 chore(server): list_family refactoring.
Move Op functions into cc file. Register BRPopLPush.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-12 12:00:10 +02:00
adiholden
ec1b118b80
feat(server family): impl ROLE command (#660)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-12 11:05:44 +02:00
Roman Gershman
427710e5c4 fix: improvements to caching tool 2023-01-11 15:11:37 +02:00
Boaz Sade
f221c10afb
fix(build): verify build image for releases (#664)
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-01-10 15:46:20 +02:00
Vladislav
5ef8454aa7
Pytests overhaul (#569) 2023-01-09 23:31:15 +03:00
adiholden
25a16ed343
bug(replica): multi command on single shard exec all commands (#661)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-09 17:15:20 +02:00
adiholden
60b3dd305a
feat(replica): enable multi cmd sync on flag (#656)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-09 16:04:05 +02:00
adiholden
53f3d860db
feat(server family): reject flushall and flushdb on multi command (#657)
* feat(server family): reject flushall and flushdb on multi command

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-09 12:00:15 +02:00
Vladislav
1fa5340c27
fix(server): Flush dbs before full sync (#659) 2023-01-09 12:11:17 +03:00
Vladislav
5750c0d334
fix(server): Fix db initialization in stable state (#658)
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-01-09 09:02:15 +02:00
Vladislav
3da6bd9f8d
fix(server): Fix bug in flushing in snapshot (#654)
* fix(server): Fix bug in flushing in snapshot

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-01-08 15:19:29 +02:00
adiholden
7ddde7c742
feat(helio): pull blocking counter fix (#655) 2023-01-08 14:51:27 +03:00
adiholden
77bd5f5a35
feat(replica): support multi shard commands new flow (#645) 2023-01-08 13:55:25 +03:00
Roman Gershman
5bc216776d
chore(server): snapshot stats fix (#653)
Fixed stats accounting. Now loop_serialized + side_saved should correspond to number of saved items in a shard.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-08 10:22:56 +02:00
Roman Gershman
2af9843fdc
fix(lua): fix a bug that truncates the last lua argument. (#652)
This happens when the last argument is a number because SNPrintF makes sure
to write \0 even though we did not account of that when passing capacity.
Since we allocate more than we use, the only thing we need to do is
to pass larger capacity.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-07 21:45:51 +02:00
Devang Jhabakh Jai
f4457be767
feat(tools): Add Zipfian cache testing tool (#640)
* adding cache testing tool

Signed-off-by: Ubuntu <ubuntu@ip-172-31-12-15.us-west-2.compute.internal>
2023-01-07 08:58:00 +02:00
yingshaoxo
1895d3113e
Update README.md (#633)
* Update README.md

add docker-compose example config

Signed-off-by: yingshaoxo <yingshaoxo@gmail.com>
2023-01-05 15:32:15 +02:00
Philipp B
b3228fe3a0
feat(container): make healthcheck tls compatible (#643)
Signed-off-by: Philipp Born <git@pborn.eu>
2023-01-05 13:28:29 +02:00
Philipp B
66cff983cb
feat(chart): add feature to generate/request TLS certificate through cert-manager (#644)
Signed-off-by: Philipp Born <git@pborn.eu>
2023-01-05 12:27:40 +02:00
adiholden
3065946b9a
feat(replica): support multi transaction command (#634) 2023-01-04 09:11:30 +02:00
ashotland
b944324bbf
chore(server): Add metrics (#638)
Signed-off-by: ashotland <ashotland@gmail.com>

Signed-off-by: ashotland <ashotland@gmail.com>
2023-01-04 09:07:11 +02:00
ashotland
21d542efb0 chore(helm-chart): update to v0.13.1 2023-01-02 11:16:21 +00:00
Roman Gershman
f7e70bc45a
fix(server): version check bugs (#632)
1. Align checked version with the format provided by the endpoint
2. Improve error reporting as well as install ca certificates in the docker file.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-02 11:43:06 +02:00
Bruno Picinin Cardoso
a7186c5baa
Update README.md (#631)
Signed-off-by: Bruno Picinin Cardoso <brunopicinin@gmail.com>

Signed-off-by: Bruno Picinin Cardoso <brunopicinin@gmail.com>
2023-01-02 08:02:37 +02:00
romange
3be4a9feb2 chore(helm-chart): update to v0.13.0 2023-01-01 20:09:53 +00:00
Boaz Sade
51a78a3ad3
feat(server): using memory defrag with per shard mem info (#616)
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-01-01 18:50:57 +02:00
Boaz Sade
1286bac238
fix(server): only print version if successfully connect. (#628)
fix(server): only print version if successfullyy connect

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-01-01 14:10:42 +02:00
Vladislav
443ab9587d
feat(server): Update helio, optimize and clean up rdb/snapshot (#625) 2022-12-31 13:32:00 +03:00
Vladislav
7788600c9b
feat(server): Buffered journal serializers (#619) 2022-12-30 16:18:37 +03:00
ashotland
f204f1c670
Cache logs player batching (#623)
* feat(tools):cache log player batching all the way optimization

Signed-off-by: ashotland <ashotland@gmail.com>

* feat(tools): cache log player add one last print stats after completion

Signed-off-by: ashotland <ashotland@gmail.com>

Signed-off-by: ashotland <ashotland@gmail.com>
2022-12-30 12:29:11 +03:00
Philipp B
c3de3ef2f3
chore: overhaul chart (#620)
This should greatly improve readability of the chart itself
- moved the `Pod` spec for both the `Deployment` and `StatefulSet` into a common template in `_pod.yaml`
- replace a bunch of `if $value; print $value`-type blocks with `with $value; print .`
- replaced `command.set` in `values.yaml` with `command` directly
  - this was broken anyways, as the chart wrongly referenced `command.cmd` for both `Deployment` and `StatefulSet`
- populated contrib/charts/dragonfly/ci/ folder for development/CI purposes

Signed-off-by: Philipp Born <git@pborn.eu>

Signed-off-by: Philipp Born <git@pborn.eu>
2022-12-30 08:30:11 +02:00
Philipp B
589a6ffd00
feat(ci test): add testing for helm chart (#622)
feat: add lint-test-chart job to CI

Signed-off-by: Philipp Born <git@pborn.eu>

Signed-off-by: Philipp Born <git@pborn.eu>
2022-12-29 18:22:09 +02:00
ashotland
cee5af1baf
feat(tools):cache log player batching all the way optimisation (#617)
feat(tools):cache log player batching all the way optimization

Signed-off-by: ashotland <ashotland@gmail.com>

Signed-off-by: ashotland <ashotland@gmail.com>
2022-12-29 16:01:01 +02:00
Pierre Jambet
febcda7935
docs(quickstart): Clarify docker command for macOS (#612)
Clarify docker command for macOS

I had issues when running the command on my m2 macbook air. [It turns
out][1] that apparently docker desktop on macOS doesn't really support
the host option.

Additionally, it looks like I had to explicitly pass the port mapping
options for the ports to be actually mapped.

There might be a better and more efficient solution, but this is what I
came up with and it finally worked.

[1]:https://github.com/docker/for-mac/issues/1031
2022-12-28 18:43:50 +02:00
ashotland
92454c6fc8
fix(tools): cache logs player handle append as redis append (#615)
Signed-off-by: ashotland <ari@dragonflydb.io>

Signed-off-by: ashotland <ari@dragonflydb.io>
2022-12-28 17:04:53 +03:00
ashotland
5638f65226
feat(tools):Cache logs player (#614)
Signed-off-by: ashotland <ari@dragonflydb.io>

Signed-off-by: ashotland <ari@dragonflydb.io>
2022-12-28 14:58:31 +03:00
Roman Gershman
63b83c5b99
chore: Add tiered_storage_test. (#613)
1. Support tiered deletion.
2. Add notion of tiered entity in "DEBUG OBJECT" output.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2022-12-28 10:37:55 +02:00
ashotland
e39d266abe
fix(server):set of existing object with expiry (issue#607) (#609)
fix(server):set of existing object with expriy (issue#607)

Signed-off-by: ashotland <ari@dragonflydb.io>

Signed-off-by: ashotland <ari@dragonflydb.io>
2022-12-27 18:09:01 +02:00