shahar
f316d7a679
WIPWIPWIP
2024-11-11 10:19:52 +02:00
shahar
6aeb019890
!!!DO NOT REVIEW!!!
...
Attempt to reproduce crash on takeover
2024-11-11 09:18:20 +02:00
Roman Gershman
75c961e7ed
chore: Add initial bindings for QList in list_family ( #4093 )
...
The feature is guarded by list_experimental_v2 flag, which is disabled.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-10 07:40:50 +02:00
Roman Gershman
1819e51f78
chore: implement QList::Erase functionality ( #4092 )
...
* chore: implement QList::Erase functionality
Also add a parametrized test covering fill/compress options.
Fix a compression bug introduced when copying the code.
Introduce move c'tor/operator.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
* chore: implement QList::Replace functionality
Also add a parametrized test covering fill/compress options.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-09 20:06:32 +02:00
Kostas Kyrimis
d3ef0a3630
fix(sanitizers): disable false positive FtProfileInvalidQuery ( #4090 )
...
* disable FtProfileInvalidQuery
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-11-08 18:46:54 +02:00
Roman Gershman
5838ed99b4
chore: implement QList::Insert function ( #4087 )
...
* chore: implement QList::Insert function
Also add a basic test for Insertion.
Prepare the skeleton for Replace functionality.
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-08 11:33:37 +00:00
Vladislav
b860b712c0
chore(acl): Implicit categories ( #3411 )
...
Most of our CO:: categories became meaningless with the introduction of acl. For example, CO::FAST literally doesn't mean anything, it's never read or used.
* add implicit categories
---------
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-11-08 12:40:56 +02:00
Roman Gershman
c9537bb52e
chore: implement QList::Iterate ( #4086 )
...
Also, copy the main flow for the Insert function.
It's not finished yet, hence no tests yet.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-08 11:19:54 +02:00
Blanky
43060ba79e
chore(dependabot): Allows only security patches ( #4075 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
Signed-off-by: Blanky <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-08 08:08:33 +02:00
Roman Gershman
41d8df6e11
Add index based iterator to QList interface ( #4083 )
...
chore: add index based iterator to the interface
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-07 19:26:57 +00:00
Roman Gershman
2794239827
chore: Add QList::Iterator ( #4082 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-07 20:51:09 +02:00
Roman Gershman
d5a0ce4004
chore: add push functionality to QList class ( #4079 )
...
The code is copied from quicklist.c
No functional changes.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-07 12:14:42 +02:00
Roman Gershman
c75683277b
chore: add QList class ( #4078 )
...
This class will consolidate list functionality across multiple layers, and eventually replace the original quicklist code.
Right now we added the skeleton files and defined most of the interface.
The implementation is not done yet.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-07 11:13:12 +02:00
Roman Gershman
c19af2bd43
chore: parser clean ups ( #4077 )
...
1. Eliminate redundant states
2. Eliminate redundant member variables
Added some comments. No functional changes.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-07 10:07:48 +02:00
Roman Gershman
f8b3fa0d7b
feat: support GCS storage for saving/loading snapshots ( #4064 )
2024-11-06 12:11:59 +02:00
adiholden
ae3faf59fb
feat(server): dont use channel for replication / save df ( #4041 )
...
* feat server: dont use channel for replication / save df
Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-11-05 16:50:01 +02:00
Roman Gershman
7df8c268d8
chore: eliminate redundant ConnectionContext arguments ( #4065 )
2024-11-05 10:40:04 +02:00
dependabot[bot]
54c67a9198
chore(deps): bump pytest-repeat from 0.9.1 to 0.9.3 in /tests/dragonfly ( #4057 )
...
Bumps [pytest-repeat](https://github.com/pytest-dev/pytest-repeat ) from 0.9.1 to 0.9.3.
- [Release notes](https://github.com/pytest-dev/pytest-repeat/releases )
- [Changelog](https://github.com/pytest-dev/pytest-repeat/blob/main/CHANGES.rst )
- [Commits](https://github.com/pytest-dev/pytest-repeat/compare/v0.9.1...v0.9.3 )
---
updated-dependencies:
- dependency-name: pytest-repeat
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 23:47:24 +02:00
dependabot[bot]
aa4a61894d
chore(deps): bump docker/build-push-action from 5 to 6 ( #4055 )
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 5 to 6.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](https://github.com/docker/build-push-action/compare/v5...v6 )
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:38:06 +02:00
dependabot[bot]
d6ec5910d1
chore(deps): bump github/codeql-action from 3.24.9 to 3.27.0 ( #4054 )
...
Bumps [github/codeql-action](https://github.com/github/codeql-action ) from 3.24.9 to 3.27.0.
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](1b1aada464...662472033e
2024-11-04 22:37:51 +02:00
dependabot[bot]
8dc12a39e5
chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.0 ( #4053 )
...
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action ) from 2.3.1 to 2.4.0.
- [Release notes](https://github.com/ossf/scorecard-action/releases )
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md )
- [Commits](0864cf1902...62b2cac7ed
2024-11-04 22:37:07 +02:00
dependabot[bot]
f67103f9b0
chore(deps): bump mozilla-actions/sccache-action from 0.0.4 to 0.0.6 ( #4051 )
...
Bumps [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action ) from 0.0.4 to 0.0.6.
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases )
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.4...v0.0.6 )
---
updated-dependencies:
- dependency-name: mozilla-actions/sccache-action
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:36:20 +02:00
dependabot[bot]
18f7d9bbd5
chore(deps): bump mikepenz/action-junit-report from 4 to 5 ( #4052 )
...
Bumps [mikepenz/action-junit-report](https://github.com/mikepenz/action-junit-report ) from 4 to 5.
- [Release notes](https://github.com/mikepenz/action-junit-report/releases )
- [Commits](https://github.com/mikepenz/action-junit-report/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: mikepenz/action-junit-report
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:35:47 +02:00
dependabot[bot]
94ee96afd0
chore(deps): bump redis-om from 0.2.2 to 0.3.3 in /tests/dragonfly ( #4060 )
...
Bumps [redis-om](https://github.com/redis/redis-om-python ) from 0.2.2 to 0.3.3.
- [Release notes](https://github.com/redis/redis-om-python/releases )
- [Commits](https://github.com/redis/redis-om-python/compare/v0.2.2...v0.3.3 )
---
updated-dependencies:
- dependency-name: redis-om
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:35:18 +02:00
dependabot[bot]
eedb04509d
chore(deps): bump github.com/gruntwork-io/terratest from 0.41.11 to 0.47.2 in /contrib/charts/dragonfly ( #4058 )
...
chore(deps): bump github.com/gruntwork-io/terratest
Bumps [github.com/gruntwork-io/terratest](https://github.com/gruntwork-io/terratest ) from 0.41.11 to 0.47.2.
- [Release notes](https://github.com/gruntwork-io/terratest/releases )
- [Commits](https://github.com/gruntwork-io/terratest/compare/v0.41.11...v0.47.2 )
---
updated-dependencies:
- dependency-name: github.com/gruntwork-io/terratest
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:34:48 +02:00
dependabot[bot]
b70f9703f4
chore(deps): bump tomli from 2.0.1 to 2.0.2 in /tests/dragonfly ( #4059 )
...
Bumps [tomli](https://github.com/hukkin/tomli ) from 2.0.1 to 2.0.2.
- [Changelog](https://github.com/hukkin/tomli/blob/master/CHANGELOG.md )
- [Commits](https://github.com/hukkin/tomli/compare/2.0.1...2.0.2 )
---
updated-dependencies:
- dependency-name: tomli
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:31:29 +02:00
dependabot[bot]
86b64d910a
chore(deps): bump github.com/redis/go-redis/v9 from 9.5.1 to 9.7.0 in /tools/replay ( #4062 )
...
chore(deps): bump github.com/redis/go-redis/v9 in /tools/replay
Bumps [github.com/redis/go-redis/v9](https://github.com/redis/go-redis ) from 9.5.1 to 9.7.0.
- [Release notes](https://github.com/redis/go-redis/releases )
- [Changelog](https://github.com/redis/go-redis/blob/master/CHANGELOG.md )
- [Commits](https://github.com/redis/go-redis/compare/v9.5.1...v9.7.0 )
---
updated-dependencies:
- dependency-name: github.com/redis/go-redis/v9
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:31:01 +02:00
dependabot[bot]
ceb474fbda
chore(deps): bump numpy from 1.24.1 to 2.1.3 in /tools ( #4063 )
...
Bumps [numpy](https://github.com/numpy/numpy ) from 1.24.1 to 2.1.3.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/RELEASE_WALKTHROUGH.rst )
- [Commits](https://github.com/numpy/numpy/compare/v1.24.1...v2.1.3 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:30:34 +02:00
Roman Gershman
8d61a91200
chore: pass reply_builder explicitly to pubsub module ( #4021 )
...
Also, deprecate `reply_builder()` access method.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-04 19:20:12 +02:00
BLANKatGITHUB
fb7ea6c827
feat(dependabot): Add dependabot to check for vulnerabilies and updat… ( #4035 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
* feat(dependabot): Adds dependabot to update dependencies automatically
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
* feat(dependabot): adds support for dependabot
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-04 19:19:04 +02:00
Stepan Bagritsevich
7ac853567b
fix(search_family): Fix crash in FT.PROFILE command for invalid queries ( #4043 )
...
* refactor(search_family): Remove unnecessary std::move in FT.SEARCH
Signed-off-by: Stepan Bagritsevich <stefan@dragonflydb.io>
* fix(search_family): Fix crash in FT.PROFILE command for invalid queries
fixes dragonflydb#3983
Signed-off-by: Stepan Bagritsevich <stefan@dragonflydb.io>
* refactor(search_family_test): address comments
Signed-off-by: Stepan Bagritsevich <stefan@dragonflydb.io>
---------
Signed-off-by: Stepan Bagritsevich <stefan@dragonflydb.io>
2024-11-04 18:18:12 +01:00
Kostas Kyrimis
9c2fc3fe63
chore: add ForceUpdate to BPTree ( #3993 )
...
ReallocIfNeeded deleted and reinserted the same key in the BPTree stored in SortedMap. This is not really needed since the key is actually the same and we can just update the pointer within BPTree instead of doing the deletion + insertion chore.
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-11-04 15:53:13 +02:00
Kostas Kyrimis
4859077122
chore(DenseSet): defrag all links in a chain ( #4019 )
...
* add defrag for all nodes in a link chain
* add tests
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-11-04 08:34:22 +00:00
Roman Gershman
cc6fdd7fbf
chore: add retry to test_noreply_pipeline test ( #4045 )
2024-11-04 08:32:48 +00:00
Roman Gershman
76b1f537b5
chore: refactor part of s3 logic for loading a snapshot. ( #4044 )
...
Is done as preparation to share some of its code with GCS implementation.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-04 10:13:53 +02:00
Kostas Kyrimis
e103254cf9
chore: add tx queue head debug info in AnalyzeTxQueue ( #4026 )
...
* add tx queue head debug info in AnalyzeTxQueue
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-11-04 09:41:18 +02:00
Borys
e4b468d953
fix: reduce memory consumption during migration ( #4017 )
...
* refactor: reduce memory consumption for RestoreStreamer
* fix: add Throttling into RestoreStreamer::WriteBucket
2024-11-03 17:03:45 +02:00
Borys
5a597cf6cc
test: update test_big_containers ( #4025 )
2024-11-03 16:20:11 +02:00
BLANKatGITHUB
121a01f78a
feat(pre-commit): adds senstive data check like api keys and linting … ( #4030 )
...
* feat(pre-commit): adds senstive data check like api keys
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-02 09:44:00 +02:00
Borys
cd2ab4a585
chore: decrease logs severity for OOM from error to warning ( #4031 )
2024-11-01 11:12:28 +02:00
Roman Gershman
30728021d0
chore: pull helio ( #4036 )
2024-11-01 11:09:49 +02:00
Roman Gershman
d10e76b408
chore: support load/save from GCS ( #4006 )
...
Not everything is supported but manual load save is supported.
1. Run dragonfly with `--dir gs://bucket/path`
2. In redis-cli:
a. SET foo bar
b. SAVE DF gsdump
c. DFLY LOAD gs://bucket/path/gsdump-summary.dfs
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-10-30 13:57:58 +02:00
Kostas Kyrimis
daf8604175
chore: flush journal to channel for non auto journal commands ( #3945 )
...
* flush journal to channel for non auto journal commands
2024-10-30 12:09:01 +02:00
Roman Gershman
c8b56b69b4
chore: print info stats if test_noreply_pipeline fails ( #4016 )
2024-10-30 08:17:15 +00:00
Roman Gershman
6f6897cef1
chore: pass RedisReplyBuilder explicitly from dragonfly connection ( #4009 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-10-29 14:52:09 +02:00
Kostas Kyrimis
566f246cee
chore: skip AggregateWithLoadOptionHard on sanitizers (false positive) ( #4013 )
...
The test fails because of false positive so I disabled it.
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-10-29 14:26:50 +02:00
Roman Gershman
7737bb46f8
chore: improve verbosity logging during shutdown ( #4010 )
...
Increase verbosity levels of uring_proactor if deadlock was detected in debug mode.
Also allow optionally to disable periodic fiber, which sometimes helps during the debugging.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-10-29 13:45:57 +02:00
Kostas Kyrimis
4b495182e8
fix: separate Heartbeat and ShardHandler to fibers ( #3936 )
...
* separate shard_handler from Heartbeat
* add test
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-10-29 09:22:53 +02:00
Diskein
f16a32582e
feat(zset_family): support WITHSCORE in zrevrank/zrank commands ( #3921 ) ( #4001 )
...
Signed-off-by: Diskein <kalantaevskii@gmail.com>
2024-10-29 04:44:27 +02:00
Roman Gershman
92be74f4e4
fix: build break in search_family ( #4008 )
...
Also perform additional clean-up of cntx->reply_builder() - Part11
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-10-28 17:40:27 +02:00
