dependabot[bot]
4a55a0ab60
chore(deps): bump github/codeql-action in the actions group
...
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.5 to 3.27.6
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](f09c1c0a94...aa57810251
2024-12-09 18:09:10 +00:00
Roman Gershman
a87d6aecef
chore: fully support qlist in all list_family commands ( #4201 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-27 13:56:56 +02:00
dependabot[bot]
5c84f21caf
chore(deps): bump github/codeql-action from 3.27.4 to 3.27.5 in the actions group ( #4186 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.4 to 3.27.5
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](ea9e4e3799...f09c1c0a94
2024-11-26 10:04:40 +02:00
Roman Gershman
2c663f3833
chore: produce core files in regtests ( #4185 )
...
Should work only for self-hosted runners.
The core files will be kept in /var/crash/
We also copy automatically dragonfly binary into /var/crash to be able to debug later.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-11-25 17:13:11 +00:00
Tarun Pothulapati
3d68c9c99e
fix(release/helm): allow empty commits for rerun ( #4163 )
...
* fix(release/helm): allow empty commits for rerun
* remove empty commit and just move forward
2024-11-25 08:29:10 +00:00
dependabot[bot]
907346e3e6
chore(deps): bump github/codeql-action from 3.27.1 to 3.27.4 in the actions group ( #4148 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.1 to 3.27.4
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](4f3212b617...ea9e4e3799
2024-11-18 23:05:42 +02:00
Daniel M
d241839cff
chore:update fakeredis, remove irrelevant tests ( #4014 )
...
* chore:update fakeredis, remove irrelevant tests
2024-11-17 20:24:46 +02:00
dependabot[bot]
a887d822a9
chore(deps): bump github/codeql-action from 3.27.0 to 3.27.1 in the actions group ( #4115 )
...
chore(deps): bump github/codeql-action in the actions group
Bumps the actions group with 1 update: [github/codeql-action](https://github.com/github/codeql-action ).
Updates `github/codeql-action` from 3.27.0 to 3.27.1
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](662472033e...4f3212b617
2024-11-14 19:28:25 +02:00
Blanky
43060ba79e
chore(dependabot): Allows only security patches ( #4075 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
Signed-off-by: Blanky <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-08 08:08:33 +02:00
dependabot[bot]
aa4a61894d
chore(deps): bump docker/build-push-action from 5 to 6 ( #4055 )
...
Bumps [docker/build-push-action](https://github.com/docker/build-push-action ) from 5 to 6.
- [Release notes](https://github.com/docker/build-push-action/releases )
- [Commits](https://github.com/docker/build-push-action/compare/v5...v6 )
---
updated-dependencies:
- dependency-name: docker/build-push-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:38:06 +02:00
dependabot[bot]
d6ec5910d1
chore(deps): bump github/codeql-action from 3.24.9 to 3.27.0 ( #4054 )
...
Bumps [github/codeql-action](https://github.com/github/codeql-action ) from 3.24.9 to 3.27.0.
- [Release notes](https://github.com/github/codeql-action/releases )
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md )
- [Commits](1b1aada464...662472033e
2024-11-04 22:37:51 +02:00
dependabot[bot]
8dc12a39e5
chore(deps): bump ossf/scorecard-action from 2.3.1 to 2.4.0 ( #4053 )
...
Bumps [ossf/scorecard-action](https://github.com/ossf/scorecard-action ) from 2.3.1 to 2.4.0.
- [Release notes](https://github.com/ossf/scorecard-action/releases )
- [Changelog](https://github.com/ossf/scorecard-action/blob/main/RELEASE.md )
- [Commits](0864cf1902...62b2cac7ed
2024-11-04 22:37:07 +02:00
dependabot[bot]
f67103f9b0
chore(deps): bump mozilla-actions/sccache-action from 0.0.4 to 0.0.6 ( #4051 )
...
Bumps [mozilla-actions/sccache-action](https://github.com/mozilla-actions/sccache-action ) from 0.0.4 to 0.0.6.
- [Release notes](https://github.com/mozilla-actions/sccache-action/releases )
- [Commits](https://github.com/mozilla-actions/sccache-action/compare/v0.0.4...v0.0.6 )
---
updated-dependencies:
- dependency-name: mozilla-actions/sccache-action
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:36:20 +02:00
dependabot[bot]
18f7d9bbd5
chore(deps): bump mikepenz/action-junit-report from 4 to 5 ( #4052 )
...
Bumps [mikepenz/action-junit-report](https://github.com/mikepenz/action-junit-report ) from 4 to 5.
- [Release notes](https://github.com/mikepenz/action-junit-report/releases )
- [Commits](https://github.com/mikepenz/action-junit-report/compare/v4...v5 )
---
updated-dependencies:
- dependency-name: mikepenz/action-junit-report
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-04 22:35:47 +02:00
BLANKatGITHUB
fb7ea6c827
feat(dependabot): Add dependabot to check for vulnerabilies and updat… ( #4035 )
...
* feat(dependabot): Add dependabot to check for vulnerabilies and update dependencies
* feat(dependabot): Adds dependabot to update dependencies automatically
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
* feat(dependabot): adds support for dependabot
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-11-04 19:19:04 +02:00
BLANKatGITHUB
851e43211e
refactor(workflow): changes default permissions to read for few workflows increasing security ( #3905 )
...
* refactor: makes read default permision
---------
Signed-off-by: BLANKatGITHUB <131886247+BLANKatGITHUB@users.noreply.github.com>
2024-10-26 19:58:23 +03:00
Ishmael Rufus
7b5fc9a244
fix(build): Reduced checks permission in build to read #3821 ( #3916 )
...
Reduced permission to read
2024-10-24 21:35:49 +03:00
Stepan Bagritsevich
ea9dc9c454
chore(fakeredis): Enable JSON tests in the Fakeredis tests ( #3773 )
...
* chore(fakeredis): Enable JSON tests in the Fakeredis tests
fixes dragonflydb#3671
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
* refactor: address comments
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
* tmp commit
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
* refactor: address comments 2
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
---------
Signed-off-by: Stsiapan Bahrytsevich <stefan@dragonflydb.io>
2024-10-23 08:53:14 +02:00
Kostas Kyrimis
d2a83121e4
fix: pre-commit ci workflow ( #3917 )
...
* fix: pre-commit ci workflow
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-10-15 12:15:57 +03:00
Daniel M
1958e09a9a
refactor: refactor fakeredis tests ( #3852 )
...
* refactor:fakeredis tests
2024-10-03 12:41:05 +03:00
Andy Dunstall
a64fc74ce1
tests: fix and enable s3 snapshot test ( #3720 )
...
* test: fix s3 snapshot test
* ci: configure s3 regression test
* tests: only run s3 snapshot test if bucket not empty
2024-09-17 17:35:53 +03:00
Roman Gershman
e21ba0b3d9
chore: symbolize stack traces in tests upon crash ( #3714 )
...
We disable address space randomization when building the binary
and use addr2line to symbolize the stacktrace if it exists.
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-16 13:43:16 +03:00
Roman Gershman
b7b96424e4
deprecate RecordsPopper and serialize channel records during push ( #3667 )
...
chore: deprecate RecordsPopper and serialize channel records during push
Records channel is redundant for DFS/replication because we have single producer/consumer
scenario and both running on the same thread. Unfortunately we need it for RDB snapshotting.
For non-rdb cases we could just pass a io sink to the snapshot producer,
so that it would use it directly instead of StringFile inside FlushChannelRecord.
This would reduce memory usage, eliminate yet another memory copy and generally would make everything simpler.
For that to work, we must serialize the order of FlushChannelRecord, and that's implemented by
this PR. Also fixes #3658 .
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-09 06:19:04 +00:00
Daniel M
eef5be1729
test: remove redundant tests ( #3642 )
...
* test: remove redundant tests
* remove more tests
* add test_bitmap_commands
* add test_bitmap_commands and test_geo_commands to ignore list
2024-09-04 23:55:35 +03:00
Roman Gershman
e6f5a2073c
fix: crash when passing empty arguments ( #3627 )
...
* fix: crash when passing empty arguments
Fix the case where we pass an empty argument, which then is parsed as an
empty string view with null pointer. The null pointer is not handled correctly
by our low level c code, hence switch to using ""sv for that.
* chore: add more list asserts + improve test_hypothesis
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-03 12:43:12 +03:00
Roman Gershman
1a0d44354f
fix: limit parsing in zrange commands ( #3626 )
...
1. The offset value can be negative, in that case we should return an empty array.
2. Fix edge cases of inf*0 and -inf + inf, so they will result in 0 and non NaN (similarily to Valkey).
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-03 10:08:45 +03:00
Roman Gershman
10de338926
chore: run fakeredis flow with the debug build ( #3612 )
...
1. Fix html publishing code
2. Upload dragonfly logs
3. Run it on pull requests
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-09-01 14:51:00 +03:00
Roman Gershman
20336805f3
chore: enable experimental_new_io by default. ( #3605 )
...
* chore: enable experimental_new_io by default.
It has been running for weeks with the flag on, so enabled it also for community.
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
Co-authored-by: Vladislav Oleshko <vlad@dragonflydb.io>
2024-08-29 23:30:26 +03:00
Daniel M
a66cbe150e
fix: fakeredis tests support python 3.10 ( #3550 )
...
* fix:change to py3.10
* fix:change to py3.10
2024-08-23 22:31:35 +03:00
Daniel M
e3016a6f83
test: tests using fakeredis to check compatibility ( #3534 )
...
* fakeredis tests
2024-08-22 22:30:42 +03:00
Vladislav
1f36c9952d
chore(io): Introduce (carefully) new io with use_new_io flag ( #3513 )
...
Plugs in new IO, must be reverted after successful testing
2024-08-16 16:56:04 +03:00
Kostas Kyrimis
d37c2ec85a
fix: pytest warnings ( #3497 )
...
* fix truncating the timeout red dots on CI failures
* fix deprecated use of with timeout warnings
* remove @pytest.mark.dbg_only as it doesn't exist
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-08-13 16:05:15 +03:00
Kostas Kyrimis
634b08dc53
fix: sanitizers post failure on google chat ( #3496 )
...
* fix sanitizers failure post on google chat
* only report failures on main branch
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-08-12 07:04:57 +00:00
Roman Gershman
7c84b8e524
chore: change how we track memory_budget during evictions ( #3457 )
...
* chore: change how we track memory_budget during evictions
We compared memory_budget vs 0 before inserting a new item in DbSlice,
and retired cool pages if we are low on memory.
The problem - when we decide whether we allow growing a table, we estimate the possible object size increase due to the future table growth.
And the memory check described before was not consistent with the actual logic that rejected the insertion.
Moreover, the memory_budget tracking interaction with EvictionPolicy was over-complicated: we passed the memory_budget counter to the evp object
and then read it back, even though evp did not track object deletions memory impact during objects evictions.
Now, we remove the responsibility from evp to update memory_budget_ so it's solely updated by DbSlice.
We also update memory_budget_ during deletions, and when we pass it to evp, we add cool memory size as potential memory resource to avoid
rejections in case we have lots of cool memory.
Fixes #3456
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-08-07 15:43:45 +03:00
Kostas Kyrimis
ff716bb8b0
fix: missing logs on ci timeout ( #3452 )
...
The env variables exported when regression tests timeout are not working properly and the if statement on the action step Print last log on timeout would fail to read and upload the files set in /tmp/last_log_file.txt. Furthermore, another problem is the job.timeout argument that kills the whole job/matrix before the upload log step has a chance to run. For that, we need manual timeouts on the workflow similar to what we do in regression tests action.
* remove print last log on timeout action step
* copy the logs on timeout directly within the timeout step
* replace global timeout on CI workflow with timeout command per step
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-08-06 14:52:18 +03:00
Vladislav
55d39b66ff
chore: fix memcached pipeline test ( #3438 )
2024-08-04 15:41:17 +03:00
Kostas Kyrimis
1aa0720843
chore: increase timeout of regression tests ( #3412 )
...
The recent changes of the serialization_max_chunk_size set to 1 for extreme testing increased the running time of the tests causing them sometimes to timeout.
* increase timeout on reg tests from 40 to 50
---------
Signed-off-by: kostas <kostas@dragonflydb.io>
2024-07-31 07:28:44 +00:00
Roman Gershman
776bd79381
fix: reenable macos builds ( #3399 )
...
* fix: reenable macos builds
Also, add debug function that prints local state if deadlocks occure.
* fix: free cold memory for non-cache mode as well
* chore: disable FreeMemWithEvictionStep again
Because it heavily affects the performance when performing evictions.
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-07-28 22:40:51 +03:00
adiholden
e3eb8518fd
feat(test): Improve benchmark workflow ( #3330 )
...
Signed-off-by: adi_holden <adi@dragonflydb.io>
2024-07-17 14:34:48 +03:00
Borys
21620ef46f
fix: missing logs on pytest failures #3255 ( #3272 )
...
* fix: missing logs on pytest failures #3255
2024-07-10 10:58:54 +03:00
Stepan Bagritsevich
e914a5f7cf
fix(json_family): Fix error in JsonFamilyTest.MGet ( #3285 )
...
* fix(json_family): Fix error in JsonFamilyTest.MGet
Signed-off-by: Stepan Bagritsevich <bagr.stepan@gmail.com>
* refactor(json_family): address comments
Signed-off-by: Stepan Bagritsevich <bagr.stepan@gmail.com>
* refactor(json_family): Change LOG(WARNING) to VLOG(2)
Signed-off-by: Stepan Bagritsevich <bagr.stepan@gmail.com>
* fix(json_family): Test case when jsonpathv2 is false
Signed-off-by: Stepan Bagritsevich <bagr.stepan@gmail.com>
* refactor(json_family): Update VLOGs level from 2 to 1
Signed-off-by: Stepan Bagritsevich <bagr.stepan@gmail.com>
---------
Signed-off-by: Stepan Bagritsevich <bagr.stepan@gmail.com>
2024-07-09 16:02:33 +04:00
Roman Gershman
ff5c89d0ad
Create scorecard.yml ( #3270 )
...
add https://scorecard.dev/ tool scanning
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-07-08 08:34:13 +03:00
Roman Gershman
d8946247df
chore: upload all the logs from /tmp ( #3263 )
...
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-07-04 09:17:25 +03:00
Roman Gershman
506ecbc3cd
chore: add more logs around the duplicate value case in small_bins ( #3254 )
...
Helps investigating #3252
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-07-02 13:04:00 +03:00
Roman Gershman
dfc7f177c1
chore: update action versions ( #3250 )
2024-07-01 08:36:36 +00:00
Roman Gershman
3b920cbe5c
fix: total_stash_overflows statistic ( #3248 )
...
* fix: total_stash_overflows statistic
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-07-01 10:43:08 +03:00
Roman Gershman
0e375295e8
chore: introduce back-pressure to tiered storage ( #3243 )
...
* chore: introduce back-pressure to tiered storage
Also, so clean-up with mac-os daily build.
Enabled forgotten test.
Improve CI insights
---------
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2024-06-30 15:46:11 +03:00
Kostas Kyrimis
d207789610
chore(ci): run replication tests on arm ( #3168 )
...
* combine replication tests and reg tests in one flow
* allow replication tests to run on arm
2024-06-18 16:48:35 +03:00
Kostas Kyrimis
165631a5aa
fix(ci): add missing docker option on reg tests workflow ( #3172 )
...
* add missing option for iouring and docker
2024-06-13 10:55:45 +03:00
Kostas Kyrimis
a9ffb22384
fix(ci): docker not using iouring ( #3169 )
...
* fix(ci): docker not using iouring
* fix errors
2024-06-12 16:38:02 +03:00
