1
0
Fork 0
mirror of https://github.com/dragonflydb/dragonfly.git synced 2024-12-15 17:51:06 +00:00
Commit graph

96 commits

Author SHA1 Message Date
Roman Gershman
964eeee6f0
chore: Add bison to release build dependencies (#1215)
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-05-15 09:39:55 +03:00
adiholden
834b827a5d
chore(regression tests) : remove replication tests from arm host runner (#1174)
* test(regression): remove replication_test from regression arm

Signed-off-by: adi_holden <adi@dragonflydb.io>

* fix

Signed-off-by: adi_holden <adi@dragonflydb.io>

---------

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-05-02 22:24:49 +03:00
Roy Jacobson
de0b73312a
chore: Tweak debug symbols generation for releases (#1139)
* chore: Tweak debug symbols generation for releases

* Update helio (for blaze.sh changes)
2023-04-30 09:14:51 +03:00
adiholden
3b3350081c
chore: enable self hosted runner (#1116)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-04-20 11:36:04 +02:00
Roman Gershman
0ff22c6078
chore: disable self-hosted runner (#1067) 2023-04-10 22:24:34 +03:00
Roman Gershman
71a4c6dd45
chore: change Dragonfly to use fb2 helio library. (#1049)
It's a bit more efficient than Boost.Fibers due to better integrations
of Fibers with Proactor loop.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-04-09 16:41:10 +03:00
adiholden
f953946eff
feat(github): add self hosted runner to regression tests (#1016)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-03-31 19:59:55 +03:00
Tarun Pothulapati
6ea76e9daa
fix(ci): Use stripped binaries for docker images (#1006)
This PR updates the container release workflow to delete the
unstripped packages so that we prevent the stripped packages from
being overwritten.

This should reduce the size of the container images significantly.
2023-03-29 08:00:28 +03:00
Tarun Pothulapati
94b8951f5e fix(ci): Use correct x86-64 with builds
This commits fixes the flag to use the right format
for `x86-64`
2023-03-16 08:52:48 +02:00
Tarun Pothulapati
999caa1e4f feat(ci): Add daily builds BFS verification
This commit adds a scheduled job that runs 8 AM Israel time every day,
with common build configuration flags so that we can be sure
that building from source for known configurations is possible.
2023-03-14 23:17:08 +02:00
adiholden
8e528f1fbb
fix(redis_replicaiton_test): fix compare set types (#929)
* fix(redis_replicaiton_test): fix compare set types

Signed-off-by: ashotland <ari@dragonflydb.io>
Co-authored-by: ashotland <ari@dragonflydb.io>
2023-03-13 13:37:58 +02:00
Vahagn Aharonian
1371ce9270 feat(workflow): Add Vercel Docs Hook to release workflow 2023-03-12 08:15:57 +02:00
Tarun Pothulapati
5c57e4efe2
chore(helm): Make release pipeline to update golden files (#916)
Golden files need to be updated as version is updated in the
`Chart.yaml` file. This commit adds the step to update the golden
files in the release pipeline.

To make that possible, The following additional changes are also
required:
- `Go.Work`: This adds support multi-module projects as we will
   have the tests along with the operator in sub-folders. This
   is required to run go cmds from the root directory. (like
   running tests in this case).
- `.helmignore`: This updates the Helm chart to ignore the `/ci`
    folder during helm packaging as those are not required for
    users of the chart.
2023-03-08 23:35:47 +05:30
Vladislav
7cb2232edc
fix(pytest): Add master restart delay (#909)
- Add restart delay to master in crashing master test
- Add process check after force shutdown
- Increase time limit to 45 min
2023-03-06 00:16:57 +03:00
adiholden
86948efb4d
fix(regression-tests): fix cpu print step (#910)
* fix(regression-tests): fix cpu print step


Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-03-05 13:26:21 +02:00
Vladislav
95f422ab6e
fix(tests): Disable logging in replication tests (#906)
Disable debug logging in replication pytests
2023-03-04 21:42:12 +03:00
adiholden
4a5d2f2a9a
feat(regression test) : add regression test that run in optimiztion mode (#900)
* feat(regression test) : add run in opimiztion mode

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-03-02 16:33:52 +02:00
Roman Gershman
edd93a086c
fix: ci (#893)
Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-03-01 16:22:33 +02:00
Tarun Pothulapati
5dfaa1d061
test(chart): add golden file output rendering tests (#882)
This commit adds a new `golden_test.go` file into the helm chart
which essentially renders the chart with a set of values and
compares that with the expected golden file, and errors if
they don't match.

This builds on the existing CI values files in `ci/` directory. As
this is the first time, The golden files are rendered and added. This
means for all the future changes, The golden files can be updated
by running `go test -update` and the CI will fail if the golden files
are not updated. By doing this, Both the committer and reviewer
can be sure that the changes are intentional, without having to render
the chart manually.
2023-02-28 18:02:15 +05:30
adiholden
6a2b152e8b
feat(db slice): add fiber atomic gaurd (#878)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-02-26 13:38:37 +02:00
ashotland
1f82f9af73
fix(regression-test): Sentinel test stabilization (#826)
* Ditch docker whcih is complex on CI in favour of local redis binary

Signed-off-by: ashotland <ari@dragonflydb.io>

* Fix typo

Signed-off-by: ashotland <ari@dragonflydb.io>

* Wait for sentinel termination

Signed-off-by: ashotland <ari@dragonflydb.io>

* fix(regression-tests): sentinel test increase timeout waiting for key to
exist in replica

* debug sentinel test

Signed-off-by: ashotland <ari@dragonflydb.io>

* add pytest repeat - tmp comment out failure notficicaiton

Signed-off-by: ashotland <ari@dragonflydb.io>

* fix typo

Signed-off-by: ashotland <ari@dragonflydb.io>

* repeat 100

Signed-off-by: ashotland <ari@dragonflydb.io>

* Increase timeout for debuging

Signed-off-by: ashotland <ari@dragonflydb.io>

* Debug prints

Signed-off-by: ashotland <ari@dragonflydb.io>

* fix

Signed-off-by: ashotland <ari@dragonflydb.io>

* increase overall timeout

Signed-off-by: ashotland <ari@dragonflydb.io>

* Debug

Signed-off-by: ashotland <ari@dragonflydb.io>

* cleanup

Signed-off-by: ashotland <ari@dragonflydb.io>

---------

Signed-off-by: ashotland <ari@dragonflydb.io>
2023-02-20 14:21:27 +02:00
Vladislav
4ef06e759a
Basic multi modes for MULTI/EXEC (#796)
feat(server): Basic multi transaction modes

This commit adds the notion of multi transaction modes that allow controlling the execution and
locking behaviour of multi transactions.
In general, there are four modes:
- GLOBAL: all commands run within a global transaction. There is no need for recording locks. Lua scripts can theoretically run with undeclared keys.
- LOCK_AHEAD: the transaction locks all keys ahead likewise to a regular transaction and schedules itself.
- LOCK_INCREMENTAL: the transaction determines what shards it has keys in and schedules itself on those shards, but locks only when accessing a new key. This allows other transactions to run ooo alonside with a big multi-transaction that accesses a contended key only at its very end.
- NON_ATOMIC: all commands run separately, no atomicity is provided, likewise to a pipeline

This commit only adds support for the first 3 modes to EXEC commands.

Signed-off-by: Vladislav Oleshko <vlad@dragonflydb.io>
2023-02-18 20:18:28 +03:00
ashotland
2f89cdc6af
chore(regressions-tests): Update regression-tests.yml (#805)
* Update regression-tests.yml

Run every 3 hours
Add -s to pytest

Signed-off-by: ashotland <ari@dragonflydb.io>

* Update regression-tests.yml

Signed-off-by: ashotland <ari@dragonflydb.io>

---------

Signed-off-by: ashotland <ari@dragonflydb.io>
2023-02-16 12:16:39 +02:00
adiholden
ae6687e563
fix(regression-tests): increase timeout of regression-tests (#806)
Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-02-15 12:39:23 +02:00
Nick Gottlieb
15c856726a
update readme (#794)
* Add files via upload

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Delete logo-full.svg

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Rename logo.svg to logo-full.svg

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

* Update README.md

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>

---------

Signed-off-by: Nick Gottlieb <ngottlieb1@gmail.com>
2023-02-14 23:08:32 +02:00
adiholden
72bad6c5ab
fix(replica) : replica will not sync execution multi shard commands as default (#800)
-sfix(replica) : replica will not sync execution multi shard commands as default
2023-02-14 16:30:14 +02:00
adiholden
c5e8a627b5
test(regression-tests): stop replication regression-tests schedual run (#795)
* regression replication will not run on github schedual
* allow running regression replication manually

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-02-14 14:48:39 +02:00
Roman Gershman
83837532e9
chore(server): General improvements
1. Update helio dependency
2. Add SLOWLOG command stub that returns empty data.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-02-10 22:37:19 +02:00
ashotland
eb0bef4c33
Notify on cancelled too (#749)
Signed-off-by: ashotland <ari@dragonflydb.io>
2023-02-02 19:12:03 +03:00
Boaz Sade
c6e96a12c0
feat(action): build debian package for arm64 arch (#719) (#738)
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-02-01 11:43:21 +02:00
ashotland
353aa344ba
Add -x to pytest invocation (#735)
Signed-off-by: ashotland <ari@dragonflydb.io>
2023-01-31 12:23:32 +02:00
adiholden
152f16bc14
test(regression test): run regression tests on github actions every 6… (#734)
test(regression test): run regression tests on github actions every 6 hours

Signed-off-by: adi_holden <adi@dragonflydb.io>
2023-01-31 09:41:06 +02:00
ashotland
20a309ebd0
chore(ci):Reduce --gtest_repeat to 10 (#730)
Reduce --gtest_repeat to 10

Signed-off-by: ashotland <ari@dragonflydb.io>
2023-01-28 20:38:26 +02:00
Roman Gershman
90eb1d81b7
fix(lua): Fix a deadlock happenning when calling a lua script (#726)
The scenario is described in a unit test that reproduces the issue with high chance.
Also added dragonfly_test in repeat=100 mode to CI.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2023-01-25 10:16:52 +02:00
Boaz Sade
3360ff1704
feat(action): build debian package for arm64 arch (#719)
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-01-24 14:43:47 +02:00
Boaz Sade
a130b71cd9
feat(actions): add support for Debian packaging - add missing dependency (#701)
feat(actions): add support for debian packaging - add missing dependency

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-01-18 13:28:13 +02:00
Boaz Sade
be74fa0a5b
feat(actions): add support for debian packaging (#696)
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>

Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2023-01-18 09:29:28 +02:00
Philipp B
c3de3ef2f3
chore: overhaul chart (#620)
This should greatly improve readability of the chart itself
- moved the `Pod` spec for both the `Deployment` and `StatefulSet` into a common template in `_pod.yaml`
- replace a bunch of `if $value; print $value`-type blocks with `with $value; print .`
- replaced `command.set` in `values.yaml` with `command` directly
  - this was broken anyways, as the chart wrongly referenced `command.cmd` for both `Deployment` and `StatefulSet`
- populated contrib/charts/dragonfly/ci/ folder for development/CI purposes

Signed-off-by: Philipp Born <git@pborn.eu>

Signed-off-by: Philipp Born <git@pborn.eu>
2022-12-30 08:30:11 +02:00
Philipp B
589a6ffd00
feat(ci test): add testing for helm chart (#622)
feat: add lint-test-chart job to CI

Signed-off-by: Philipp Born <git@pborn.eu>

Signed-off-by: Philipp Born <git@pborn.eu>
2022-12-29 18:22:09 +02:00
Philipp Born
98b92a0073 feat: build and publish weekly alpha/development container image
- make use of docker buildx caching when possible (helpful with local docker builds)
- introduce a reusable container workflow which is triggered by docker-release and docker-weekly workflows
- added an alpine-dev Dockerfile
- split release.sh contents into different Makefile targets
- make use of job matrix to build alpine + ubuntu in parallel
- make alpine build optional by checking for Dockerfile presence
-- as the pre-built binaries don't work with alpine, because of glibc <-> musl incompatibilities

Signed-off-by: Philipp Born <git@pborn.eu>
2022-12-26 20:41:53 +02:00
Roman Gershman
bcafd7e25d
feat: introduce simd algorithm for bitpacking (#568)
My benchmark shows a x3.5 improvement when compressing a 1KB string.

Signed-off-by: Roman Gershman <roman@dragonflydb.io>
2022-12-17 19:22:40 +02:00
adiholden
53e18673a9
feat(ci test): add build and test on release mode (#556) 2022-12-11 13:52:45 +02:00
Roman Gershman
2d83aa995e
fix(github): add libzstd-dev dep to aarch64 release pipeline (#539) 2022-12-06 21:19:15 +02:00
adiholden
74d1839f97
feat(regression test): add timeout cpu info and inc frequecy (#524)
Signed-off-by: adi_holden <adi@dragonflydb.io>

Signed-off-by: adi_holden <adi@dragonflydb.io>
2022-12-01 14:04:26 +02:00
Roman Gershman
cd40bd76e4 fix: Use dev image for running regression tests (#521) 2022-11-30 15:43:17 +02:00
Boaz Sade
26b03145f9 feat(server): acrtive memory defrag high level flow
Signed-off-by: Boaz Sade <boaz@dragonflydb.io>
2022-11-30 14:27:59 +02:00
Philipp B
96989b2124
feat(actions): push helm chart as OCI image (#500)
Signed-off-by: Philipp Born <git@pborn.eu>

Signed-off-by: Philipp Born <git@pborn.eu>
2022-11-17 17:02:18 +02:00
zNNiz
57a313cf5a
A dedicated github actions pipeline that build dragonfly and runs pyt… (#490)
Adding a regression pipeline

A dedicated github actions pipeline that build dragonfly and runs pytests located under "tests/dragonfly" every 3 days

Fixes #291

Signed-off-by: zNNiz <96877065+zNNiz@users.noreply.github.com>
2022-11-16 13:05:43 +02:00
Leonardo Mello
e46e5819c9
ci: added clang pre-commit hook (#461)
Signed-off-by: Leonardo Mello <lsvmello@gmail.com>
2022-11-05 22:16:57 +02:00
Ran Ribenzaft
63f8e00273
ci(workflow): fixing discord notification link (#419)
Signed-off-by: Ran Ribenzaft <ranrib@users.noreply.github.com>
2022-10-23 21:44:06 +03:00