24434 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Renaud Allard	8291aa8fd7	Support both import names of PyPI package python-multipart. (#17932)	2024-11-20 11:48:04 +00:00
Erik Johnston	1092a35a2a	Speed up slow initial sliding syncs on large servers (#17946) ... This was due to a missing index, which meant that deleting previous connections associated with the device and `conn_id` took a long time.	2024-11-19 15:03:32 +00:00
Richard van der Hoff	c5e89f5fae	Create one-off scheduled task to delete old OTKs (#17934) ... To work around the fact that, pre-https://github.com/element-hq/synapse/pull/17903, our database may have old one-time-keys that the clients have long thrown away the private keys for, we want to delete OTKs that look like they came from libolm. To spread the load a bit, without holding up other background database updates, we use a scheduled task to do the work.	2024-11-19 11:20:48 +00:00
dependabot[bot]	e918f683d4	Bump serde from 1.0.214 to 1.0.215 (#17938)	2024-11-18 15:48:26 +00:00
dependabot[bot]	4efd1056ca	Bump packaging from 24.1 to 24.2 (#17940)	2024-11-18 15:48:05 +00:00
dependabot[bot]	0f32408c80	Bump phonenumbers from 8.13.49 to 8.13.50 (#17942)	2024-11-18 15:47:54 +00:00
dependabot[bot]	9d837daa8a	Bump immutabledict from 4.2.0 to 4.2.1 (#17941)	2024-11-18 15:24:44 +00:00
Richard van der Hoff	d72843056b	Add some documentation about backing up Synapse (#17931) ... Fixes: https://github.com/element-hq/element-meta/issues/2155 Fixes: https://github.com/element-hq/synapse/issues/2046	2024-11-18 14:05:49 +00:00
Devon Hudson	e80dad5fa9	Move server event filtering logic to rust (#17928) ... ### Pull Request Checklist <!-- Please read https://element-hq.github.io/synapse/latest/development/contributing_guide.html before submitting your pull request --> * [X] Pull request is based on the develop branch * [X] Pull request includes a [changelog file](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#changelog). The entry should: - Be a short description of your change which makes sense to users. "Fixed a bug that prevented receiving messages from other servers." instead of "Moved X method from `EventStore` to `EventWorkerStore`.". - Use markdown where necessary, mostly for `code blocks`. - End with either a period (.) or an exclamation mark (!). - Start with a capital letter. - Feel free to credit yourself, by adding a sentence "Contributed by @github_username." or "Contributed by [Your Name]." to the end of the entry. * [X] [Code style](https://element-hq.github.io/synapse/latest/code_style.html) is correct (run the [linters](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#run-the-linters))	2024-11-14 16:18:24 +00:00
Erik Johnston	97284689ea	Merge branch 'master' into develop	2024-11-13 21:51:44 +00:00
Poruri Sai Rahul	c812a79422	Removal: Remove support for experimental msc3886 (#17638)	2024-11-13 14:10:20 +00:00
Erik Johnston	850ff14613	1.119.0	2024-11-13 13:58:18 +00:00
Erik Johnston	e0fdb862cb	Bump macos version used to build wheels (#17924) ... MacOS 12 is end-of-life and GitHub is deprecating support for it (including doing brown outs). Let's bump to MacOS 13.	2024-11-13 11:30:04 +00:00
Erik Johnston	73dc05c993	Unpin the upload release GHA action (#17923) ... We were pinned to an old version that had deprecation warnings. In new versions of the action leaving off properties (i.e. `draft` and `prerelease`) tells the action to not modify those properties of the release.	2024-11-12 16:52:00 +00:00
Benjamin Bouvier	bfb197c596	Fix typo in error message when a media ID isn't known (#17865)	2024-11-12 16:41:14 +00:00
Erik Johnston	f387f47a6a	Merge branch 'release-v1.119' into develop	2024-11-11 15:47:27 +00:00
Erik Johnston	a4c503674f	1.119.0rc2	2024-11-11 14:33:37 +00:00
Erik Johnston	2637b26cfe	Fix building and attaching release artifacts (#17921) ... Broke in #17905 due to upgrading the `upload-artifact` action, as we didn't rename debs. I think we also need to change how we download the artefacts and attach them to a release, as they'll download to a different place. Docs: - https://github.com/actions/upload-artifact/tree/v4/ - https://github.com/actions/download-artifact/tree/v4/	2024-11-11 14:32:45 +00:00
dependabot[bot]	db59067e78	Bump bleach from 6.1.0 to 6.2.0 (#17918)	2024-11-11 14:15:17 +00:00
dependabot[bot]	7feb07c3e9	Bump pygithub from 2.4.0 to 2.5.0 (#17917)	2024-11-11 13:52:14 +00:00
dependabot[bot]	54e0086abd	Bump ruff from 0.7.2 to 0.7.3 (#17919)	2024-11-11 13:51:47 +00:00
dependabot[bot]	9916932e98	Bump anyhow from 1.0.92 to 1.0.93 (#17920)	2024-11-11 13:51:36 +00:00
Erik Johnston	f4943b875b	Update changelog	2024-11-11 11:37:09 +00:00
Erik Johnston	92fcca8ed7	Update changelog	2024-11-11 10:46:34 +00:00
Erik Johnston	c486ec8bc2	Add index to current_state_delta_stream (#17912) ... As we're now using it in the sync APIs to get state changes within a room	2024-11-11 10:45:46 +00:00
reivilibre	20fc9fcc33	Clarify the semantics of the enable_authenticated_media configuration option. (#17913) ... Signed-off-by: Olivier 'reivilibre <oliverw@matrix.org>	2024-11-11 10:44:47 +00:00
Devon Hudson	2f41f6d947	Update changelog for release	2024-11-08 10:23:07 -07:00
Devon Hudson	f377cee7ec	Merge branch 'develop' into release-v1.119	2024-11-08 10:06:46 -07:00
Erik Johnston	cacd4fd7bd	Fix MSC4222 returning full state (#17915) ... There was a bug that meant we would return the full state of the room on incremental syncs when using lazy loaded members and there were no entries in the timeline. This was due to trying to use `state_filter or state_filter.all()` as a short hand for handling `None` case, however `state_filter` implements `__bool__` so if the state filter was empty it would be set to full. c.f. MSC4222 and #17888	2024-11-08 16:41:24 +00:00
Erik Johnston	c7a1d0aa1a	Fix Twisted tests with latest release (#17911) ... c.f. #17906 and #17907	2024-11-07 16:22:09 +00:00
Andrew Morgan	c92639df21	Switch portdb CI to python 3.13, pg 17 (#17909)	2024-11-07 16:09:45 +00:00
Erik Johnston	d0fc1e904a	Fix cancellation tests with new Twisted. (#17906) ... The latest Twisted release changed how they implemented `__await__` on deferreds, which broke the machinery we used to test cancellation. This PR changes things a bit to instead patch the `__await__` method, which is a stable API. This mostly doesn't change the core logic, except for fixing two bugs: - We previously did not intercept all await points - After cancellation we now need to not only unblock currently blocked await points, but also make sure we don't block any future await points. c.f. https://github.com/twisted/twisted/pull/12226 --------- Co-authored-by: Devon Hudson <devon.dmytro@gmail.com>	2024-11-07 15:26:14 +00:00
Erik Johnston	77eafd47df	Fix other unit tests with latest twisted (#17907) ... There's also https://github.com/element-hq/synapse/pull/17906	2024-11-07 10:11:13 +00:00
Richard van der Hoff	2a321bac35	Issue one time keys in upload order (#17903) ... Currently, one-time-keys are issued in a somewhat random order. (In practice, they are issued according to the lexicographical order of their key IDs.) That can lead to a situation where a client gives up hope of a given OTK ever being used, whilst it is still on the server. Related: https://github.com/element-hq/element-meta/issues/2356	2024-11-06 22:21:06 +00:00
Devon Hudson	eda735e4bb	Remove support for python 3.8 (#17908) ... ### Pull Request Checklist <!-- Please read https://element-hq.github.io/synapse/latest/development/contributing_guide.html before submitting your pull request --> * [X] Pull request is based on the develop branch * [X] Pull request includes a [changelog file](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#changelog). The entry should: - Be a short description of your change which makes sense to users. "Fixed a bug that prevented receiving messages from other servers." instead of "Moved X method from `EventStore` to `EventWorkerStore`.". - Use markdown where necessary, mostly for `code blocks`. - End with either a period (.) or an exclamation mark (!). - Start with a capital letter. - Feel free to credit yourself, by adding a sentence "Contributed by @github_username." or "Contributed by [Your Name]." to the end of the entry. * [X] [Code style](https://element-hq.github.io/synapse/latest/code_style.html) is correct (run the [linters](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#run-the-linters)) --------- Co-authored-by: Andrew Morgan <1342360+anoadragon453@users.noreply.github.com>	2024-11-06 19:36:01 +00:00
Eric Eastwood	e1f5da65e1	Update version constraint to allow the latest poetry-core 1.9.1 (#17902) ... Update version constraint to allow the latest `poetry-core` `1.9.1` Context: > I am working on updating poetry-core in Fedora and synapse is one of affected packages. Please run a CI to see if it works properly. Thank you. Mergeable version of https://github.com/element-hq/synapse/pull/17848	2024-11-06 10:51:19 -06:00
Devon Hudson	a4438c9bc1	Cleanup changelog	2024-11-06 09:15:59 -07:00
Devon Hudson	9266ba72b5	1.119.0rc1	2024-11-06 09:03:06 -07:00
Devon Hudson	61aadb158f	Use unique name for each os.arch variant when uploading Wheels (#17905) ... ### Pull Request Checklist <!-- Please read https://element-hq.github.io/synapse/latest/development/contributing_guide.html before submitting your pull request --> * [X] Pull request is based on the develop branch * [X] Pull request includes a [changelog file](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#changelog). The entry should: - Be a short description of your change which makes sense to users. "Fixed a bug that prevented receiving messages from other servers." instead of "Moved X method from `EventStore` to `EventWorkerStore`.". - Use markdown where necessary, mostly for `code blocks`. - End with either a period (.) or an exclamation mark (!). - Start with a capital letter. - Feel free to credit yourself, by adding a sentence "Contributed by @github_username." or "Contributed by [Your Name]." to the end of the entry. * [X] [Code style](https://element-hq.github.io/synapse/latest/code_style.html) is correct (run the [linters](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#run-the-linters))	2024-11-06 15:21:45 +00:00
Sandro	75698a3e53	Improve nix flake to use nixpkgs-unstable in lieu of master (#17852)	2024-11-06 14:03:46 +00:00
dependabot[bot]	46bd7e136d	Bump actions/download-artifact from 3 to 4.1.7 in /.github/workflows (#17657) ... Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3 to 4.1.7. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/actions/download-artifact/releases">actions/download-artifact's releases</a>.</em></p> <blockquote> <h2>v4.1.7</h2> <h2>What's Changed</h2> <ul> <li>Update <code>@​actions/artifact</code> dependency by <a href="https://github.com/bethanyj28"><code>@​bethanyj28</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/325">actions/download-artifact#325</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/actions/download-artifact/compare/v4.1.6...v4.1.7">https://github.com/actions/download-artifact/compare/v4.1.6...v4.1.7</a></p> <h2>v4.1.6</h2> <h2>What's Changed</h2> <ul> <li>updating <code>@actions/artifact</code> dependency to v2.1.6 by <a href="https://github.com/eggyhead"><code>@​eggyhead</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/324">actions/download-artifact#324</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/actions/download-artifact/compare/v4.1.5...v4.1.6">https://github.com/actions/download-artifact/compare/v4.1.5...v4.1.6</a></p> <h2>v4.1.5</h2> <h2>What's Changed</h2> <ul> <li>Update readme with v3/v2/v1 deprecation notice by <a href="https://github.com/robherley"><code>@​robherley</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/322">actions/download-artifact#322</a></li> <li>Update dependencies <code>@actions/core</code> to v1.10.1 and <code>@actions/artifact</code> to v2.1.5</li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/actions/download-artifact/compare/v4.1.4...v4.1.5">https://github.com/actions/download-artifact/compare/v4.1.4...v4.1.5</a></p> <h2>v4.1.4</h2> <h2>What's Changed</h2> <ul> <li>Update <code>@​actions/artifact</code> by <a href="https://github.com/bethanyj28"><code>@​bethanyj28</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/307">actions/download-artifact#307</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/actions/download-artifact/compare/v4...v4.1.4">https://github.com/actions/download-artifact/compare/v4...v4.1.4</a></p> <h2>v4.1.3</h2> <h2>What's Changed</h2> <ul> <li>Update release-new-action-version.yml by <a href="https://github.com/konradpabjan"><code>@​konradpabjan</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/292">actions/download-artifact#292</a></li> <li>Update toolkit dependency with updated unzip logic by <a href="https://github.com/bethanyj28"><code>@​bethanyj28</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/299">actions/download-artifact#299</a></li> <li>Update <code>@​actions/artifact</code> by <a href="https://github.com/bethanyj28"><code>@​bethanyj28</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/303">actions/download-artifact#303</a></li> </ul> <h2>New Contributors</h2> <ul> <li><a href="https://github.com/bethanyj28"><code>@​bethanyj28</code></a> made their first contribution in <a href="https://redirect.github.com/actions/download-artifact/pull/299">actions/download-artifact#299</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/actions/download-artifact/compare/v4...v4.1.3">https://github.com/actions/download-artifact/compare/v4...v4.1.3</a></p> <h2>v4.1.2</h2> <ul> <li>Bump <code>@​actions/artifacts</code> to latest version to include <a href="https://redirect.github.com/actions/toolkit/pull/1648">updated GHES host check</a></li> </ul> <h2>v4.1.1</h2> <ul> <li>Fix transient request timeouts <a href="https://redirect.github.com/actions/download-artifact/issues/249">actions/download-artifact#249</a></li> <li>Bump <code>@actions/artifacts</code> to latest version</li> </ul> <h2>v4.1.0</h2> <h2>What's Changed</h2> <ul> <li>Some cleanup by <a href="https://github.com/robherley"><code>@​robherley</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/247">actions/download-artifact#247</a></li> <li>Fix default for run-id by <a href="https://github.com/stchr"><code>@​stchr</code></a> in <a href="https://redirect.github.com/actions/download-artifact/pull/252">actions/download-artifact#252</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="65a9edc588"><code>65a9edc</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/325">#325</a> from bethanyj28/main</li> <li><a href="fdd1595981"><code>fdd1595</code></a> licensed</li> <li><a href="c13dba102f"><code>c13dba1</code></a> update <code>@​actions/artifact</code> dependency</li> <li><a href="0daa75ebea"><code>0daa75e</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/324">#324</a> from actions/eggyhead/use-artifact-v2.1.6</li> <li><a href="9c19ed7fe5"><code>9c19ed7</code></a> Merge branch 'main' into eggyhead/use-artifact-v2.1.6</li> <li><a href="3d3ea8741e"><code>3d3ea87</code></a> updating license</li> <li><a href="89af5db821"><code>89af5db</code></a> updating artifact package v2.1.6</li> <li><a href="b4aefff88e"><code>b4aefff</code></a> Merge pull request <a href="https://redirect.github.com/actions/download-artifact/issues/323">#323</a> from actions/eggyhead/update-artifact-v215</li> <li><a href="8caf195ad4"><code>8caf195</code></a> package lock update</li> <li><a href="d7a2ec411d"><code>d7a2ec4</code></a> updating package version</li> <li>Additional commits viewable in <a href="https://github.com/actions/download-artifact/compare/v3...v4.1.7">compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) You can trigger a rebase of this PR by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/element-hq/synapse/network/alerts). </details> > **Note** > Automatic rebases have been disabled on this pull request as it has been open for over 30 days. --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Devon Hudson <devonhudson@librem.one>	2024-11-06 00:24:40 +00:00
Eric Eastwood	eac170b21b	Use more correct changelog entries for refactoring Generator usage (#17890) ... Use more correct changelog entries for refactoring `Generator` usage - https://github.com/element-hq/synapse/pull/17813 - https://github.com/element-hq/synapse/pull/17814 - https://github.com/element-hq/synapse/pull/17815 - https://github.com/element-hq/synapse/pull/17816 - https://github.com/element-hq/synapse/pull/17817 ### Pull Request Checklist <!-- Please read https://element-hq.github.io/synapse/latest/development/contributing_guide.html before submitting your pull request --> * [x] Pull request is based on the develop branch * [x] Pull request includes a [changelog file](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#changelog). The entry should: - Be a short description of your change which makes sense to users. "Fixed a bug that prevented receiving messages from other servers." instead of "Moved X method from `EventStore` to `EventWorkerStore`.". - Use markdown where necessary, mostly for `code blocks`. - End with either a period (.) or an exclamation mark (!). - Start with a capital letter. - Feel free to credit yourself, by adding a sentence "Contributed by @github_username." or "Contributed by [Your Name]." to the end of the entry. * [x] [Code style](https://element-hq.github.io/synapse/latest/code_style.html) is correct (run the [linters](https://element-hq.github.io/synapse/latest/development/contributing_guide.html#run-the-linters))	2024-11-05 22:54:18 +00:00
Alexander Udovichenko	211c31dbd7	Fix WheelTimer implementation that can expired timeout early (#17850) ... When entries insert in the end of timer queue, then unnecessary entry inserted (with duplicated key). This can lead to some timeouts expired early and consume memory.	2024-11-05 12:08:17 -06:00
Erik Johnston	361bdafb87	Add experimental support for MSC4222 (#17888) ... Basically, if the client sets a special query param on `/sync` v2 instead of responding with `state` at the *start* of the timeline, we instead respond with `state_after` at the *end* of the timeline. We do this by using the `current_state_delta_stream` table, which is actually reliable, rather than messing around with "state at" points on the timeline. c.f. MSC4222	2024-11-05 14:45:57 +00:00
Andrew Morgan	1c2b18a704	Bump Synapse Dockerfile default to Python 3.12 (#17887)	2024-11-05 13:15:10 +00:00
Eric Eastwood	2c9ed5e510	Remove usage of internal header encoding API (#17894) ... ```py from twisted.web.http_headers import Headers Headers()._canonicalNameCaps Headers()._encodeName ``` Introduced in https://github.com/matrix-org/synapse/pull/15913 <- https://github.com/matrix-org/synapse/pull/15773	2024-11-04 12:20:07 -06:00
dependabot[bot]	9c0a3963bc	Bump phonenumbers from 8.13.48 to 8.13.49 (#17899)	2024-11-04 17:21:05 +00:00
Eric Eastwood	0932c77539	Sliding Sync: Lazy-loading room members on incremental sync (remember memberships) (#17809) ... Lazy-loading room members on incremental sync and remember which memberships we've sent down the connection before (up-to 100) Fix https://github.com/element-hq/synapse/issues/17804	2024-11-04 10:17:58 -06:00
dependabot[bot]	5580a820ae	Bump ruff from 0.7.1 to 0.7.2 (#17897)	2024-11-04 16:14:46 +00:00
dependabot[bot]	541a009564	Bump anyhow from 1.0.91 to 1.0.92 (#17901)	2024-11-04 16:14:10 +00:00