Asynchronous Uploads

[sumnerevans]

Implements the recently merged MSC2246 Asynchronous Uploads for Synapse's media repository.

Closes #12484

• Configuration options rate limiting media creation
• Configuration options for how long to wait until media IDs expire
• POST /_matrix/media/v1/create
• PUT /_matrix/media/v3/upload/{serverName}/{mediaId}
• timeout_ms support on /download
• timeout_ms support on /thumbnail
• Option to restrict how many open media uploads a given user can have.

Signed-off-by: Sumner Evans [email protected]

---

Keywords: async

Pull Request Checklist

• Pull request is based on the develop branch
• Pull request includes a changelog file. The entry should:
  • Be a short description of your change which makes sense to users. "Fixed a bug that prevented receiving messages from other servers." instead of "Moved X method from EventStore to EventWorkerStore.".
  • Use markdown where necessary, mostly for code blocks.
  • End with either a period (.) or an exclamation mark (!).
  • Start with a capital letter.
  • Feel free to credit yourself, by adding a sentence "Contributed by @github_username." or "Contributed by [Your Name]." to the end of the entry.
• Pull request includes a sign off
• Code style is correct
  (run the linters)

[clokep]

@sumnerevans I'm going to remove the review request from this since you marked it as a draft; if you are still looking for a review please shout about what bits you're looking for a review of (or why it is in draft but you want a review). Thanks! 👍

[sumnerevans]

@clokep I accidentally opened as a non-draft PR. And then the automatic reviewer adder functionality kicked in and I could not remove it. Sorry about that!

[clokep]

Not an issue! If it doesn't kick in when un-drafting the PR just shout! 👍

[sumnerevans]

Blocked by matrix-org/complement#638

[clokep]

With the last comment and updating the complement tests this is all passing for me locally again! 👍

I'm pretty certain it is good to merge.

[clokep]

Kicked off a new round of complement tests: https://github.com/matrix-org/synapse/actions/runs/6867273574

[clokep]

Should be good if the test run works. 🎉

[clokep]

Complement with workers was failing, hopefully the latest change fixes it: https://github.com/matrix-org/synapse/actions/runs/6877944714

[clokep]

Tests passed minus a known flake (matrix-org/sytest#1201). 🎉 Thanks for working through this with me! 🚀