Kosmos.social backups are broken

colby · August 2, 2024, 3:27pm

kosmos.social used to email S3 links when requesting a backup. For example:

https://s3.kosmos.social/backups/dumps/000/000/007/original/archive-20230413141919-[...].tar.gz

Now it gives links like:

https://kosmos.social/backups/10/download

… which, if you’re authorized, redirects to:

http://localhost:3900/kosmos-social/backups/dumps/000/000/010/original/archive-20240801003321-[...].zip?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=[...]

(instead of s3.kosmos.social).

raucao · August 4, 2024, 12:16pm

Thanks for the report, and welcome to the forums!

I found the upstream issue for this bug:

github.com/mastodon/mastodon

Archive download link does not respect S3_ALIAS_HOST setting

opened 03:13PM - 03 Apr 23 UTC

davetroy

status/confirmed

### Steps to reproduce the problem 1. Request an archive of your account 2. Cl…ick "Download your archive" Link in Email notification 3. User is redirected to link based on S3_ENDPOINT setting, not S3_ALIAS_HOST 4. Manually replace S3_ENDPOINT value in link with S3_ALIAS_HOST; download will work ### Expected behaviour User should have received link based on S3_ALIAS_HOST ### Actual behaviour User received link based on S3_ENDPOINT ### Detailed description Requesting a download of one's account archive produces a user-facing link to S3_ENDPOINT instead of S3_ALIAS_HOST. In our setup, this will not work, because S3_ENDPOINT is a private VLAN-accessible endpoint that we do not want to expose to end users. S3_ALIAS_HOST should be used instead, as it is for the distribution of other user-uploaded files. ### Specifications Mastodon 4.1.1 Ruby 3.0.4p208 PostgreSQL 15.1 Redis 5.0.7

raucao · August 4, 2024, 1:01pm

Update: fixed in #564 - Fix download URLs for Mastodon exports/archives - chef - Gitea (already running on kosmos.social, so downloads should work again, both from e-mail and Web links)