Every time I post something that gets lots of engagement, I essentially end up carrying out a denial of service attack on myself. What does this say about the design of Mastodon and ActivityPub and the future of the fediverse?
Is this sidekiq software really so inefficient that it can only run 12 parallel jobs on a Mastodon instance that costs 50€ per month? With Lemmy we are running up to 64 such jobs in parallel, and the resource usage is still very low. Part of the reason might be that we are using a Rust library and not a whole separate software project, but still.
Yes probably. But what each of these jobs is doing is essentially just creating a cryptographic signature and making an HTTP Post request. So its very fast and jobs can easily be run in parallel. Any modern computer should be able to do this thousands of times per second without a problem.
I already had several issues with sidekiq with GitLab too. It may be a not that bad piece of software, but it looks like, as if it’s overstrained with many requests at once. With GitLab it’s less of a problem, but with software like Mastodon, where there’s a lot going on especially with large instances, it might be worth considering switching to an alternative.
Is this sidekiq software really so inefficient that it can only run 12 parallel jobs on a Mastodon instance that costs 50€ per month? With Lemmy we are running up to 64 such jobs in parallel, and the resource usage is still very low. Part of the reason might be that we are using a Rust library and not a whole separate software project, but still.
I have absolutely no expertise in this area but could it be explained by the fact that Rust is (potentially) much faster than Ruby?
Yes probably. But what each of these jobs is doing is essentially just creating a cryptographic signature and making an HTTP Post request. So its very fast and jobs can easily be run in parallel. Any modern computer should be able to do this thousands of times per second without a problem.
I already had several issues with sidekiq with GitLab too. It may be a not that bad piece of software, but it looks like, as if it’s overstrained with many requests at once. With GitLab it’s less of a problem, but with software like Mastodon, where there’s a lot going on especially with large instances, it might be worth considering switching to an alternative.
https://slrpnk.net/post/150849