I mean, when you want to find a server to join, sopuli used to be there, but now it’s gone.
- QuentinCallaghan ( @QuentinCallaghan@sopuli.xyz ) 3•1 year ago
According to my understanding, the instances to be listed at join-lemmy are collected with a crawler. The crawler seems to have had problems, and this makes me curious. I am not suspecting anything like my instance not being fit for being listed there.
- nutomic ( @nutomic@lemmy.ml ) 3•1 year ago
Yes its a bug in the crawler, it throws an error about too many files. The problem seems to be due to recursion, because there are up to 2700 concurrent active tasks. Need to find a way to optimize this.
- wintermute ( @wintermute@feddit.de ) 1•1 year ago
You run them in parallel?
- nutomic ( @nutomic@lemmy.ml ) 1•1 year ago
The crawler is fixed now and site is updated. There is also another problem with builds so that crawl results wont get updated automatically every day.
- nutomic ( @nutomic@lemmy.ml ) 3•1 year ago
Fix is here: https://github.com/LemmyNet/lemmy-stats-crawler/pull/1
There is currently a TLS certificate problem on Github, once that is fixed join-lemmy.org should be updated automatically with sopuli and other missing instances.
- QuentinCallaghan ( @QuentinCallaghan@sopuli.xyz ) 1•1 year ago
Nice!
- nutomic ( @nutomic@lemmy.ml ) 1•1 year ago
Odd, joinlemmy is updated now but it contains even less instances than before. Something is wrong with the crawler, you can run it yourself to test or debug.
@nutomic@lemmy.ml thank you both for the answers!