- cross-posted to:
- opensource@lemmy.ml
You must log in or register to comment.
- Destragras ( @Destragras@kbin.social ) 12•10 months ago
I tried finding information on what indexer they are using. Are they using their own?
Edit: says this in the readme:
The commoncrawl organization for crawling the web and making the dataset readily available. Even though we have our own crawler now, commoncrawl has been a huge help in the early stages of development.
- panmeek ( @panmeek@lemmy.sdf.org ) 8•10 months ago
this looks VERY interesting!
- Samsy ( @Samsy@lemmy.ml ) 5•10 months ago
Lol it searches through stack, github, fediverse. Really nice.