What the title says. Are there any good ChatGPT alts that can be self hosted?
zephyrvs ( @zephyrvs@lemmy.ml ) 4•2 years agoLlama.cpp + Wizard Vicuna (Uncensored, if you want to get the real thing) + one of the web interfaces that are compatible. Should be listed in the readme.
Or try gpt4all which is much easier to use and even offers a selection of downloadable models.
7B/13B/30B+ depends on your hardware, especially GPU.
Serge I’ve heard good things about this one as well.
mrmojo ( @mrmojo@beehaw.org ) 4•2 years agoHi, I think localAi is a good place to start.
frap129 ( @frap129@lemmy.maples.dev ) 4•2 years agoI use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.
Admiral Patrick ( @ptz@dubvee.org ) 3•2 years agoSearxNG is my favorite.
It’s a meta search engine that makes it easy to find what you’re looking for without ads, tracking, or SEO crap.
From there, you can train your own, built-in neural net to earn the knowledge for yourself :)
frap129 ( @frap129@lemmy.maples.dev ) 8•2 years agoSearxng is a meta search engine, how is that relevant to a large language model?
ddtfrog ( @ddtfrog@lemm.ee ) 1•2 years agoCodestar for dev