[Question] What are some good selfhostable ChatGPT alternatives? Weirdbeardgame ( @Weirdbeardgame@lemmy.ml ) Self Hosted - Self-hosting your services.@lemmy.ml • 1 year ago message-square9fedilinkarrow-up111
arrow-up111message-square[Question] What are some good selfhostable ChatGPT alternatives? Weirdbeardgame ( @Weirdbeardgame@lemmy.ml ) Self Hosted - Self-hosting your services.@lemmy.ml • 1 year ago message-square9fedilink
minus-square frap129 ( @frap129@lemmy.maples.dev ) linkfedilink4•1 year agoI use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.
I use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.