Weirdbeardgame ( Weirdbeardgame@lemmy.ml ) to Self Hosted - Self-hosting your services.@lemmy.ml · 3 years ago[Question] What are some good selfhostable ChatGPT alternatives?message-squaremessage-square9linkfedilinkarrow-up112file-text
arrow-up112message-square[Question] What are some good selfhostable ChatGPT alternatives?Weirdbeardgame ( Weirdbeardgame@lemmy.ml ) to Self Hosted - Self-hosting your services.@lemmy.ml · 3 years agomessage-square9linkfedilinkfile-text
minus-squarefrap129 ( frap129@lemmy.maples.dev ) linkfedilinkarrow-up4·3 years agoI use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.
I use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.