frap129@lemmy.maples.devtoSelf Hosted - Self-hosting your services.@lemmy.ml•[Question] What are some good selfhostable ChatGPT alternatives?
51·
1 year agoI use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.
Searxng is a meta search engine, how is that relevant to a large language model?