other12h
I made a FAQ Chatbot that runs completely in browser; Local AI in Two Clicks
A developer created a FAQ chatbot that runs entirely in-browser using webLLM and a simple RAG. The chatbot is deployed on a static website, allowing easy updates to its knowledge base. With chromium's WebGPU support, the chatbot can run on modest hardware, including some phones. This showcases advancements in AI interface architecture and the capabilities of small models.
Key takeaways
- Runs entirely in-browser with webLLM and RAG.
- Deployed on a static website for easy knowledge base updates.
- Works on modest hardware, including some phones, thanks to WebGPU support.