WebLLM model provider for Vercel AI SDK. This library enables you to easily use the AI SDK with popular open-source models running directly in your web browser.
Installation
npm i @browser-ai/web-llm
The @browser-ai/web-llm package is the AI SDK provider for open-source built-in browser AI models leveraging the WebLLM inference engine.
Documentation
For a complete documentation including examples, refer to this site.