Back to list
High-Potential
TypeScript

🖥️ qvac: Cross-Platform Local AI SDK

528 stars102 forksTypeScript
ai-sdkdecentralized-aillamallm-inferencelocal-ailocal-fine-tuninglocal-llmnodejson-device-aiopen-source-aiopen-source-llmopen-source-rag
qvac is an open-source local AI SDK designed to run models directly on-device without relying on cloud services or API keys. It goes beyond standard text generation, supporting GGUF models, RAG, image, music, and video generation, as well as speech-to-text capabilities. The notable aspect of this project is its broad cross-platform support, covering Linux, macOS, Windows, Android, and iOS. It also experiments with P2P inference. For developers looking to embed offline, multimodal AI capabilities into desktop or mobile applications without wrestling with low-level inference engines, this SDK provides a solid foundation.