Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine.

https://ollama.com/

chat mode server mode

ollama+openwebui

ollama+ AnythingLLM

0基础！一行代码部署Gemma！纯本地！主打一个快！不用搞依赖！7B尺寸超13B性能！附模型下载！ https://mp.weixin.qq.com/s/4hjewv3TFI5fqe66PaT6Tg