https://wintermutecore.com/tags/localai/Recent content in Localai on Project WintermuteHugoen-usMon, 14 Sep 2026 14:00:26 +0000https://wintermutecore.com/posts/localai-credentials-file-and-cli-benchmark/Mon, 14 Sep 2026 14:00:26 +0000https://wintermutecore.com/posts/localai-credentials-file-and-cli-benchmark/<p>LocalAI is a self hosted OpenAI compatible inference server that fronts llama.cpp, vLLM, whisper.cpp, and related backends. <a href="https://github.com/mudler/LocalAI">mudler/LocalAI</a> put 143 commits on master in the past week. Most of that is nightly pin churn. The operator visible work is a credentials file for private galleries and registries, a new <code>local-ai benchmark</code> command, and a gallery restore after a batch apply overwrote seven model entries.</p>