Model swapping for llama.cpp (or any local OpenAI API compatible server)
-
Updated
Sep 2, 2025 - Go
#
localllama
Here are 24 public repositories matching this topic...
β¨ Kubectl plugin to create manifests with LLMs
kubernetes ai openai k8s kubectl gpt hacktoberfest kubectl-plugins openai-api gpt-4 llm chatgpt open-llm localllama
-
Updated
Jan 27, 2025 - Go
The easiest way to use Ollama in .NET
library streaming ai llama gpt llm llamacpp ollama ollama-api localllama microsoft-extensions-ai ichatclient
-
Updated
Aug 20, 2025 - C#
ποΈ Fine-tune, build, and deploy open-source LLMs easily!
docker kubernetes ai inference nvidia openai llama gpt gemma mistral fine-tuning finetuning buildkit large-language-models llm chatgpt open-llm open-source-llm localllama mixtral
-
Updated
Sep 2, 2025 - Go
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
-
Updated
Mar 13, 2024 - Rust
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing compression text-generation transformer llama quantization mistral model-compression efficient-inference efficient-model large-language-models llm small-models localllm localllama
-
Updated
Aug 13, 2024 - Python
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
android nlp macos linux dart ios native-apps gemini flutter indiedev on-device ipados on-device-ai pubdev llamacpp gen-ai genai mistral-7b localllama gemini-nano
-
Updated
Apr 27, 2024 - Dart
Social and customizable AI writing assistant! βοΈ
-
Updated
Jun 30, 2025 - TypeScript
A local and uncensored AI entity.
python bot text-to-speech ai deep-learning speech pytorch tts assistant vad speech-to-text voice-assistant large-language-models llm xttsv2 localllama llamacpp-python kokoro-tts
-
Updated
Aug 1, 2025 - Python
LLM RAG Application with Cross-Encoders Re-ranking for YouTube video π₯
awesome re-ranking rag streamlit cross-encoders langchain retrieval-augmented-generation ollama localllama
-
Updated
Jan 30, 2025 - Python
Run gguf LLM models in Latest Version TextGen-webui and koboldcpp
-
Updated
Aug 6, 2025 - Jupyter Notebook
Secure Flutter desktop app connecting Auth0 authentication with local Ollama AI models via encrypted tunneling. Access your private AI instances remotely while keeping data on your hardware.
-
Updated
Sep 3, 2025 - Dart
Full featured demo application for OllamaSharp
-
Updated
Oct 22, 2024 - C#
Use your open source local model from the terminal
-
Updated
Jun 9, 2025 - Python
π LocalLLaMA Archive β Community-powered static archive for r/LocalLLaMA
react open-source typescript clone archiving web-scraper static-site dataset llama fusejs reddit-crawler reddit-scraper vite github-actions llm localllama reddit-archive
-
Updated
Aug 8, 2025 - TypeScript
A control server for managing multiple Llama Server instances with a web-based dashboard.
-
Updated
Sep 3, 2025 - Go
Copilot hack for running local copilot without auth and proxying
-
Updated
Dec 23, 2024 - JavaScript
Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine
-
Updated
Jun 30, 2025 - Python
Local AI Search assistant web or CLI for ollama and llama.cpp. Lightweight and easy to run, providing a Perplexity-like experience.
-
Updated
Nov 18, 2024 - Python
Improve this page
Add a description, image, and links to the localllama topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the localllama topic, visit your repo's landing page and select "manage topics."