Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Giving Kubernetes Superpowers to everyone

⚡️AI Cloud OS: Open-source enterprise-level AI knowledge base and Manus-like agent management platform with admin UI, user management and Single-Sign-On⚡️, supports ChatGPT, Claude, DeepSeek R1, Llama, Ollama, HuggingFace, etc., chat bot demo: https://ai.casibase.com, admin UI demo: https://ai-admin.casibase.com

AI Chatbots in terminal without needing API keys

llama.go is like llama.cpp in pure Golang!

ChatGPT CLI is a versatile tool for interacting with LLM models through OpenAI and Azure, as well as models from Perplexity AI and Llama. It supports prompts and history tracking for seamless, context-aware interactions. With extensive configuration options, it’s designed for both users and developers to create a customized GPT experience.

Model swapping for llama.cpp (or any local OpenAPI compatible server)

🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs

LLaMA-2 in native Go

🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

OpenShield is a new generation security layer for AI models

A client/server for LLaMA (Large Language Model Meta AI) that can run ANYWHERE.

Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models.

Inference Hub for AI at Scale

Port of Facebook's LLaMA 2 model in pure go and use little memory

MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.