A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App

Custom AI Generator -- Pretrain your LLM Models with this Automated Embedding Generator and model Q&A Interface. Uses Retrieval Augmented Generation (RAG) to reduce hallucinations and ground the LLM on a source of truth

A drop-in replacement of fastapi to enable scalable and fault tolerant deployments with ray serve

Experimenting with Ray Serve on KubeRay

Use Ray to deploy your remote services.

contains the basic structure that a model serving application should have. This implementation is based on the Ray Serve framework.