#

modelscope

Here is 1 public repository matching this topic...

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

kubernetes inference huggingface llm modelscope llamacpp vllm text-generation-inference ollama sglang inference-platform

Updated Apr 8, 2025
Go

Improve this page

Add a description, image, and links to the modelscope topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the modelscope topic, visit your repo's landing page and select "manage topics."