Repositories list

• PUMA

  Public

  InftyAI/PUMA’s past year of commit activity
  Aim to be a lightweight, high-performance inference engine for local AI.

  rustinference-enginellm+ 1

  rustinference-enginellmlocal-ai

  Rust

  •

  Apache License 2.0

  •11 fork•00 stars•22 issues•00 pull requests•Updated Apr 19, 2026Apr 19, 2026

• alphatrion

  Public

  InftyAI/alphatrion’s past year of commit activity
  ⚒️ The observability platform for agentic systems.

  observabilityai-applicationsai-agent+ 1

  observabilityai-applicationsai-agentllmops

  Python

  •

  Apache License 2.0

  •55 forks•1313 stars•1515 issues•00 pull requests•Updated Apr 16, 2026Apr 16, 2026

• Awesome-LLMOps

  Public

  InftyAI/Awesome-LLMOps’s past year of commit activity
  🎉 An awesome & curated list of best LLMOps tools.

  awesomeaiawesome-list+ 3

  awesomeaiawesome-listllmllmopsai-developer-tools

  Python

  •

  Apache License 2.0

  •5151 forks•220220 stars•44 issues•1414 pull requests•Updated Apr 16, 2026Apr 16, 2026

• website

  Public

  InftyAI/website’s past year of commit activity
  Website and Blogs.

  blogwebsiteai

  blogwebsiteai

  HTML

  •

  MIT License

  •11 fork•11 star•11 issue•00 pull requests•Updated Apr 8, 2026Apr 8, 2026

• llmaz

  Public

  InftyAI/llmaz’s past year of commit activity
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

  kubernetesinferencehuggingface+ 8

  kubernetesinferencehuggingfacellmmodelscopellamacppvllmtext-generation-inferenceollamasglang+ 1

  Go

  •

  Apache License 2.0

  •4545 forks•300300 stars•3939 issues•1313 pull requests•Updated Jan 26, 2026Jan 26, 2026

• .github

  Public

  InftyAI/.github’s past year of commit activity
  Apache License 2.0

  •11 fork•00 stars•00 issues•00 pull requests•Updated Jan 11, 2026Jan 11, 2026

• AMRS

  Public
  🧬 The adaptive model routing system for exploration and exploitation.

  sdkllmllmops+ 2

  sdkllmllmopsai-gatewayai-proxy

  Rust

  •

  MIT License

  •66 forks•2424 stars•22 issues•00 pull requests•Updated Jan 4, 2026Jan 4, 2026

• omnistore

  Public

  InftyAI/omnistore’s past year of commit activity
  🎯 An unified python client to communicate with various kinds of object-store providers.

  pythonosss3+ 3

  pythonosss3gcsminioobject-store

  Python

  •

  MIT License

  •33 forks•33 stars•33 issues•00 pull requests•Updated Nov 18, 2025Nov 18, 2025

• template-repo

  Public template

  InftyAI/template-repo’s past year of commit activity
  A template repo.

  Apache License 2.0

  •11 fork•00 stars•00 issues•00 pull requests•Updated Sep 19, 2025Sep 19, 2025

• karpenter

  Public
  This is a fork of Karpenter focused on GPU scaling with llmaz.

  Go

  •

  Apache License 2.0

  •470470 forks•00 stars•11 issue•00 pull requests•Updated Jun 18, 2025Jun 18, 2025

• scheduler-plugins

  Public
  Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.

  Go

  •

  Apache License 2.0

  •33 forks•1111 stars•11 issue•00 pull requests•Updated Jun 16, 2025Jun 16, 2025

• community

  Public
  The InftyAI community.

  Apache License 2.0

  •11 fork•00 stars•11 issue•00 pull requests•Updated Apr 18, 2025Apr 18, 2025

• Manta

  Public archive
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

  kubernetesdistributed-systemscache+ 2

  kubernetesdistributed-systemscachep2p-networkllm

  Go

  •

  Apache License 2.0

  •33 forks•2626 stars•1414 issues•11 pull request•Updated Dec 6, 2024Dec 6, 2024

• PR-Copilot

  Public archive
  Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛

  Python

  •

  MIT License

  •33 forks•33 stars•22 issues•00 pull requests•Updated Jun 29, 2024Jun 29, 2024