Skip to content
@InftyAI

InftyAI

Exploring the ∞ possibilities of AI. We 💙 Open Source.
README.md

inftyai logo

Hey, this is InftyAI 🪂

InftyAI is a non-profit organization focused on building AI infrastructure, including model training & inference, agentic systems and more. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PRs, issues, new ideas, documentations and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

We also have an official fundraising venue through OpenCollective. We'll use the fund transparently to support the development, maintenance, and adoption of our community.

Welcome to join us!

Popular repositories Loading

  1. llmaz llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 293 45

  2. Awesome-LLMOps Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    Python 210 38

  3. Manta Manta Public archive

    💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

    Go 26 3

  4. AMRS AMRS Public

    🧬 The adaptive model routing system for exploration and exploitation.

    Rust 22 4

  5. alphatrion alphatrion Public

    ⚒️ AlphaTrion is an open-source framework to help build GenAI applications, including experiment tracking, adaptive model routing, prompt optimization and performance evaluation.

    Python 13 4

  6. scheduler-plugins scheduler-plugins Public

    Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.

    Go 11 3

Repositories

Showing 10 of 15 repositories
  • Quintessa Public

    👾 Your JARVIS sitting in the Terminal, running in the shadow.

    InftyAI/Quintessa’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Mar 6, 2026
  • alphatrion Public

    ⚒️ AlphaTrion is an open-source framework to help build GenAI applications, including experiment tracking, adaptive model routing, prompt optimization and performance evaluation.

    InftyAI/alphatrion’s past year of commit activity
    Python 13 Apache-2.0 4 12 (3 issues need help) 2 Updated Mar 6, 2026
  • Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    InftyAI/Awesome-LLMOps’s past year of commit activity
    Python 210 Apache-2.0 38 4 3 Updated Feb 4, 2026
  • llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    InftyAI/llmaz’s past year of commit activity
    Go 293 Apache-2.0 45 39 (5 issues need help) 13 Updated Jan 26, 2026
  • .github Public
    InftyAI/.github’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Jan 11, 2026
  • AMRS Public

    🧬 The adaptive model routing system for exploration and exploitation.

    InftyAI/AMRS’s past year of commit activity
    Rust 22 MIT 4 2 0 Updated Jan 4, 2026
  • website Public

    Website and Blogs.

    InftyAI/website’s past year of commit activity
    HTML 1 MIT 1 1 0 Updated Dec 29, 2025
  • omnistore Public

    🎯 An unified python client to communicate with various kinds of object-store providers.

    InftyAI/omnistore’s past year of commit activity
    Python 3 MIT 3 3 0 Updated Nov 18, 2025
  • template-repo Public template

    A template repo.

    InftyAI/template-repo’s past year of commit activity
    0 Apache-2.0 1 0 0 Updated Sep 19, 2025
  • karpenter Public Forked from kubernetes-sigs/karpenter

    This is a fork of Karpenter focused on GPU scaling with llmaz.

    InftyAI/karpenter’s past year of commit activity
    Go 0 Apache-2.0 446 1 0 Updated Jun 18, 2025
View all repositories

Top languages

Loading…