Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 375 37

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 279 18

  3. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 251 18

  4. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 145 12

  5. UMbreLLa UMbreLLa Public

    LLM Inference on consumer devices

    Python 130 15

  6. MonarchRT MonarchRT Public

    Python 122 12

Repositories

Showing 10 of 36 repositories
  • STEM Public
    Infini-AI-Lab/STEM’s past year of commit activity
    Python 62 BSD-3-Clause 2 3 0 Updated Mar 28, 2026
  • WWW.Serve Public
    Infini-AI-Lab/WWW.Serve’s past year of commit activity
    Python 1 Apache-2.0 0 0 0 Updated Mar 24, 2026
  • lm-eval-stem Public
    Infini-AI-Lab/lm-eval-stem’s past year of commit activity
    Python 0 MIT 0 0 0 Updated Mar 22, 2026
  • MonarchRT Public
    Infini-AI-Lab/MonarchRT’s past year of commit activity
    Python 122 Apache-2.0 12 2 0 Updated Feb 17, 2026
  • jackpot Public

    A rejection-sampling based distribution alignment method for extreme actor-policy mismatch RL Training

    Infini-AI-Lab/jackpot’s past year of commit activity
    Python 15 Apache-2.0 0 0 5 Updated Feb 11, 2026
  • jpt_website Public

    Host the website of project Jackpot

    Infini-AI-Lab/jpt_website’s past year of commit activity
    HTML 0 0 0 0 Updated Feb 9, 2026
  • vortex_torch Public

    Vortex: A Flexible and Efficient Sparse Attention Framework

    Infini-AI-Lab/vortex_torch’s past year of commit activity
    Python 49 Apache-2.0 3 0 1 Updated Jan 21, 2026
  • jackpot_unofficial Public
    Infini-AI-Lab/jackpot_unofficial’s past year of commit activity
    0 0 0 0 Updated Dec 7, 2025
  • vortex-technical-blog Public
    Infini-AI-Lab/vortex-technical-blog’s past year of commit activity
    HTML 0 0 0 0 Updated Dec 1, 2025
  • ai-environment-architect Public
    Infini-AI-Lab/ai-environment-architect’s past year of commit activity
    HTML 0 0 0 0 Updated Nov 26, 2025
View all repositories

Most used topics

Loading…