Skip to content
@ndif-team

National Deep Inference Fabric

The National Deep Inference Fabric is a proposed research computing project that will enable us to crack open the mysteries inside large-scale AI

National Deep Inference Fabric

A research computing project enabling transparent and reproducible experiments on large-scale AI systems.


Projects

nnsight

nnsight

A Python library for interpreting and manipulating the internals of deep learning models. Access activations, modify them to study causal effects, compute gradients, and batch interventions efficiently.

Documentation | GitHub | Paper

pip install nnsight

NDIF

NDIF

The National Deep Inference Fabric — a nationwide research computing infrastructure enabling scientists and students to perform transparent experiments on running AI models without local GPU resources.

Website | GitHub | Paper

pip install ndif

nnterp

nnterp

A unified interface for mechanistic interpretability of transformers. Built on NNsight, it provides standardized naming conventions across all transformer architectures with built-in interventions like logit lens, patchscope, and activation steering.

Documentation | GitHub | Paper

pip install nnterp

Workbench

Workbench

A UI for doing exploratory analysis on open source AI models by applying interpretability techniques. Leverages both NNsight and NDIF to provide an interactive environment for exploring LLM internals.

Use Workbench now! | GitHub


Join the community

Discord | Forum | Twitter

Pinned Loading

  1. nnsight nnsight Public

    The nnsight package enables interpreting and manipulating the internals of deep learned models.

    Python 891 84

Repositories

Showing 10 of 15 repositories
  • ndif Public

    The NDIF server, which performs deep inference and serves nnsight requests remotely

    ndif-team/ndif’s past year of commit activity
    Python 44 MIT 16 13 (3 issues need help) 9 Updated Apr 10, 2026
  • nnsight Public

    The nnsight package enables interpreting and manipulating the internals of deep learned models.

    ndif-team/nnsight’s past year of commit activity
    Python 891 MIT 84 51 12 Updated Apr 10, 2026
  • workbench Public
    ndif-team/workbench’s past year of commit activity
    TypeScript 14 8 34 4 Updated Apr 7, 2026
  • ndif-citations Public

    Automated pipeline to discover and catalog papers citing or using NDIF/NNsight.

    ndif-team/ndif-citations’s past year of commit activity
    Python 0 0 0 0 Updated Apr 7, 2026
  • nnterp Public

    Unified access to Large Language Model modules using NNsight

    ndif-team/nnterp’s past year of commit activity
    Python 108 MIT 10 6 (1 issue needs help) 4 Updated Apr 5, 2026
  • ndif-web-beta Public
    ndif-team/ndif-web-beta’s past year of commit activity
    TypeScript 0 0 0 0 Updated Apr 5, 2026
  • nnsight-website Public

    The nnsight website, which explains and documents the open-source nnsight API

    ndif-team/nnsight-website’s past year of commit activity
    Python 3 4 5 1 Updated Apr 1, 2026
  • cookbook Public

    Implementations of most mech interp papers

    ndif-team/cookbook’s past year of commit activity
    6 1 0 0 Updated Mar 28, 2026
  • ndif-team/nnsight-vllm-demos’s past year of commit activity
    Python 0 0 0 0 Updated Feb 27, 2026
  • inif Public

    Interpretability interchange format for the NDIF ecosystem 🔄

    ndif-team/inif’s past year of commit activity
    Python 1 MIT 0 0 0 Updated Feb 17, 2026