Skip to content

@epfml EPFL Machine Learning and Optimization Laboratory

All

    Repositories list

    64 repositories

    • disco

      Public
      DISCO is a code-free and installation-free browser platform that allows any non-technical user to collaboratively train machine learning models without sharing …
      machine-learningmobilebrowser
      machine-learningmobilebrowsercollaborative-learningprivacy-preservingfederated-learningdecentralized-learning
      TypeScript
      •
      Apache License 2.0
      •32•187•58•3•Updated Sep 3, 2026Sep 3, 2026

    • halluhard

      Public
      A Hard Multi-Turn Hallucination Benchmark
      Python
      •9•35•0•0•Updated Aug 2, 2026Aug 2, 2026

    • OptML_course

      Public
      EPFL Course - Optimization for Machine Learning - CS-439
      Jupyter Notebook
      •347•1.5k•5•2•Updated Jul 14, 2026Jul 14, 2026

    • looped-moe

      Public
      code for "Tying the Loop - Tied Expert Layers in Mixture-of-Experts Language Models"
      Python
      •
      Apache License 2.0
      •1•12•0•0•Updated Jun 16, 2026Jun 16, 2026

    • llm-optimizer-benchmark

      Public
      Benchmarking Optimizers for LLM Pretraining
      benchmarkingoptimizersllm
      benchmarkingoptimizersllm
      Python
      •
      Apache License 2.0
      •8•60•1•1•Updated May 3, 2026May 3, 2026

    • grad-norm-smooth

      Public
      Official implementation of "Gradient-Normalized Smoothness for Optimization with Approximate Hessians". ICLR 2026
      second-order-optimizationinexact-hessians
      second-order-optimizationinexact-hessians
      Jupyter Notebook
      •
      Apache License 2.0
      •0•0•0•0•Updated Mar 23, 2026Mar 23, 2026

    • getting-started

      Public
      Python
      •16•34•1•2•Updated Mar 18, 2026Mar 18, 2026

    • ML_course

      Public
      EPFL Machine Learning Course, Fall 2025
      Jupyter Notebook
      •1k•2k•4•1•Updated Dec 15, 2025Dec 15, 2025

    • llm-baselines

      Public
      nanoGPT-like codebase for LLM training
      pretrainingllms
      pretrainingllms
      Python
      •
      MIT License
      •41•118•3•3•Updated Nov 7, 2025Nov 7, 2025

    • CoMiGS

      Public
      Python
      •
      Apache License 2.0
      •1•2•0•0•Updated Sep 24, 2025Sep 24, 2025

    • TiMoE

      Public
      A time aware language modeling framework
      Python
      •0•1•0•0•Updated Aug 31, 2025Aug 31, 2025

    • fineweb2-hq

      Public
      Code for the paper "Enhancing Multilingual LLM Pretraining with Model-Based Data Selection"
      Python
      •
      Apache License 2.0
      •2•7•1•0•Updated May 16, 2025May 16, 2025

    • schedules-and-scaling

      Public
      Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
      Python
      •
      MIT License
      •8•93•1•0•Updated Oct 30, 2024Oct 30, 2024

    • powersgd

      Public
      Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
      Python
      •
      MIT License
      •35•151•1•1•Updated Oct 29, 2024Oct 29, 2024

    • CoBo

      Public
      Python
      •0•0•0•0•Updated Oct 22, 2024Oct 22, 2024

    • personalized-collaborative-llms

      Public
      Exploration on-device self-supervised collaborative fine-tuning of large language models with limited local data availability, using Low-Rank Adaptation (LoRA).…
      Python
      •
      Apache License 2.0
      •0•6•0•0•Updated Sep 2, 2024Sep 2, 2024

    • error-feedback-SGD

      Public
      SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847
      Jupyter Notebook
      •
      MIT License
      •10•30•2•2•Updated Jul 25, 2024Jul 25, 2024

    • REQ

      Public
      Python
      •
      Apache License 2.0
      •0•19•0•0•Updated Jun 10, 2024Jun 10, 2024

    • CoTFormer

      Public
      Python
      •
      MIT License
      •1•7•0•0•Updated May 22, 2024May 22, 2024

    • semester-project-personalization

      Public
      Python
      •0•0•0•0•Updated May 22, 2024May 22, 2024

    • getting-started-lauzhack

      Public
      Python
      •16•0•0•0•Updated Apr 18, 2024Apr 18, 2024

    • DenseFormer

      Public
      Python
      •
      Apache License 2.0
      •10•83•0•1•Updated Apr 16, 2024Apr 16, 2024

    • DoGE

      Public
      Codebase for ICML submission "DOGE: Domain Reweighting with Generalization Estimation"
      5•0•0•0•Updated Feb 4, 2024Feb 4, 2024

    • landmark-attention

      Public
      Landmark Attention: Random-Access Infinite Context Length for Transformers
      Python
      •
      Apache License 2.0
      •38•428•8•0•Updated Dec 20, 2023Dec 20, 2023

    • pam

      Public
      Python
      •
      Apache License 2.0
      •4•16•0•0•Updated Dec 9, 2023Dec 9, 2023

    • ghost-noise

      Public
      Python
      •
      Apache License 2.0
      •0•4•0•0•Updated Aug 18, 2023Aug 18, 2023

    • optML-pku

      Public
      summer school materials
      6•46•0•0•Updated Aug 4, 2023Aug 4, 2023

    • collaborative-attention

      Public
      Code for Multi-Head Attention: Collaborate Instead of Concatenate
      Python
      •
      Apache License 2.0
      •22•152•6•1•Updated Jun 12, 2023Jun 12, 2023

    • dynamic-sparse-flash-attention

      Public
      Jupyter Notebook
      •
      Other
      •6•152•2•0•Updated Jun 2, 2023Jun 2, 2023

    • easy-summary

      Public
      difficulty-guided text summarization
      Python
      •
      Apache License 2.0
      •6•6•0•1•Updated May 22, 2023May 22, 2023
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.