Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Training pipeline for an osu!mania 7k next-event model, designed as the upstream predictor for audio-driven 7k map generation systems.

run AI without internet, on the web & desktop

Offline plant disease diagnosis with MobileNetV3, TensorFlow Lite, and Flutter for field-ready edge AI inference.

A Cloud-to-Edge MLOps pipeline for offline industrial diagnostics. Fine-tunes Phi-3-mini (3.8B) on Cloud GPUs via QLoRA, quantizes to INT4, and deploys as a CPU-optimized ONNX microservice for industrial standard sensor logs.

Offline CrowdAware system for Raspberry Pi 4B and Heltec LoRa V3 using Raspberry Pi Camera Module 3 and MLX90640 Thermal Camera.

Download Hugging Face model snapshots locally for offline inference, deployment, and Docker workflows.

A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.

Real-time semantic audio codec achieving 300bps bandwidth via gen AI reconstruction.

Event-driven image processing pipeline with automatic format normalization, thumbnail generation, AI-powered captioning (BLIP), and full lifecycle management. Built with .NET 10, Python, Docker, and Terraform.

Мультимодальная офлайновая система детекции контрафакта (текст+изображение+таблица).

GPT-OSS B20 Local Execution. Lightweight local environment for running it with Python 3.12 and CUDA acceleration. - Run GPT-OSS B20 entirely offline - Optimize text generation with GPU - Enable fast, secure inference on consumer hardware.

Inclusive hand gesture recognition system for assistive human–computer interaction, based on classical machine learning and MediaPipe Hands.

Offline Krita plugin for e621 image tag generation using JTP-3 ONNX Runtime CPU inference