Skip to content
View loki52501's full-sized avatar

Highlights

  • Pro

Block or report loki52501

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
loki52501/README.md

👋 hey, i'm lokesh

i write C++ because i like knowing where my memory lives. python and js pay the bills and ship the demos. rust is the new toy on my desk — half-learned, half-loved, fully humbling.

right now i'm deep in mechanistic interpretability — poking at transformer internals, residual streams, attention heads, trying to figure out what these models are actually doing under the hood instead of what they say they're doing. there's a difference, and the gap is where most of the interesting stuff hides.

on the side i'm picking up CUDA, getting comfortable with kernels, memory hierarchies, and the general vibe of writing code that runs on a few thousand threads at once. parallel programming on GPU clusters is genuinely fun in a way i didn't expect — it's like puzzle-solving where the puzzle pushes back.

i've built LLMs from scratch (yes, the whole stack — tokenizer, attention, training loop, the works) and shipped a few AI-native apps. i like building things that don't work yet more than things that already do.

// the stack, roughly
auto me = Developer {
    .heart       = "C++",
    .daily       = {"Python", "JavaScript"},
    .learning    = "Rust",
    .tinkering   = {"mech interp", "CUDA", "GPU clusters"},
    .built       = {"LLMs from scratch", "AI-native apps"},
    .obsession   = "what's actually happening inside the model"
};

🔮 a thought i can't shake

when i think about LLMs, i don't think about chatbots. i think about oracles.

the ancient ones — Delphi, Cumae, the seers kings consulted before marching to war. people brought them the biggest questions of their lives and walked away convinced. and for centuries, empires were built and burned on the strength of that conviction.

the oracles weren't always wrong. that's the unsettling part. they were often right, just often enough that doubting them felt unreasonable. and when they were wrong, the ashes were enormous.

LLMs feel like that to me. they're genuinely intelligent — not in the cute "look what it did" way, but in the this-is-actually-reasoning way. and we're starting to consult them on real things. real decisions. real lives.

but here's what keeps me up:

  • evaluation isn't a solved problem. it's not even close. the benchmarks shift, the failure modes shift, the goalposts shift. we're grading the oracle with a ruler that keeps changing length.
  • there's no moral compass in there. not a broken one — none. whatever ethics show up are stitched on from the outside, and the stitching is loose.
  • and yet they're smart enough to be persuasive. which is the exact combination that got empires into trouble the first time around.

so that's the thread running through most of what i build — interpretability work, evaluation harnesses, sycophancy probes, CoT faithfulness tests. not because i think AI is bad, but because i think we don't actually know what it's doing yet, and pretending we do is how the ashes happen.

🛠️ stuff i've built

🧠 LLM Sycophancy + CoT Faithfulness Suite

Llama-3 · PyTorch · BIG-Bench-Hard

does the model actually believe what it says? probably not always. this suite tests for it — agreement bias, pressure capitulation, flattery resistance, and whether chain-of-thought reasoning is real reasoning or theater. extends Turpin and Lanham's work onto Llama-3-8B.

🔬 Mech Interp Tinkering

ARENA · TransformerLens · residual stream probes

working through Neel Nanda's curriculum, ARENA chapter 1, attention head analysis, the whole linear algebra rabbit hole. extending CoT faithfulness into residual stream probing — if the model's CoT lies, does the residual stream tell the truth?

🐾 OpenClaw — Multi-Agent RAG on K8s

Node.js · Kubernetes · ChromaDB

multi-agent RAG system that actually runs in production. agent pods scale independently, ChromaDB for the vector side, GitHub Actions → Docker → K8s for the boring-but-important part.

📚 SQ3R AI Study Agent

TypeScript · React · FSRS-4.5 · Multi-LLM

chrome extension that turns any page or PDF into spaced-repetition flashcards. routes between local Ollama and cloud LLMs, FSRS-4.5 scheduling, a pomodoro agent that ambushes you with due cards.

🌊 DDoS Detection IDS

BiLSTM · 1D Residual CNN · PyTorch

ensemble IDS on 700K+ network flows. 94.11% accuracy on 3-class. confidence-gated routing so the model doesn't pretend to be sure when it isn't — same theme as the LLM work, different stack.

⚡ Other Stuff Worth Mentioning

zero-dependency static site generator in C++, QUIC router simulation, HEVC video streaming platform with MinIO, a microservice blood donor app, an agro-foods produce-grading ML pipeline for the family business. mostly side quests.

💼 where i've been

  • Instructional Assistant — DSA & Discrete Math · Penn State · Aug 2024 – present
  • AI Research Intern — Network IDS · Anna University CEG · Feb 2023 – Jul 2024
  • Platform Engineer Intern · Tvastr · AWS compliance automation across 1000+ accounts
  • ML Engineer · Lokesh Agro Foods · image classification for produce grading, family-owned organic foods business

🧰 what i use

languages

C++ for serious work · Python and JS for everything else · Rust because it's time

ML / LLM

HuggingFace TransformerLens CUDA LangChain ChromaDB Ollama

infra

📊 the github numbers

📫 say hi



the oracles weren't always wrong. that was the problem.

Pinned Loading

  1. autoencode_detection_research-Project autoencode_detection_research-Project Public

    Jupyter Notebook 1

  2. bloodbank-webapp bloodbank-webapp Public

    1

  3. whatsappbot whatsappbot Public

    JavaScript 1

  4. Linear-algebra-game Linear-algebra-game Public

    C

  5. SSGengine SSGengine Public

    Static Site generator for your portfolio site

    C++

  6. CoT-evaluation CoT-evaluation Public

    Python 1