●Open for freelance & contract projects — DM me

I build AI agents that ship. Right now that means AI memory, agent infra, and inference engineering.

I'm Arush, an AI engineer. Most of my work is agentic systems: LangGraph orchestration, graph memory for coding agents, retrieval you can inspect, and the inference layer underneath. Designed, shipped, and monitored on GCP.

2
open-source PyPI packages
10K+
chunks grounding RAG
71ms
p50 graph retrieval

What I focus on

→ Applied AI

Turning models into products people use. SAADHO reached 155 users in its first 10 days, alongside voice interviewers, a RAG support agent, and an assessment engine deployed on GCP.

Python · TypeScript · Next.js · GCP Cloud Run

→ AI memory

What an agent keeps and how it finds it again. GraphSight pairs 384-dim HNSW search with multi-hop typed-edge traversal at 71ms p50, and Bodhi moves session state through in-memory, Redis, and PostgreSQL tiers.

HNSW · Graph traversal · pgvector · Redis

→ AI agent infra

The orchestration, tracing, and evals around the model. A 6-phase LangGraph agent, two open-source packages for retrieval observability, and an audit that root-caused a defect mis-scoring 400+ submissions.

LangGraph · LangSmith · Eval datasets · FastAPI

→ Inference engineering

Making model calls fast and dependable. A hybrid LLM router in GraphSight, automatic model fallback in AltEgo, and speech models chosen by measured word error in SAADHO (7–9% vs 54–61%).

Groq · GLiNER · Sarvam · Cartesia

// operating principle

System design is the programming language, AI is the compiler.
01

Selected work

SAADHO

2026

AI/ML interview prep, planned day by day

→ 142 of 155 users built a plan in the first 10 days

SAADHO live demo

The problem. Prepping for an AI/ML interview means a hundred open tabs and an hour just spent working out where to start. You end up with a pile of resources and no order to them.

What I built. You enter your role, interview date, and daily hours, and SAADHO builds a day-by-day plan: it fits the must-know topics into the time you have, drops the optional ones first, and orders the rest by prerequisite over resources I've curated, each with a short briefing. Company prep covers 203 companies, 81 with sourced interview rounds, and splits a 1-hour sprint across that company's actual rounds. A voice practice room runs a group discussion with four AI colleagues — one confidently wrong, one holding the deciding fact it shares only if asked — in English or Hinglish, with a scorecard that quotes your own words back.

  • Voice pipeline without a framework: push-to-talk replaces turn detection, and interrupting cancels the pending line and trims the transcript to what you actually heard
  • Hinglish speech-to-text chosen by measurement — 7–9% word error with Sarvam vs 54–61% with Deepgram
  • A rule-based classifier labels 972 of 1,026 sourced interview rounds, and each sprint divides its time across them
  • Row-level security on every user table; plans work as a guest, with no account needed
Next.js 16TypeScriptTailwind v4SupabaseClaude HaikuSarvamCartesia

GraphSight

2026

Graph memory for AI coding agents

→ ~90% lower latency (4.5s → <500ms)

GraphSight live demo

The problem. Root-cause analysis in distributed systems is slow. When something breaks, engineers end up tracing service dependencies by hand to work out what a given bug affected.

What I built. An observability platform built on a custom GraphRAG engine that maps service dependencies and automates root-cause analysis. A hybrid LLM router classifies intent using Groq Llama-3.1-8B and GLiNER for zero-shot NER, backed by LadybugDB, a custom multi-hop graph database that runs batched Cypher traversals. The React Flow frontend visualizes the blast radius of a bug across GitHub PRs and Jira tickets, with plain-English summaries.

  • Batched Cypher queries in LadybugDB eliminate N+1 bottlenecks
  • Sustained 13 req/s with zero errors under a 25-way concurrent load test
  • Interactive blast-radius view spanning GitHub PRs and Jira tickets
PythonFastAPIReact FlowGroq Llama-3GLiNER

Bodhi

2026

AI mock-interview platform

→ Sub-millisecond session latency at scale

Bodhi live demo

The problem. Interview prep tends to be either expensive coaching or a static question bank. Neither feels realistic, offers meaningful feedback, or scales.

What I built. A voice-first interview platform with a 6-phase adaptive pipeline and 4-dimensional scoring, with live proctoring via FaceNet512, MediaPipe, and YOLOv8. Session state moves through a 3-tier store, from in-memory to Redis to PostgreSQL.

  • RAG over 10K+ document chunks keeps follow-up questions grounded
  • Sarvam AI for STT/TTS, with a gamification engine spanning XP and 7 rank tiers
LangGraphFastAPIPostgreSQLRedisYOLOv8MediaPipe

AltEgo

2026

Parallel-universe AI for X profiles

→ 4 validated personas from one LLM call

AltEgo live demo

The problem. A viral AI toy is easy to demo and hard to keep working — external APIs rate-limit, keys go missing, and results have to unfurl cleanly when someone shares them.

What I built. AltEgo turns any public X/Twitter handle into four exaggerated 'parallel-universe' versions of the account. It fetches recent tweets and runs them through a single Groq call (Kimi K2, with an automatic Llama 3.3 70B fallback) that returns validated JSON for all four personas — each a different archetype from a pool of 20, with a parody handle, tweets that mimic the person's real writing style, vibe stats, and an absurd engagement projection. Every external dependency degrades gracefully: with no API keys it runs a fully functional demo mode on deterministic sample data, so local dev and CI need zero setup. Results are cached per handle in Upstash Redis, and each one gets a short URL with a dynamically generated Open Graph image so it previews cleanly on X.

  • Graceful degradation: full demo mode with zero API keys, real APIs swap in when configured
  • Per-result Open Graph images via next/og, plus downloadable 4-in-1 share cards
  • Custom hand-drawn 'sketchbook' design system — SVG doodles, marker type, Framer Motion
Next.js 15TypeScriptGroqUpstash Redisnext/ogFramer Motion

SmartFlow

2025

RL traffic optimization

→ 30% lower average wait time

SmartFlow live demo

The problem. Fixed-timer traffic signals don't respond to real congestion, so an intersection can sit red over an empty lane while traffic backs up beside it.

What I built. A real-time vision pipeline tracks vehicles across 4-lane intersections, and a reinforcement-learning agent uses the live counts to adjust signal timing dynamically.

  • 94% vehicle detection accuracy at 30 FPS
  • Analyzes 500+ traffic patterns an hour, improving flow efficiency by 40%
YOLOv8DeepSORTReinforcement Learning

More projects

FlowState

2026

Realtime collaborative whiteboard

→ In active development

A backend-first collaborative whiteboard built around an immutable operation log, snapshot-based replay, per-room version ordering, and websocket broadcast — the same primitives behind Figma and Excalidraw multiplayer. I designed the system before implementing it, with 18+ diagrams covering architecture, schema, sequence flows, reconnect recovery, and a Redis pub/sub scaling path.

FastAPI · WebSockets · PostgreSQL · React · Konva

Applyzer

2025

AI job-application automation

→ 100+ applications tracked end-to-end

It generates tailored LaTeX resumes, cover letters, and cold emails, with an async scheduler that polls Gmail and sends context-aware follow-ups. A human stays in the loop throughout.

FastAPI · PostgreSQL · Redis · LangGraph · Groq LLaMA 3

ATS Scorer

2025

Semantic resume matching

→ Deployed full-stack on AWS

It scores resumes against a job description using SentenceTransformers for semantic matching, with LLaMA 3 generating feedback on what's missing.

FastAPI · React · Groq LLaMA 3 · SentenceTransformers · AWS · MongoDB

AeroMix

2024

Gesture-based audio control

→ 96% recognition across 12 commands

A computer-vision system that maps hand gestures to audio commands in real time, using MediaPipe landmarks and lightweight ML classifiers.

MediaPipe · OpenCV · ML classifiers

02

About

What interests me most is the engineering around a model, not the model itself. Getting an agent to produce a good answer once is the easy part. Making it retrieve the right context every time, stay grounded across thousands of documents, and letting you see exactly which chunk the answer came from is where the real work is.

Most of what I've built sits at the boundary between an LLM and the system around it — LangGraph interview and assessment agents, a GraphRAG engine with multi-hop retrieval, and two open-source packages for retrieval observability. There's real-time computer vision in there too, but the throughline is agents that hold up once real users depend on them. I've also taught it, including an 8-week NLP course for 20+ students.

Winner

Built an RL traffic system that cut wait time by 30%, beating 200+ teams at Hackers Playground.

1st place

First place at the IIIT-Delhi Ideathon for an AI-driven system architecture.

Finalist ×5

Reached the finals of 5 national hackathons, placing in the top 1% of 500+ teams across India.

Production

Shipped a pipeline processing 10K+ aerial images a day at sub-200ms latency.

Teaching

Designed and taught an 8-week NLP course with a 90% completion rate.

Community

Ran AI/ML hackathons and workshops, mentoring 100+ participants.

03

Experience

May 2026 – Present

Applied AI Intern

·Gravity AI

I prototype and ship features across the AI stack — prompting, retrieval, evaluation, and lightweight model integrations, along with backend work where it's needed. Much of the role is experimental: building and labeling datasets, defining success metrics, and turning the results into code that ships. The throughline is making the agents more reliable for real users, working closely with product and engineering to ship on schedule.

LLMsRAGEvaluationPythonFastAPI

Feb 2026 – Apr 2026

AI Engineer

·HiTouchCX (REBOO8)

Built four production AI systems, all deployed on GCP: live proctoring, a RAG support agent, a voice interviewer, and a LangGraph assessment engine.

YOLOv8DeepSORTMediaPipeLangGraphFastAPIRedis

Jun 2025 – Present

ML DevOps Trainee

·Kanchan Drones India

Built 5+ ML pipelines processing 10,000+ aerial images a day, plus a Unity desktop app that gives 15+ drone operators real-time imaging. The pipelines cut manual intervention by 65%.

OpenCVWebSocketsUnityML Pipelines

Jun 2025 – Sep 2025

AI/ML Intern

·Circus Theory · Dubai

Built edge ML pipelines across 8+ devices, reaching 92% accuracy on 50GB+ datasets with 45% lower latency.

YOLOv8TensorFlowPyTorchESP32

Nov 2025 – Dec 2025

AI/ML Instructor

·Apna College

Designed and taught an 8-week NLP curriculum covering everything from tokenization to transformers, with a 90% completion rate across 20+ students.

NLPTransformersCurriculum

Sep 2024 – Oct 2024

Credit Risk Modeling Intern

·Peak2Tails

Built Basel-compliant credit scorecards for 5,000+ users, improving prediction accuracy by 22% and cutting prep time by 40%.

PythonStatistical ModelingPandas
04

Writing

05

Contact

Working on something that needs to ship?

Open for freelance & contract projects — DM me. Email or any of the links below works, and I read everything that comes in.

arushkarnatak1881@gmail.com