Move across the keys · press one

Available for ambitious AI work

> hello, I am

Ritesh Rajput.

I build systems that think, retrieve & speak.

I build LLM and retrieval systems end to end — ingestion, hybrid search, reranking, grounded generation, and the APIs and deployment around them.

GitHub LinkedIn Greater Noida, India
PythonPyTorchRAGFastAPIPostgreSQLpgvectorNext.jsVoice AIDockerKubernetesUnityEvaluationPythonPyTorchRAGFastAPIPostgreSQLpgvectorNext.jsVoice AIDockerKubernetesUnityEvaluation
01

About me

I work across the full life of an AI product.

I care about the part after “it works.” How is it measured? What happens when retrieval fails? Can it run without a model provider? Does the answer stay tied to evidence?

Let’s work together

I am an AI engineer working on the parts of an LLM product that decide whether it actually holds up: how documents get chunked, how retrieval is scored and reranked, how answers stay grounded in evidence, and how the whole thing is served and measured under real traffic.

Most of my recent work is retrieval systems and real-time voice. I built a production RAG backend over a 452-page technical manual that reaches 0.975 recall@5 on a gold evaluation set, and a full-duplex voice gateway that streams 24 kHz PCM over WebSockets into locally quantized models. I also wrote a decoder-only transformer and its pretraining pipeline from scratch to understand the layer underneath the API calls.

I have an M.Tech in Computer Science from IIIT Delhi. I work in Python, Java, and TypeScript, and I deploy with Docker, Kubernetes, and AWS. I care about evaluation harnesses more than demos — if I cannot measure a retrieval change, I do not trust it.

Hover to inspectRetrieval before generationStructure-aware ingestion, hybrid search, reranking, evidence constraints, and citations that can be checked.Designed for the audio pathStreaming PCM, routing, STT/TTS, alignment, latency budgets, and listening quality—not a text bot with a microphone.A demo is not a resultGold sets, recall, leakage-safe validation, audible coverage, and explicit acceptance gates decide whether a change is better.Own the path around the modelAPIs, databases, queues, auth, observability, deterministic fallbacks, deployment, and failure recovery.
01

Retrieval first

Strong chunking, hybrid search, reranking, and source authority before generation.

02

Measure it

Gold sets, listening gates, walk-forward tests, and explicit failure modes over demo confidence.

03

Own the system

From model behaviour to APIs, storage, queues, observability, deployment, and UX.

02

Interactive lab

Don’t just read the stack. Run through how it thinks.

python -m dog_v1.evaluate

Live system map

Evidence in. Grounded answer out.

Watch the production retrieval path move from structure-aware ingestion to evaluated, cited output.
0.975recall@5
1Docling
2Hybrid search
3RRF
4Cross-encoder
5Citations

Featured systems

Four builds. Four very different worlds.

01 / 04

Production RAG System

DOG-V1

A domain-specific RAG backend over a 452-page heavy-equipment manual that preserves sections, warnings, tables, figures, part numbers, and page provenance.
PythonFastAPIQdrantBM25Cross-EncoderRedis
Open the case note +

39/40 recall@5 (0.975) on a corrected gold set. Evidence-constrained generation with server-side source-ID, citation, quantity, and identifier validation to stop fabricated page references.

03

Things I built

Products, experiments, research, and systems — not just three featured cards.

Showing 12 of 31 matching projects

01AI & Retrieval

Production RAG System

DOG-V1

A domain-specific RAG backend over a 452-page heavy-equipment manual that preserves sections, warnings, tables, figures, part numbers, and page provenance.

PythonFastAPIQdrantBM25Cross-EncoderRedis
Read the build notes +

My workBuilt the full stack: Docling OCR ingestion, 1,431 structure-aware chunks with 1,170 cross-links, hybrid dense + BM25 retrieval with weighted reciprocal-rank fusion, exact-identifier lanes, and local cross-encoder reranking.

Outcome39/40 recall@5 (0.975) on a corrected gold set. Evidence-constrained generation with server-side source-ID, citation, quantity, and identifier validation to stop fabricated page references.

02Voice & Audio

Real-Time Voice AI

Two-Tier Voice Assistant

A low-latency full-duplex voice gateway that streams 24 kHz PCM audio from the browser over WebSocket into a Spring Boot gateway coordinating STT and TTS sidecars.

Java 21Spring BootWebSocketsOllamaMLXDocker
Read the build notes +

My workDesigned the two-tier router that keeps conversation on a locally hosted Qwen3-4B for fast turns and escalates to a stronger backend LLM for slower factual answers, with a harmonizer merging both paths into one audio stream.

OutcomeQuantized inference on Apple Silicon via MLX q4 (Kyutai Moshi), model lifecycle management, health checks, and Prometheus metrics. Stub mode is the default so the whole gateway runs in CI with no GPU or API key.

03AI & Retrieval

LLM From Scratch

Hinglish LM Pretraining Stack

A decoder-only transformer and its full pretraining pipeline built from first principles, to study what a Hinglish model should be trained on.

PyTorchTokenizersNumPypytestruff
Read the build notes +

My workImplemented RMSNorm, rotary embeddings, grouped-query attention via scaled dot-product attention, SwiGLU feed-forward, pre-norm blocks, tied output head, and scaled init — plus weight decay applied only to 2D parameters through explicit optimizer groups.

OutcomeYAML-driven configs for 50M/100M/300M variants, byte-level BPE tokenizer training, streaming download/clean/dedup/tokenize pipeline with hash-checked idempotency, and a seeded mixture sampler. Every stage is locked behind a test gate before it counts as done.

04AI & Retrieval

Orchestrated RAG Commerce

AFC Grocery Assistant

A full-stack storefront with a rule-guided RAG assistant that keeps two sources of truth strictly separate: PostgreSQL for product facts, Qdrant for policy knowledge.

PythonFastAPIPostgreSQLQdrantNext.jsDocker
Read the build notes +

My workBuilt the authority contract — the planner extracts intent and filters, but a deterministic rule layer decides the source. The model can never submit raw SQL; only a validated ProductFilters schema is compiled to SQLAlchemy expressions.

OutcomeMetadata-filtered dense search plus BM25 fused with reciprocal-rank fusion, parallel retrieval branches for compound questions, and a 40-question retrieval evaluation set. 100 products, 508 category nodes, 8 locations.

05Voice & Audio

Applied AI + DSP

Audio Drama Engine

A Chrome extension plus local engine that turns a web-novel chapter into a produced audio drama: narrated, multi-voiced, with sound effects landing on exact words.

JavaScriptNode.jsKokoro TTSForced AlignmentDSPChrome Extension
Read the build notes +

My workDesigned the system around two rules — every sound is positioned by word index in the frozen chapter text rather than seconds, and measurements beat models: loudness, onset, and loop suitability come from DSP, never from a model's description.

OutcomeModels are used for judgment and always produce proposals that get validated against invariants, with deterministic fallbacks. Uncalibrated scores are explicitly marked so nobody reads them as probabilities.

06Voice & Audio

Speech Pipeline

Zero2OneTTS

Turns a structured story script in any language into organised narrator and character voice tracks, keeping SFX and ambient cues as metadata instead of speaking them.

PythonTTSWhisperDNSMOSElevenLabsFlask
Read the build notes +

My workBuilt the parser, speaker/emotion annotation pass, a season bible that acts as series memory across episodes, and multi-provider synthesis across OpenAI and ElevenLabs.

OutcomeAutomatic QC transcribes every generated line and compares it to the script by normalized word-error-rate, regenerating failures. Multi-take direction renders N seeds per line and picks the best by QC errors, then local DNSMOS perceptual score.

07Platforms

ML Library From Scratch

NeuraLib

A Python machine-learning library written from first principles instead of wrapping scikit-learn.

PythonNumPyAutogradpytestPackaging
Read the build notes +

My workImplemented 15+ classical ML algorithms and a reverse-mode autograd engine, with Dense, Conv2D, BatchNorm, Dropout, RNN, LSTM, and multi-head self-attention layers, plus SGD, Momentum, and Adam optimizers.

OutcomePackaged, tested with pytest, and documented with runnable examples. This is where I keep the math honest.

08AI & Retrieval

AI-Integrated Platform

GymBro

A mobile-first fitness marketplace spanning iOS, Android, and web, with recurring three-week coaching packages, scheduling, and payments.

NestJSPostgreSQLPrismaRedisBullMQReact Native
Read the build notes +

My workArchitected a multi-service platform with cross-repository interfaces defined in OpenAPI, AsyncAPI, and JSON Schema, and isolated all model access behind a dedicated AI gateway service enforcing PII redaction before any request leaves the trust boundary.

OutcomeMedia worker for validation, thumbnails, and OCR; scheduling and payment domains handled through queue-based async workflows with atomic overlap protection on every booked session.

09Vision & ML

Multimodal Research

Uni-Sign Reimplementation

A from-scratch implementation of the Uni-Sign multi-task sign-language model from arXiv:2501.15187.

PyTorchGraph NetworksMulti-Task LearningTransformers
Read the build notes +

My workBuilt 69-keypoint pose input split across left hand, right hand, body, and face, three-layer spatial graph pose encoders per sub-pose group, temporal encoders, and prior-guided fusion gates for hand pose and RGB interaction.

OutcomeOne unified text-generation objective covers isolated recognition, continuous recognition, and translation. Runs locally with a tiny causal decoder so the repo works without downloading a large language model.

10AI & Retrieval

LLM Product

SEO Lens

A Chrome extension and Vercel web app that audits any page in one click, then ranks and clusters its keywords against competitor sites.

JavaScriptVercelGroqOpenAITF-IDFChrome Extension
Read the build notes +

My workBuilt 28 deterministic on-page checks, a placement-weighted n-gram keyword profile, and TF-IDF competitor scoring — with an optional LLM enhancement layer supporting OpenAI, Groq, and Claude keys.

OutcomeThe deterministic audit works with no key at all; the model layer is strictly additive. Groq requests are sized under a 12K-token allowance with bounded retries on 429s and user-facing recovery guidance for every failure class.

11Voice & Audio

Generative Storytelling

Pocket Multiverse

An audio-first interactive storytelling system where the world remembers the listener's choices and characters only know what they should know.

TypeScriptNext.jsLLM OrchestrationTTSCloudflare
Read the build notes +

My workWorked on the context and memory model — persistent world state, per-character knowledge boundaries, and consequence tracking so side stories inherit the history that made a character interesting.

OutcomeBuilt for the Pocket FM x HackCulture hackathon, where it finished in the Top 10.

12Platforms

ML + Platform

CodeGuard

A coding evaluation platform for classrooms: professors publish problems with hidden tests, students submit Python, and the system grades and flags likely plagiarism.

FastAPIExpressPrismaPostgreSQLDockerReact
Read the build notes +

My workBuilt the FastAPI ML service that tokenizes Python ASTs and compares submissions by TF-IDF cosine similarity, plus the Docker-based sandbox runner for isolated execution.

OutcomeReact frontend, Express API with JWT auth and role checks, Prisma/PostgreSQL model, and a full Docker Compose stack.

04

Experience

Research discipline, product ownership, and production delivery.

01
2025 - PresentRemote, India

Freelance / Independent

AI Engineer

Building RAG systems, LLM-backed assistants, and automation workflows for clients, from ingestion pipelines through deployed APIs.

What I worked on +
  • Designed document-ingestion and retrieval pipelines with structure-aware chunking, metadata filtering, hybrid dense + BM25 search, cross-encoder reranking, and citation validation.
  • Built LLM assistants and orchestration layers over FastAPI and vector databases (Qdrant, pgvector), with Redis-backed session context and webhook integrations.
  • Containerized and deployed AI APIs and background workers on AWS with REST/WebSocket interfaces, authentication, health checks, and CI/CD.
  • Delivered evaluation harnesses alongside each system so retrieval and answer quality are measured, not assumed.
02
Apr 2025 - Sep 2025New Delhi, India

Quant Research Lab

Quantitative ML Research Intern

Built forecasting models and leakage-safe backtesting infrastructure for noisy financial time-series across 10 assets.

What I worked on +
  • Trained BiLSTM and gradient-boosting models with CEEMDAN signal decomposition to separate trend from noise.
  • Designed leakage-safe training and nested walk-forward backtesting so reported numbers reflected out-of-sample behaviour, not fitted noise.
  • Directional accuracy moved from 48-51% to 52-55% with log loss held below 0.60 under walk-forward validation.
  • Built the surrounding Python data pipelines: feature construction, external-data enrichment, normalization, and daily retraining simulation.
05

Tech stack

The tools change. The engineering habits travel.

01

AI & ML

PyTorchTransformer internals (RoPE, GQA, SwiGLU, RMSNorm)RAG pipelinesEmbeddingsCross-encoder rerankingEvaluation harnessesFine-tuningHugging Facescikit-learnOpenCV
02

AI Infrastructure

QdrantpgvectorPineconeHybrid dense + BM25LLM inference & quantization (MLX, Ollama, ONNX Runtime, llama.cpp)GroqOpenAI APIStreaming STT/TTS24 kHz PCM over WebSocketPII redaction boundaries
03

Backend & APIs

PythonJavaTypeScriptFastAPISpring BootNestJSDjangoNext.jsRESTWebSocketsJWT / RBACOpenAPI / AsyncAPI
04

Data & Cloud

PostgreSQLMySQLRedisBullMQPrismaDockerKubernetesAWS (EC2, RDS, EKS)TerraformGitHub Actionspytest / JUnit

Education & recognition

Built on fundamentals, sharpened by shipping.

2023 - 2025

M.Tech, Computer Science & Engineering

IIIT Delhi

CGPA 7.14/10
2019 - 2023

B.Tech, Computer Science & Engineering

Gautam Buddha University

CGPA 8.14/10
Selected recognition
  • Selected for the Pocket FM x HackCulture Hackathon — finished in the Top 10.
  • GATE qualified in Computer Science, 2023 and 2025.
  • Active competitive programmer on Codeforces.

Open to roles, collaborations, and difficult AI problems.

Have a system worth building?

Open to AI Engineer, ML Engineer, and Forward Deployed Engineer roles — RAG systems, LLM infrastructure, real-time voice, and applied ML platforms.

Say hello

ritesh23075@iiitd.ac.in

Greater Noida, India

LET’S BUILD ITGitHubLinkedInEmail
© 2026 Ritesh RajputDesigned around the work, not a template.Back to top