Architecture & Systems
How the pieces fit together: router + specialist agents on LangGraph, self-hosted vLLM/SGLang inference, semantic caching, async workers, gRPC microservices and observability.
DocuMind AI — Grounded Multimodal Document Q&A at Scale
System design for a 1M-user document Q&A product: async multimodal ingestion, hybrid retrieval, a deterministic confidence gate that refuses instead of hallucinating, and hot/warm/cold session tiering.
Agentic AI Chatbot Platform
Production multi-agent assistant for cybersecurity & case management — a router agent dispatching to five specialist agents across hybrid RAG, text-to-SQL and action execution, on self-hosted vLLM.
3B Tokens/Day Vision-LLM Inference on One GPU
Scaled self-hosted vision-LLM screenshot analysis to 3 billion input and 50 million output tokens per day on a single 96GB GPU — no third-party API spend.
Abuse Reporting Automation Platform
End-to-end automation of trademark and abuse complaints across multiple platforms — FastAPI services, async workers and resilient browser automation.