Indraneel Mukherjee
Portrait of Indraneel Mukherjee
AI Engineer · Agentic Systems, RAG & LLM Infrastructure

Agents that act on production systems. With a human on every irreversible call.

I’m Indraneel — eight years in backend and distributed systems, now building production agentic systems end to end: LangGraph orchestration, hybrid retrieval, MCP servers, and the guardrail and evaluation layers that make them safe to deploy. Currently CTO at Unmatrix Technologies, still principal engineer on every delivery.

8yrsEngineering
12Production LLM systems
50kdocsLargest retrieval corpus
6Engineers led
turn_47 · tracerunning
input_guardsupervisorpolicyaccountremediationexecutorapproval_gateinterrupt() · checkpointed

The supervisor classifies the turn and routes it to a worker. Every hop decrements a turn budget.

Selected work

Three systems, and the part that was actually hard.

Each one shipped with the boring layer attached: a safety boundary in code rather than in a prompt, and numbers measured against a baseline instead of asserted.

01 / 3
LangGraphAzure OpenAIAzure AI SearchPostgreSQLFastAPIAzure Container Apps

Multi-Agent Banking Support System with Durable Human Approval

An agent that can spend the bank's money — so most of the engineering went into making sure it can't do that by itself.

  • Supervisor–worker agent system over a 180-page corpus of published UAE retail-banking policy documents; a lightweight classifier routes intent to policy-retrieval, account and remediation workers, with per-node retries and a hard turn budget.
  • Durable human-in-the-loop gate on all irreversible financial actions the agent emits a typed, cited ActionProposal that a reviewer approves, edits or rejects; the graph checkpoints to Postgres and resumes mid-node after arbitrary delay or process restart. Execution is idempotent and fully audit-logged.
  • Made the safety boundary architectural rather than prompt-based the executor accepts only typed proposals carrying a valid approval record, so a compromised model can propose but cannot act.
  • Hybrid BM25 + vector retrieval with semantic re-ranking, and clause-level chunking with parent-section expansion; cut incorrect fee retrieval from 21% to 6% versus semantic-only search on a fee-lookup scenario set.
  • Defended against prompt injection via tool outputs transaction memo fields are attacker-controlled — by isolating tool results in untrusted state and screening them on the same path as user input.

21%6%

Incorrect fee retrieval vs. semantic-only search
02 / 3
Model Context ProtocolPythonOAuth 2.1 / Entra IDAzure Container AppsPostgreSQLAzure AI Search

Remote MCP Server for Heterogeneous Enterprise Systems

One tool surface over three systems that have nothing in common — and a measurement of what tool-surface design does to model accuracy.

  • Remote MCP server (streamable HTTP) exposing three deliberately heterogeneous systems — a Postgres transactional database, the GitHub REST API and a document store — through one tool surface consumable by any MCP client. Demonstrated in Claude Desktop, Cursor and a custom LangGraph client with zero per-client integration code.
  • Measured tool-selection accuracy against tool-surface size building the same capability at 60 endpoint-shaped tools, 20 grouped and 8 task-shaped: selection accuracy rose from 71% to 94% while per-request tool-definition overhead fell from ~6,200 to ~1,150 tokens. Designed the final surface to absorb joins and pagination into server code rather than model reasoning.
  • Per-user OAuth 2.1 identity propagation the server authenticates the user rather than the model, downstream calls carry that user's authority, and tool visibility is filtered per user at tools/list, closing the confused-deputy exposure of a shared service credential.
  • Constrained SQL access over allowlisted read-only views with mandatory result limits, statement timeouts and EXPLAIN cost-gating to reject unbounded queries before execution.
  • Implemented elicitation and sampling server-initiated human approval on write tools, and server-initiated inference on the client's model to condense retrieved passages before they enter conversation context — protocol capabilities with no REST equivalent.

71%94%

Tool-selection accuracy

~6,200~1,150

Tool-definition tokens per request
03 / 3
PythonLangSmithAzure AI FoundrypytestGitHub ActionsStreamlit

Trajectory Evaluation & Judge Calibration for LLM Agents

Scoring the path the agent took, not just the answer it landed on — and proving the judge doing the scoring was worth trusting.

  • Evaluation layer built on LangSmith tracing for both systems above adding trajectory-level scoring — tool-sequence constraint satisfaction, redundant-call rate, and recovery rate under injected tool failures (timeouts, rate limits, malformed responses, permission denials) — where output-only scoring is blind.
  • Calibrated the LLM judge against 200 hand-labelled pairwise human preferences reporting Cohen's κ per scenario category against a human–human agreement ceiling of 0.71 from double-labelled samples. Agreement was strong on groundedness (κ = 0.68) and weak on tone (κ = 0.34), so CI gating was restricted to the metrics where the judge was calibrated.
  • Quantified and mitigated judge bias 18% of verdicts flipped on presentation order alone, addressed by randomising order and scoring flips as ties; verbosity bias by length-controlled prompting; self-preference by using a cross-family judge model distinct from the generator.

κ 0.68 / 0.34

Judge–human agreement, groundedness vs. tone (ceiling 0.71)

18%

Verdicts that flipped on presentation order alone
Experience

Eight years of systems that had to stay up.

Distributed systems, payments and healthcare platforms before LLMs — which is most of why the agent work holds together.

Current
Nov 2023 — Present
Gurugram, India

Unmatrix Technologies

Chief Technology Officer

Technical founder and principal engineer for an AI consultancy delivering production GenAI systems to enterprise clients. I architect and write the core of every engagement and own delivery from discovery to deployment.

  • Delivered 12 production LLM systems across document intelligence, conversational agents and workflow automation, with typical time-to-production of 2–3 weeks against an internal-hiring alternative measured in months.
  • Defined the firm's reference architecture for agentic systems — LangGraph orchestration, hybrid RAG service, tool registry, guardrail middleware and evaluation harness — cutting per-project setup from roughly three weeks to four days.
  • Designed retrieval architectures over client corpora of up to 50,000 documents, using hybrid search and cross-encoder re-ranking to lift answer accuracy from 62% to 89% on client-defined golden sets.
  • Established AI governance standards adopted across all engagements — human-in-the-loop approval gates and full audit logging for any agent action with financial or data-destructive consequences — a precondition for client sign-off in regulated industries.
  • Cut inference cost 60% through model routing (small models for classification and extraction, frontier models only for reasoning), prompt caching and semantic response caching.
  • Lead and coach a team of 6 engineers; own architecture review, design authority and the hiring bar for AI roles, and act as primary technical counterpart to client stakeholders through discovery and delivery.
Mar 2023 — Jul 2023
Bengaluru, India

Narvar Inc.

Software Engineer, Distributed Systems

Post-purchase experience provider for Fortune 500 retailers

  • Designed and built configuration-driven no-code internal tooling that replaced bespoke per-retailer engineering, reducing retailer onboarding from 30 days to 7 days.
  • Architected a shared HS code lookup service mapping tariff codes to SKUs, streamlining shipping label generation for cross-border shipments and eliminating duplicated classification logic across retailer integrations.
  • Led the integration design for Adidas' order data, implementing Salesforce Apex to ingest and process their feed within our platform.
Jun 2021 — Feb 2023
Bengaluru, India

UnitedHealth Group

Senior Software Engineer

Fortune 5 healthcare company

  • Architected and built multi-tenant Java microservices powering the AVA virtual assistant, including the routing layer that dispatched user intents to downstream service domains and allowed each tenant to scale independently.
  • Delivered Bot and Tenant Registration APIs as the platform's onboarding control plane — versioned contracts and self-service provisioning — with the supporting cloud infrastructure automated end to end through Terraform and CI/CD pipelines.
  • Introduced resilience and observability patterns across services — circuit breakers, retries with exponential backoff, structured logging and latency/health dashboards — reducing mean time to detection on production incidents.
  • Remediated security vulnerabilities across Virtual Agent cloud resources, aligning the platform with enterprise (EIS) security and compliance standards in a Fortune 5 healthcare environment.
Oct 2020 — May 2021
Bengaluru, India

Narvar Inc.

Backend Developer

Post-purchase experience provider for Fortune 500 retailers

  • Scaled the carrier-logistics and retailer shipment data ingestion platform to 2,000 RPS, partitioning ingestion by carrier and adding backpressure handling to absorb burst traffic during peak retail seasons.
  • Built event-driven file-feed and webhook ingestion pipelines for third-party logistics providers, with idempotent processing and dead-letter queues to guarantee at-least-once delivery without duplicate shipment records.
Jun 2019 — Sep 2020
Bengaluru, India

Ninjacart

Software Engineer

Walmart-backed B2B agricultural produce supplier

  • Developed APIs for an internal audit product on AWS using Node.js, Express.js and DynamoDB.
  • Contributed to the payments team, building a fresh-produce supplier settlement system and an internal wallet system for the agri-supply chain.
  • Created in-house analytics dashboards using a master–slave architecture with Redis for real-time reporting, saving $30k annually.
Aug 2018 — May 2019
Bengaluru, India

Mu Sigma

Data Scientist

  • Delivered predictive modelling and decision-science engagements for Fortune 500 clients, building forecasting and classification models plus the analysis that translated them into operating decisions.
Stack

What I reach for, and why it’s grouped this way.

Orchestration and retrieval get the attention; evaluation and governance are what decide whether any of it reaches production.

LLM & Agentic

LangGraphLangChainCrewAIOpenAI Agents SDKModel Context ProtocolTool / function callingReActPlan-and-executeReflectionSupervisor–worker multi-agentPrompt engineeringStructured output (Pydantic / JSON schema)

RAG & Retrieval

Chunking strategyEmbedding selectionHybrid BM25 + vector searchCross-encoder re-rankingAzure AI SearchPineconeQdrantpgvectorFAISS

Evaluation & Observability

Golden datasetsRegression suitesLLM-as-judgeJudge calibrationLangSmithMLflowWeights & BiasesOpenTelemetryCost / latency / task-success tracking

Safety & Governance

Human-in-the-loop approval gatesPrompt-injection defensePII redactionOutput filteringAudit loggingData residency

Cloud & Platform

AWS (EC2, ECS / EKS, S3, RDS, DynamoDB, VPC, Lambda, CloudWatch)Azure (OpenAI, AI Foundry, AI Search, Container Apps)DockerKubernetesTerraformCI/CD

Languages & Frameworks

Java (primary)Spring BootPythonFastAPIasyncioTypeScript / Node.jsExpress.jsSQLKafkaPostgreSQLRedis
Contact

If you’re putting an agent somewhere it can do damage, I’d like to hear about it.

indraneelplay@gmail.com

Education

B.Tech, Electrical Engineering
National Institute of Technology, Raipur
2014 — 2018

Certifications

  • DeepLearning.AI — Neural Networks & Deep Learning
  • DeepLearning.AI — Convolutional Neural Networks
  • DeepLearning.AI — Improving Deep Neural Networks
  • OWASP 2021 Module 04: Insecure Design

Languages

  • English (Professional)
  • Hindi (Native)
  • Bengali (Native)