Lead Software Engineer - AI Agent Developer

JP Morgan Services India Pvt Ltd

Bengaluru

On-site

INR 4,000,000 - 7,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Qualifications

  • 8+ years in software engineering with large-scale systems.
  • Experience deploying LLM/agent systems in production.
  • Strong knowledge of foundation models and prompting strategies.
  • Experience with knowledge graphs (Neo4J preferred).
  • Experience with observability (tracing, metrics, logs).
  • Proficiency in Python, Java, Go, or TypeScript.
  • Familiarity with retrieval systems and vector databases.
  • Strong API and distributed-systems fundamentals.

Responsibilities

  • Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
  • Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution).
  • Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
  • Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
  • Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
  • Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
  • Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
  • Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).

Skills

Python
Java
Go
TypeScript
LLM knowledge
System design
API design
Distributed systems
Memory management
Observability

Tools

Neo4J
Vector databases
APIs

Job description

Lead Software Engineer- AI Agent Developer Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team. We’re seeking a Lead Software Engineer (AI/ML) to build and operate scalable, low-latency autonomous agent systems in production. You’ll lead the design and delivery of agentic platforms that reliably serve 100K+ customers, combining strong software engineering fundamentals with deep hands-on expertise in foundation models and LLM-powered architectures.

Job responsibilities
  • Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
  • Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution).
  • Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
  • Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
  • Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
  • Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
  • Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
  • Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).
Required qualifications, capabilities and skills
  • 8+ years of software engineering experience, including leading design and delivery of large-scale production systems.
  • Demonstrated experience building and operating LLM/agentic systems in production with strict latency and reliability requirements.
  • Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns.
  • Strong understanding of Knowledge graph (Neo4J preferred), Open Knowledge formats (OKFs) Proven expertise in context and memory engineering, model evaluation methodologies, and quantity measurement.
  • Experience implementing observability for distributed systems and AI applications (tracing/metrics/logs, dashboards, alerting, on-call readiness).
  • Strong programming skills in one or more of: Python, Java, Go, or TypeScript; plus strong API and distributed-systems fundamentals.
  • Familiarity with retrieval systems, vector databases, and hybrid search patterns.
Preferred qualifications, capabilities and skills
  • Agentic AI architecture: planner/executor patterns, multi-agent orchestration, tool-use design, retrieval workflows
  • LLM/foundation model expertise: prompting strategies, tool-augmented generation, model behavior understanding
  • Context & memory engineering: short/long-term memory, summarization, retrieval grounding, caching strategies
  • Knowledge graphs: Neo4J (preferred), Open Knowledge Formats (OKFs) Retrieval systems: vector databases, hybrid search patterns

Experience Level Senior Level

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Software Engineer- AI Agent Developer
Lead Software Engineer- AI Agent Developer

JP Morgan Chase • Bengaluru

On-site
INR 3,500,000 - 7,000,000
Lead Software Engineer- AI Agent Developer
Lead Software Engineer- AI Agent Developer

Aumni • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Agentic AI Developer
Agentic AI Developer

Vibehackers • Dadri, Hyderabad

On-site
INR 1,800,000 - 2,800,000
Senior Technical Lead - Agentic AI / Generative AI
Senior Technical Lead - Agentic AI / Generative AI

Weekday AI • India

Remote
INR 3,000,000 - 5,000,000
AI Software Architect / Senior AI Engineer (LLM & Agentic Systems)
AI Software Architect / Senior AI Engineer (LLM & Agentic Systems)

BuildxPartners • Hyderabad

On-site
INR 4,000,000 - 8,000,000
AI Engineer
AI Engineer

TheMathCompany Inc. • Bengaluru

On-site
INR 1,800,000 - 3,000,000
Senior Agentic AI Engineer
Senior Agentic AI Engineer

Alternative Path • Gurugram District

On-site
INR 1,400,000 - 2,400,000
Senior Technical Lead - Generative AI
Senior Technical Lead - Generative AI

Weekday AI • India

Remote
INR 3,000,000 - 5,000,000
AI Engineer (Agentic AI & LLM Systems)
AI Engineer (Agentic AI & LLM Systems)

Beroe Inc • India

Remote
INR 3,000,000 - 6,000,000
Sr. Software AI Engineer
Sr. Software AI Engineer

Mployee.me • Bengaluru

On-site
INR 2,400,000 - 4,000,000
Relocation Assistance Provided