ML Engineer

Sarvam AI; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Sarvam AI is hiring a Senior Software Engineer to help build an enterprise-grade AI orchestration platform. You will work on an agentic execution layer that connects LLMs, tools, and task graphs to enable complex AI workflows.

Requirements include 3+ years of production Python experience, asynchronous programming, FastAPI, gRPC, and cloud experience across GCP/AWS/Azure. Knowledge of embeddings, RAG, Docker, and Kubernetes is beneficial.

Qualifications

• 3+ years of production Python experience, including async programming (asyncio) and type hints.
• Backend experience with FastAPI or similar, gRPC & Protobuf, and microservices patterns.
• Database experience with PostgreSQL (SQLAlchemy, migrations) and Redis (caching, pub/sub).
• Hands-on LLM API integration (OpenAI, Google AI, Anthropic) and knowledge of embeddings and RAG.
• Cloud exposure across GCP, AWS, or Azure.
• Docker and Kubernetes basics; observability basics (logging/tracing).

Responsibilities

• Design and implement distributed microservices for AI agent orchestration.
• Build and optimise task graph execution engines for LLM-powered workflows.
• Develop integrations with multiple LLM providers and tool ecosystems.
• Create and maintain gRPC/REST APIs for real-time AI interactions.
• Implement document processing pipelines — ingestion, chunking, and vector embeddings.
• Build and maintain knowledge base systems with vector search capabilities.
• Build code interpreter sandboxes for safe AI code execution.
• Contribute to MCP (Model Context Protocol) server implementations.

Skills

Python (asyncio)

Async programming

Type hints

Pydantic

FastAPI

gRPC

Protobuf

Microservices

PostgreSQL

Redis

LLM API integration

Embeddings

RAG

Cloud (GCP/AWS/Azure)

Tools

Docker

Kubernetes

gRPC

Protobuf

Job description

About Sarvam

Sarvam is building the bedrock of Sovereign AI for India. The company is developing India’s full-stack sovereign AI platform, building across research, models, infrastructure and applications with a singular focus on making AI genuinely work for India. Sarvam works with leading enterprises and public institutions and is backed by Lightspeed, Peak XV, and Khosla Ventures. Sarvam partners with India’s leading brands, including Tata Capital, SBI Life, CRED, IDFC, and LIC.

About the Role

We are looking for a Senior Software Engineer with 3–5 years of experience to join our team building an enterprise-grade AI orchestration platform. You will work on our agentic execution layer that integrates large language models (LLMs), third-party tools, and task graph execution to enable complex AI-driven workflows.

What You’ll Do

• Design and implement distributed microservices for AI agent orchestration

• Build and optimise task graph execution engines for LLM-powered workflows

• Develop integrations with multiple LLM providers and tool ecosystems

• Create and maintain gRPC/REST APIs for real-time AI interactions

• Implement document processing pipelines — ingestion, chunking, and vector embeddings

• Build and maintain knowledge base systems with vector search capabilities

• Build code interpreter sandboxes for safe AI code execution

• Contribute to MCP (Model Context Protocol) server implementations

What We’re Looking For

• 3+ years of production Python experience — async programming (asyncio), type hints, Pydantic

• Backend proficiency: FastAPI or similar frameworks, gRPC & Protobuf, microservices patterns

• Database experience: PostgreSQL (SQLAlchemy, migrations), Redis (caching, pub/sub, distributed locks)

• Hands-on LLM API integration (OpenAI, Google AI, Anthropic) and working knowledge of embeddings and RAG

• Infrastructure experience: Docker, Kubernetes basics, observability (logging, tracing)

• Cloud experience with GCP, AWS, or Azure

Bonus Points

• Experience with vector databases such as Milvus or Pinecone

• Familiarity with workflow orchestration tools like Temporal or Celery

• Document processing experience — PDF parsing, OCR

• Experience with the Bazel build system

• Knowledge of MCP (Model Context Protocol)

Why Sarvam?

Sarvam is a fast-moving, high talent-density team building full-stack AI for India, working on problems that push the frontiers of AI with real population-scale impact.

• Work alongside researchers, engineers, builders, and business leaders who move fast and hold each other to a very high bar

• High ownership and high impact, from day one

• Everything we do is AI-first, from the way we build and ship to the way we think about problems

• You can work on problems that could change how an entire country learns, works, and communicates

If you want to work on problems at the frontier of AI in India, Sarvam is the place to be.