ML Engineer

Sarvam; India; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

A technology company in Bengaluru is seeking a Senior Software Engineer to work on an enterprise-grade AI orchestration platform. The role requires 3-5 years of experience, strong skills in Python, and familiarity with microservices architecture. You will design distributed systems, optimize task execution engines, and develop integrations with various LLM providers. The position offers the chance to be at the forefront of AI technology in a collaborative environment.

Qualifications

• 3-5 years of experience as a software engineer.
• Production experience with Python and async programming.
• Understanding of LLM API integration and microservices patterns.
• LLM/embeddings integration (OpenAI/Google/Anthropic) and RAG concepts.
• Docker, Kubernetes basics, observability (logging/tracing).
• Cloud experience (GCP/AWS/Azure).
• Nice to have: Workflow orchestration (Temporal/Celery).

Responsibilities

• Design and implement distributed microservices for AI orchestration.
• Build and optimize task graph execution engines.
• Develop integrations with multiple LLM providers.
• Create and maintain gRPC/REST APIs for real-time AI interactions.
• Work on knowledgebase systems with vector search capabilities.
• Contribute to MCP (Model Context Protocol) server implementations.

Skills

Python

Backend Frameworks (FastAPI)

PostgreSQL

Redis

AI/ML API integration

Docker

Kubernetes

Cloud experience (GCP, AWS, Azure)

Tools

FastAPI

gRPC

Protobuf

PostgreSQL (SQLAlchemy)

Redis

Docker

Kubernetes

LLM integration

Vector embeddings / RAG

Git & CI/CD basics

Temporal (nice to have)

Job description

Job type: Full Time · Department: Engineering · Work type: On-Site

About Sarvam.ai

Sarvam.ai is at the forefront of India’s AI revolution, dedicated to building transformative technologies that empower users and redefine digital interactions. Our mission is to develop intelligent systems that seamlessly integrate into everyday workflows, enhancing productivity and user experience.

About the Role

We are looking for a Senior Software Engineer with 3-5 years of experience to join our team building an enterprise-grade AI orchestration platform. You will work on our agentic execution layer that integrates large language models (LLMs), third-party tools, and task graph execution to enable complex AI-driven workflows.

What You’ll Work On

• Design and implement distributed microservices for AI agent orchestration
• Build and optimize task graph execution engines for LLM-powered workflows
• Develop integrations with multiple LLM providers and tool ecosystems
• Create and maintain gRPC/REST APIs for real-time AI interactions
• Work on knowledgebase systems with vector search capabilities
• Contribute to MCP (Model Context Protocol) server implementations

Required Skills

Must Have

• Python – 3+ years production experience, async programming (asyncio), type hints, Pydantic
• Backend – FastAPI or similar frameworks, gRPC & Protobuf, microservices patterns
• Databases – PostgreSQL (SQLAlchemy, migrations), Redis (caching, pub/sub, distributed locks)
• AI/ML – LLM API integration (OpenAI, Google AI, Anthropic), understanding of embeddings & RAG
• Infrastructure – Docker, Kubernetes basics, observability (logging, tracing)
• Cloud – GCP, AWS, or Azure experience

Nice to Have

• Workflow orchestration (Temporal, Celery)