SDE2 - API Platform

AI Voice Base; Bengaluru; Presencial; INR 2.500.000 - 4.000.000; Jornada completa

Descripción de la vacante

Sarvam AI in Bengaluru is hiring a Software Development Engineer 2 to own core API components of our platform. You will advance the API stack, support streaming for chat completions, and ensure reliable routing and failover.

Collaboration with inference and MLOps teams is essential as we prepare new model launches for production. We value 3+ years building backend systems, strong Python and FastAPI skills, and willingness to gain proficiency in Go.

Formación

• 3+ years of experience building backend systems.
• Strong Python skills with frameworks like FastAPI.
• Willingness to learn Go and contribute to a Go backend transition.
• Experience with PostgreSQL and Redis for data management.
• Experience running services on Kubernetes.

Responsabilidades

• Own critical components of the API platform.
• Build and evolve the API stack and streaming infrastructure for chat completions.
• Manage routing and failover mechanisms.
• Maintain metering and billing features.
• Collaborate with inference and MLOps teams for production model launches.
• Focus on observability and integration testing to ensure robust service delivery.

Conocimientos

Python

Go

FastAPI

Streaming protocols (SSE/WebSockets)

Observability

Herramientas

Kubernetes

PostgreSQL

Redis

WebSockets

Descripción del empleo

At Sarvam AI, the engineering team is focused on developing and maintaining a sophisticated API platform that supports various AI models including large language models, speech recognition, text-to-speech, vision, and translation. This platform enables developers and enterprises to integrate foundation models into their products through OpenAI-compatible APIs. The team is currently transitioning their backend from Python to Go to enhance performance and reliability, emphasizing a design-first and documentation-driven engineering culture.

The Software Development Engineer 2 role involves owning critical components of the API platform, ensuring high reliability, performance, and scalability. Daily responsibilities include building and evolving the API stack, managing streaming infrastructure for chat completions, handling routing and failover mechanisms, and maintaining commercial features like metering and billing. The engineer will collaborate closely with inference and MLOps teams to prepare new model launches for production, while also focusing on observability and integration testing to maintain robust service delivery.

Candidates should have at least three years of experience building backend systems, strong Python skills with frameworks like FastAPI, and familiarity or willingness to learn Go. Experience with streaming protocols such as SSE or WebSockets, PostgreSQL and Redis for data management, and running services on Kubernetes is essential. Bonus qualifications include prior work with LLM APIs, inference servers, and usage-based pricing systems. The role is onsite in Bengaluru, offering an opportunity to contribute to AI solutions with significant societal impact in India.