Founding ML Infrastructure Engineer

Kalpa Labs

Bengaluru

On-site

INR 4,200,000 - 6,800,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Kalpa Labs in Bengaluru seeks a Founding ML Infrastructure Engineer to own the systems that train and serve speech models. You will lead distributed training, realtime inference, and cloud services with immediate impact.

You will work in a small team, shaping the stack from day one, with plentiful compute and a path to production in days. Strong background in ML systems and low-latency infra is required.

Qualifications

  • 3+ years building ML systems or high-performance backend infra.
  • Hands-on depth in distributed training, LLM serving, data processing, or low-latency streaming.
  • Ability to spec, build, debug, and ship in ambiguity.
  • Speech/audio experience is a plus but not required.

Responsibilities

  • Own the training stack with FSDP/TP and Megatron-style tensor parallelism.
  • Improve realtime inference speed for time-to-first-audio and throughput.
  • Build scale data pipelines processing millions of hours of audio.
  • Run production path: API gateway, streaming WebSocket APIs, logging and monitoring.

Skills

Distributed training
LLM serving
High-performance backend
Low-latency streaming

Tools

PyTorch
vLLM
TensorRT
Megatron

Job description

Python Distributed Systems Machine Learning CUDA

We're hiring a Founding ML Infrastructure Engineer in Bengaluru to own the systems that train and serve our Speech models: the distributed training stack, Realtime inference engine, and the cloud services. You'll work in a small team with tons of compute and see your ideas making it to production in days.

What you'll do

  • Own the training stack: FSDP/HSDP and Megatron-style tensor parallelism in our PyTorch framework
  • Make realtime inference fast: time-to-first-audio and throughput on our vLLM-based engine, Quantization, model compilation and load testing under high concurrency.
  • Build data pipelines at scale: Work on creating in-house data pipelines that process Millions of hours of audio and feed training at high throughput.
  • Run the production path: API gateway and streaming WebSocket APIs, deploy tooling, logging, monitoring.

What we're looking for

  • 3+ years building ML systems or high-performance backend infrastructure.
  • Hands-on depth in at least one of: distributed training (FSDP/TP/PP), LLM serving (vLLM/SGLang/TensorRT-LLM), High volume data processing, or low-latency streaming systems.
  • Comfort operating in ambiguity: you can spec, build, debug, and ship.
  • Speech/audio experience is a plus, not required.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer - Speech Platform
Senior Backend Engineer - Speech Platform

Rezo.AI • Dadri

On-site
INR 1,400,000 - 2,400,000
Founding Platform Engineer
Founding Platform Engineer

Weekday • India

On-site
INR 4,000,000 - 9,000,000
Founding Platform Engineer
Founding Platform Engineer

Weekday AI • Gurugram District

On-site
INR 4,000,000 - 7,000,000
ML Research Engineer, Speech
ML Research Engineer, Speech

Blue Machines AI • Bengaluru Urban

Hybrid
INR 900,000 - 1,300,000
ML Research Engineer, Speech
ML Research Engineer, Speech

Blue Machines AI • Bengaluru

On-site
INR 1,200,000 - 2,000,000
Founding Platform Engineer
Founding Platform Engineer

Weekday • Delhi

On-site
INR 4,000,000 - 9,000,000
ML Engineer - Speech
ML Engineer - Speech

Rezo.AI • Dadri

On-site
INR 1,200,000 - 2,400,000
Senior AI/ML Engineer
Senior AI/ML Engineer

Dolby Laboratories • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Flex Work approach
Senior ML Research Scientist, Speech
Senior ML Research Scientist, Speech

Blue Machines AI • Bengaluru Urban

Hybrid
INR 3,000,000 - 6,000,000
AI/ML Founding Engineer
AI/ML Founding Engineer

Recro • Bengaluru

On-site
INR 4,000,000 - 6,000,000