Director of Engineering — AI Platform

EduRankAI

Kolkata District

On-site

INR 5,000,000 - 9,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

EduRankAI is seeking an experienced leader to run the AI platform organization, overseeing training infrastructure, inference, evals, agents and observability. You will guide a small staff of engineers and collaborate closely with research scientists to ensure smooth handoffs from notebooks to production runs.

You will own the model lifecycle from research handoff to production release, design the inference fleet and serving stack, and set safety release bars.

Qualifications

  • Experience leading ML platform teams at scale.
  • Strong systems engineering background.
  • Experience with distributed training frameworks (DeepSpeed, Megatron).
  • Ability to liaise with researchers and translate hypotheses into experiment infrastructure.
  • Experience designing cost/per-token reporting and production handoff processes.

Responsibilities

  • Lead the AI platform team: training infra, inference, eval, agents, observability.
  • Own the model lifecycle from research handoff to production release.
  • Architect the inference fleet and serving stack (cost, latency, reliability SLOs).
  • Hire ML platform engineers — Staff, Senior, Mid.
  • Set the eval + safety release bar for every model that goes to production.
  • Liaise with research scientists weekly; turn hypotheses into experiment infrastructure.
  • Own the cost-per-token reporting that finance and the CTO depend on.

Skills

Led ML/LLM teams
Distributed training
Inference optimisation
Systems engineering
Frontier tooling

Tools

DeepSpeed
Megatron
TensorRT
vLLM
SGLang
FSDP

Job description

AI Platform Leadership

Lead the AI platform org — training infrastructure, inference, evals, agents, observability. The systems that turn research code into production model serving. Two staff-level engineers and a growing team of mid/senior ICs report to you.You will partner closely with the research scientists. The handoff between a research notebook and a production training run is where a lot of labs lose months. You will own that handoff.

Responsibilities
  • Lead the AI platform team: training infra, inference, eval, agents, observability.
  • Own the model lifecycle from research handoff to production release.
  • Architect the inference fleet and serving stack (cost, latency, reliability SLOs).
  • Hire ML platform engineers — Staff, Senior, Mid.
  • Set the eval + safety release bar for every model that goes to production.
  • Liaise with research scientists weekly; turn hypotheses into experiment infrastructure.
  • Own the cost-per-token reporting that finance and the CTO depend on.
Skills
  • Led ML/LLM platform teams at scale
  • Distributed training (FSDP / DeepSpeed / Megatron)
  • Inference optimisation (vLLM / TensorRT-LLM / SGLang)
  • Strong systems engineering
  • Familiar with frontier-lab tooling
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI-ML Engineer
AI-ML Engineer

KanthamAi • Mumbai

On-site
INR 2,000,000 - 3,000,000
Senior AI Platform Engineer
Senior AI Platform Engineer

AryaXAI • Bengaluru

On-site
INR 4,000,000 - 6,500,000
Senior Engineer - AI Platform
Senior Engineer - AI Platform

NetConnectGlobal • Bengaluru

On-site
INR 4,200,000 - 6,000,000
Senior Artificial Intelligence Engineer
Senior Artificial Intelligence Engineer

Yotta Data Services Private Limited • Mumbai

On-site
INR 4,000,000 - 7,000,000
AI Platform Admin Lead
AI Platform Admin Lead

Cirruslabs • Hyderabad, Pune District, Bengaluru

On-site
INR 4,000,000 - 7,000,000
Senior AI Engineer
Senior AI Engineer

InfraCents Pvt. Ltd. • India

Remote
INR 2,500,000 - 5,500,000
Principal Machine Learning Engineer
Principal Machine Learning Engineer

SourcingXPress • Hyderabad

On-site
INR 1,906,577 - 2,859,866
AI Platform Admin ( Anthropic Claude, or Google Gemini)
AI Platform Admin ( Anthropic Claude, or Google Gemini)

CirrusLabs • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Sr Engineer - Ad Tech
Sr Engineer - Ad Tech

Target • Bengaluru

On-site
INR 2,600,000 - 4,200,000
Senior AI Engineer - Agentic AI & Knowledge Systems
Senior AI Engineer - Agentic AI & Knowledge Systems

Ontio AI • Pune District

On-site
INR 3,000,000 - 5,000,000