Senior ML Engineer

IDfy; Mumbai; On-site; INR 2,500,000 - 6,000,000; Full time

Job summary

IDfy in Mumbai is seeking a senior ML engineer to own end-to-end model development, from framing the problem to deployment and monitoring. You will ensure production-grade quality, design robust evaluations, and optimize inference to meet latency and cost targets.

Join a team that values rigorous math, reproducibility, and scalable ML systems across real-world verification workloads in a fast-moving environment.

Qualifications

• Proven model-training experience with deep learning models.
• Experience shipping models into production at scale.
• Strong mathematical foundations for ML systems.

Responsibilities

• Frame business requirements into well-posed ML objectives.
• Train models end-to-end, from data strategy to deployment and monitoring.
• Design rigorous evaluation and calibrate for production explainability.
• Optimize inference for latency, throughput, and cost.
• Mentor junior engineers on math-driven problem solving.

Skills

Prob & Statistics

Optimization

Linear Algebra

PyTorch

ML Systems

Tools

PyTorch

Kubernetes

OpenVINO

Triton

vLLM

Job description

The Production Footprint

• 2000 requests per second at peak
• 25 TB of serving RAM
• ~18,000 CPUs
• 120 NVIDIA L4 GPUs
• 2M+ verifications per day

At this scale, cost-to-serve is a first-class engineering constraint. A model that is 2 percentage points more accurate but 10x more expensive to run may be the wrong model. You will own that tradeoff with numbers, not opinions.

What you will do

Frame ambiguous problems mathematically. Turn a business requirement like "catch deepfakes in KYC" into a well-posed objective: the right positive class, the right operating point, the right validation protocol that does not leak, and a metric that survives class-prevalence shift.

Train models, end to end. Own the full lifecycle for one or more model families: problem framing, data strategy, architecture choice, training, evaluation, deployment, monitoring, and retraining. You are accountable for the model in production, not just the notebook.

Evaluate with rigor. Design evaluation that predicts production behavior. Confusion matrices, ROC and PR curves, TPR at a fixed low FPR, calibration error, and cross-distribution generalization. Know why AUC can lie about a model you operate at FPR = 1e-4.

Optimize for inference at scale. Quantize, prune, and re-architect models so they serve within latency, throughput, and cost budgets. Move workloads off GPU to quantized CPU inference where the numbers justify it, and prove the accuracy held with a production canary before, not after. Deploy and operate resilient production systems that run 24x7

Reproduce and improve on research. Read a paper, reproduce its results, strip it down to what actually matters for our constraints, and ship it. We value simplification that preserves accuracy. A smaller, cheaper model that matches a heavier one is treated as a genuine result here, not a compromise.

Lead. Mentor 3 to 6 junior engineers on math-driven problem solving, experiment design, and ML systems. Set the bar for source discipline and reproducibility. Review models, not just code.

What you bring

ML fundamentals, deeply held.

• Probability and statistics: distributions, estimation, hypothesis testing, class prevalence and its effect on precision, sampling.
• Optimization: gradient descent and its variants, loss landscapes, convergence behavior, why training diverges and how to fix it.
• Linear algebra: enough to reason about embeddings, projections, and what a layer is actually computing.
• You can derive, not just import. If asked why a loss is shaped the way it is, or what changes when you quantize a layer to INT8, you can work it out on a whiteboard.

Proven model-training experience.

• You have trained deep learning models from scratch and fine-tuned pretrained networks, in PyTorch. Training loops, data pipelines, augmentation, and loss design are things you have written, not things you have called.
• Depth in at least one of Computer Vision (detection, classification, metric or embedding learning, anti-spoofing) or NLP (sequence labeling, NER, transformer models), with working literacy in the other.
• You have shipped at least two models into production, operated them at some scale and kept them healthy through drift and adversarial pressure.

Evaluation and calibration.

• You design evaluations that do not overstate performance: leakage-free splits, cross-generator or cross-source generalization tests, and operating points chosen for the real cost asymmetry.
• You understand calibration and can reason about decision thresholds under changing prevalence.

Production ML at scale.

• 4+ years building and operating large-scale ML systems: real-time inference, monitoring, drift detection, and retraining.
• Inference optimization: quantization (INT8, BF16), and hands-on with at least one of OpenVINO, CTranslate2, Triton, or vLLM. You reason about latency, throughput, and cost-to-serve as engineering targets.
• Comfortable on Kubernetes and a major cloud (we run primarily on GCP and AWS).

Working with LLMs, the right way.

• If you work with LLMs, you work with the model, not only the API: fine-tuning, embedding geometry, retrieval statistics, and transformer internals. You can build a RAG system and also explain why the retriever is failing at the embedding level.

What makes you stand out

• Face recognition, liveness, or presentation-attack and deepfake detection experience.
• Metric learning and large-scale vector search (millions of vectors and up).
• OCR, document forensics, or tampering detection on real-world degraded documents.
• Contributions to open-source ML, published papers, or teaching and speaking in the community.
• Familiarity with Indian regulatory context: DPDP, RBI KYC modes, UIDAI, PCI DSS.

Why this role is rare

Most "AI" roles today are integration roles: call a hosted model, shape a prompt, ship. This is not that. Here you build the models that have real world impact on 2 million people a day, in an adversarial setting where accuracy and cost both have real consequences. You get production traffic at 2000 RPS, a fleet of 40+ models to learn from, and a mandate to make them faster, better and cheaper.

This is a place for people who are still excited by the math.

Job Location: Mumbai, Pune.