Staff Machine Learning Engineer

Zendesk Technologies Private Limited (India); Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Zendesk Technologies Private Limited (India) seeks a Staff Machine Learning Engineer to shape the GenAI platform architecture and strategy. You’ll lead cross‑functional efforts to standardize evaluation, observability, and orchestration for LLMs across product lines—making AI experiences safe, performant, and trustworthy for millions of end users.

As a Staff ML Engineer, you’ll define and deliver platform‑level solutions that scale across Zendesk, influence roadmaps, mentor engineering leaders,

Qualifications

• BS/BE in CS, Engineering, or related field with hands-on ML infra exposure.
• 8+ years building production-grade backend, ML infra, or platform systems.
• Experience with cloud-native infra and production ML/LLM systems.

Responsibilities

• Architect and lead cross- product GenAI platform capabilities for LLMs.
• Oversee evaluation, benchmarking, and gating of model releases.
• Define safety, tone, and evaluation standards across the stack.
• Identify failure modes and drive mitigations with ML teams.
• Ensure platform reliability, observability, and capacity planning.
• Mentor senior engineers and align roadmaps with product goals.

Skills

Distributed systems

LLMs & inference serving

Platform design

Python

Observability

Mentoring engineers

Education

Bachelor's degree in CS/Engineering or related field

Tools

Kubernetes

AWS

GCP

Azure

ML platforms

Job description

Job Description

Join us at Zendesk, where we’re on a mission to power exceptional service for every person on the planet. We’re accelerating that ambition by building products rooted in AI, automation, and intelligent customer experiences, because behind every interaction lies an opportunity to make a human connection. We’re looking for a Staff Machine Learning Engineer to shape the architecture and strategy of Zendesk’s GenAI platform. You’ll lead large, cross‑functional efforts that standardize evaluation, access, observability, and orchestration for LLMs across product lines—making AI experiences safe, performant, and trustworthy for millions of end users.

Summary

As a Staff ML Engineer, you’ll define and deliver platform‑level solutions (LLM Proxy, benchmarking, cost‑control, orchestration) that scale across Zendesk. You’ll influence product and ML roadmaps, lead complex technical projects, and mentor engineering leaders to raise the bar on AI quality and trust company‑wide.

What you’ll be doing

• Architect and lead delivery of cross‑product GenAI platform capabilities: LLM Proxy, model registry integrations, vendor abstraction, and cost/usage attribution.
• Own the design and scaling of evaluation and benchmarking frameworks (A/B, offline, continuous regression tests) used to gate model releases.
• Define company‑wide standards for safety, tone, and reasoning evaluation; drive adoption of evaluation rubrics and automated checks.
• Identify systemic failure modes across products and model families; prioritize mitigations, monitoring, and retraining strategies in partnership with ML teams.
• Drive platform reliability, observability, and capacity planning for LLM services; implement rate limiting, throttling, and SLA practices.
• Lead efforts to enable agentic workflows and safe tool use, defining integration patterns and security boundaries.
• Partner with engineering leadership, product, research, and legal/policy teams to translate risk, cost, and quality tradeoffs into platform design decisions.
• Mentor senior engineers, coordinate cross‑team roadmaps, and represent the platform in technical forums.

What you bring to the role

• 8+ years building distributed systems and ML infrastructure with a track record delivering large, cross‑team projects to production.
• Deep understanding of LLMs, inference serving patterns, vendor routing strategies, and platform design for ML workloads.
• Strong system design skills: scalable architectures, service reliability engineering, capacity planning, and cost optimization.
• Proficiency in Python (or comparable server‑side language), Kubernetes, cloud infrastructure, and observability tooling.
• Experience creating evaluation frameworks, gold‑standard datasets, and regression suites for language models.
• Excellent stakeholder skills: you can synthesize product, research, and engineering constraints into pragmatic platform solutions.
• Proven ability to lead technical strategy and mentor senior engineers to achieve broad adoption.

Basic Qualifications

• BS in Computer Science, Engineering, or related field, or equivalent practical experience.
• 8+ years industry experience in backend, platform, or ML infrastructure engineering with major production responsibilities.
• Demonstrable experience with cloud‑native infrastructure (Kubernetes, AWS/GCP/Azure) and production ML/LLM systems.
• Strong track record of building evaluation and monitoring for ML systems.

Preferred Qualifications

• Experience building model registries, feature stores, or inference platforms at scale.
• Background in agentic AI frameworks, workflow orchestration, or tool‑using models.
• Prior experience influencing company‑wide ML safety, trust, or quality frameworks.
• Advanced degree (MS/PhD) in ML/NLP or related field and/or published research in relevant areas.

Location: Pune, India (on‑site).

We note that Zendesk can only hire candidates who are physically located and plan to work from Karnataka or Maharashtra. Please refer to the location posted on the requisition for where this role is based.

Hybrid: In this role, our hybrid experience is designed at the team level to give you a rich onsite experience packed with connection, collaboration, learning, and celebration—while also giving you flexibility to work remotely for part of the week. This role must attend our local office for part of the week. The specific in‑office schedule is to be determined by the hiring manager.

The intelligent heart of customer experience Zendesk software was built to bring a sense of calm to the chaotic world of customer service. Today we power billions of conversations with brands you know and love.

Zendesk believes in offering our people a fulfilling and inclusive experience. Our hybrid way of working, enables us to purposefully come together in person, at one of our many Zendesk offices around the world, to connect, collaborate and learn whilst also giving our people the flexibility to work remotely for part of the week.

As part of our commitment to fairness and transparency, we inform all applicants that artificial intelligence (AI) or automated decision systems may be used to screen or evaluate applications for this position, in accordance with Company guidelines and applicable law.

Zendesk is an equal opportunity employer, and we’re proud of our ongoing efforts to foster global diversity, equity, & inclusion in the workplace. Individuals seeking employment and employees at Zendesk are considered without regard to race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, medical condition, ancestry, disability, military or veteran status, or any other characteristic protected by applicable law. We are an AA/EEO/Veterans/Disabled employer.

Zendesk endeavors to make reasonable accommodations for applicants with disabilities and disabled veterans pursuant to applicable federal and state law.

We are on a mission to simplify the complexity of business and make it easy for companies and customers to create connections. Our customer experience software unlocks the power of billions of interactions, enabling businesses to build rich, meaningful relationships with their customers.

What’s it like to work here? Our offices reflect the global cities we call home, and have spaces for collaboration, quiet, and events. With our hybrid approach, you’ll experience flexibility and connection, collaboration, and learning with your team.

We’re aware of an increase in recruitment scams where individuals falsely claim to represent Zendesk. These scammers may ask for money or personal information by offering fake job opportunities through e‑mail, text message or social media. Please verify the source of any job‑related communications carefully. All official Zendesk communications are conducted through "@zendesk.com" email addresses. If you encounter suspicious messages, do not respond and report them to [e-mail].