Principal AI/ML Engineer

Optum

Hyderabad

On-site

INR 3,000,000 - 7,000,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Optum Hyderabad is seeking an experienced software engineer to design, build and operate the AI platform and agent runtime, from design reviews to production support. You will shape APIs, SDKs, schemas, and versions; implement MCP servers, tool interfaces with proper contracts and auth; and ensure scalability, security and cost efficiency at scale.

The role involves delivering end-to-end platform capabilities, CI/CD, and collaborating with Azure/Databricks partners while focusing on healthcare

Qualifications

  • Bachelor's degree in computer science, engineering or a related technical field, or equivalent experience
  • 10+ years of professional software engineering experience building and operating production systems
  • 5+ years of experience designing distributed services and platform-level APIs consumed by other engineering teams
  • Hands-on experience with LLM-based or agentic systems, including retrieval-augmented generation, tool and function calling, and orchestration
  • Expert-level proficiency in Python and at least one additional production language such as Java, TypeScript, Scala or C++
  • Demonstrated depth in software engineering fundamentals: testing strategy, debugging complex production issues, performance profiling, code review and technical documentation
  • Experience with cloud-native delivery, including containers and Kubernetes, CI/CD, infrastructure as code, and observability tooling
  • Experience with large-scale computing frameworks and distributed data processing such as Spark/Databricks, Ray, Kafka or equivalent
  • Experience building software subject to security, privacy or regulatory constraints
  • Demonstrated ability to explain complex technical results and trade-offs clearly to non-technical stakeholders and senior leaders

Responsibilities

  • Design, code, test, debug, document and maintain the services that make up the AI platform and agent runtime
  • Design the public surface of the platform - APIs, SDKs, client libraries, schemas and versioning strategy
  • Build the Capability Gateway: implement MCP servers and tool interfaces with contracts, auth, input/output validation, quota and rate limiting
  • Build and operate the agent harness and runtime: orchestration, state management, retrieval paths, retries, timeouts and degradation
  • Establish engineering standards, methods and tooling for the portfolio including CI/CD pipelines and IaC
  • Engineer the platform for cost and scale, including inference routing, caching, batching and per-tenant telemetry
  • Code and deploy the ML/LLM components: model serving, embedding pipelines and deployment canary/shadow/rollback
  • Implement AI/ML capabilities for healthcare workflows including NLP, semantic search, extraction and document AI
  • Build evaluation/experimentation infrastructure with datasets, evals and regression gates
  • Work with large-scale computing frameworks and data analysis systems for data foundation
  • Engineer for PHI: data minimization, de-identification, encryption, access controls
  • Evaluate new tools/strategies with rigorous trade-offs and brief leadership
  • Partner across Platform Enablement, product management, security, privacy and external partners
  • Raise engineering bar through reference implementations and mentorship
  • Comply with company policies and flexible work arrangements

Skills

Python
Java
TypeScript
Scala
C++
Distributed systems design
Debug production issues
Tech communication

Education

Bachelor's degree in computer science or related field

Tools

Kubernetes
Spark/Databricks
Kafka
CI/CD
Infrastructure as code

Job description

Primary Responsibilities
  • Design, code, test, debug, document and maintain the services that make up the AI platform and agent runtime, taking systems from design review through production operation and long-term support
  • Design the public surface of the platform - APIs, SDKs, client libraries, schemas and versioning strategy - so that internal teams, client engineering teams and external builders can integrate without bespoke work for each consumer
  • Build the Capability Gateway: implement Model Context Protocol (MCP) servers and tool interfaces with typed contracts, authentication and authorization, input and output validation, quota and rate limiting, audit logging, and an automated conformance test suite that new capabilities must pass
  • Build and operate the agent harness and runtime: orchestration and tool-calling execution, state and session management, retrieval paths, concurrency, queuing and retries, timeout and failure handling, idempotency, and graceful degradation under partial outage
  • Establish engineering standards, methods and tooling for the portfolio: coding standards, code review practice, branching and release strategy, CI/CD pipelines, infrastructure as code, environment management, and automated testing at unit, contract, integration and end-to-end levels
  • Engineer the platform for cost and scale, including inference routing across models, caching, batching, connection and resource pooling, capacity planning, and per-tenant cost telemetry that ties spend to completed work
  • Code and deploy the ML and LLM components of the platform into production: model and prompt serving, retrieval and embedding pipelines, adapters and fine-tuned variants, and the deployment mechanics behind them including canary, shadow and rollback paths
  • Implement AI/ML capabilities in support of healthcare workflows, which may include natural language processing and understanding, semantic search, intent classification, information extraction, document AI and computer vision, and automatic speech recognition applied to clinical notes, claims, faxes, referrals, prior authorizations and recorded encounters
  • Build the evaluation and experimentation infrastructure the platform depends on: golden datasets, task-level benchmarks, offline and online evals, human-in-the-loop review workflows, regression gates wired into CI, and experiment tooling with defensible statistical treatment of results
  • Work with large-scale computing frameworks and data analysis systems to build the data foundation behind agent capabilities, including distributed processing, feature and vector stores, streaming ingestion, schema evolution and lineage
  • Engineer for PHI from the first commit: data minimization and de-identification, tenant isolation, encryption in transit and at rest, secrets management, retention and access controls, and enforcement that keeps agent behavior inside approved data and action boundaries
  • Evaluate new tools, techniques and strategies - models, frameworks, orchestration approaches, serving stacks - with enough rigor to make a build, buy or adopt recommendation, and communicate the results and trade-offs to leadership and internal stakeholders
  • Partner across Platform Enablement, product management, design, security, privacy and legal, forward-deployed engineering, operations and external partners such as Azure and Databricks on one integrated backlog with explicit interfaces and SLOs
  • Raise the engineering bar through reference implementations, reusable libraries, design review participation, code review and technical mentorship, and influence thought and leadership on where the platform should go next
  • Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements

You will be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Required Qualifications
  • Bachelor's degree in computer science, engineering or a related technical field, or equivalent experience
  • 10+ years of professional software engineering experience building and operating production systems
  • 5+ years of experience designing distributed services and platform-level APIs consumed by other engineering teams
  • Hands-on experience with LLM-based or agentic systems, including retrieval-augmented generation, tool and function calling, and orchestration
  • Expert-level proficiency in Python and at least one additional production language such as Java, TypeScript, Scala or C++
  • Demonstrated depth in software engineering fundamentals: testing strategy, debugging complex production issues, performance profiling, code review and technical documentation
  • Experience with cloud-native delivery, including containers and Kubernetes, CI/CD, infrastructure as code, and observability tooling
  • Experience with large-scale computing frameworks and distributed data processing such as Spark/Databricks, Ray, Kafka or equivalent
  • Experience building software subject to security, privacy or regulatory constraints
  • Demonstrated ability to explain complex technical results and trade-offs clearly to non-technical stakeholders and senior leaders
Preferred Qualifications
  • Experience building multi-tenant platforms or services, including tenant isolation, quota and entitlement enforcement, and developer experience as an explicit product concern
  • Experience implementing or operating Model Context Protocol (MCP) servers, tool-calling standards, or agent frameworks such as LangGraph or equivalent
  • Experience with vector databases, embedding lifecycle management, hybrid retrieval and enterprise knowledge graphs
  • Experience with inference cost management or FinOps for AI workloads
  • Experience with responsible AI practice, including bias and fairness evaluation, model risk management, model documentation, or alignment to frameworks such as the NIST AI Risk Management Framework
  • Experience on a 0-to-1 product or platform, working directly with design partners or customers to shape what gets built
  • Experience with Azure AI services and Databricks in a regulated enterprise environment
  • Health care industry experience including provider, payer, medical device, pharmaceutical, or other health services a plus
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI/ML Engineer
Principal AI/ML Engineer

UnitedHealth Group • Hyderabad

On-site
INR 4,000,000 - 8,000,000
Principal AI/ML Engineer
Principal AI/ML Engineer

Optum India • Hyderabad

On-site
INR 400,000 - 750,000
Principal AI/ML Engineer
Principal AI/ML Engineer

Optum • Bengaluru

On-site
INR 4,000,000 - 9,000,000
Principal Software Engineer
Principal Software Engineer

Amgen Technology • Hyderabad

On-site
INR 3,500,000 - 7,500,000
Lead AI Engineer
Lead AI Engineer

FINVASIA CAREER • Nagar

On-site
INR 1,500,000 - 2,100,000
Tech Lead
Tech Lead

Latentbridge • Pune District

On-site
INR 350,000 - 800,000
Technical Architect
Technical Architect

Bacancy Technology • Ahmedabad District

Hybrid
INR 4,000,000 - 7,000,000
Staff Engineer - AI Platform
Staff Engineer - AI Platform

Highlevel Llc • New Delhi

On-site
INR 4,500,000 - 7,500,000
Senior AI Engineer
Senior AI Engineer

H130 MetLife Investment Management Taiwan Limited • Panaji

On-site
INR 1,800,000 - 2,400,000
Lead AI Engineer
Lead AI Engineer

Bridge Global • Ernakulam

On-site
INR 3,000,000 - 5,200,000