Lead AI Engineer — Enterprise GenAI & Agent Solutions (Azure)

Mphasis

New York (NY)

On-site

USD 63,000 - 135,000

Full time

3 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mphasis seeks a hands-on Lead AI Engineer with 10+ years of software, data or ML engineering experience to guide enterprise AI delivery on Microsoft Azure and Azure Databricks for Insurance and Benefits Management.

You will design and deliver secure, governed generative AI, retrieval-augmented generation, and agent-based solutions, oversee architecture, lead reviews, and mentor engineers across teams with emphasis on compliance, scalability, and cost efficiency.

Qualifications

  • 10+ years of software, data, analytics or machine-learning engineering experience, including leadership of complex AI workstreams.
  • Proven experience designing and delivering production-grade AI assistants, conversational AI, RAG and agent-based solutions in enterprise environments.
  • Strong hands-on experience with Azure, Databricks, Python, APIs, vector retrieval, evaluation and AI observability.
  • Experience defining non-functional requirements for security, scalability, resilience, latency, cost and auditability.
  • Experience leading distributed teams, stakeholder workshops, technical reviews and production readiness activities.
  • Bachelor’s or master’s degree in Computer Science, AI, Data Science or a related discipline; Azure or Databricks certification is preferred.

Responsibilities

  • Lead AI solution architecture, detailed design and engineering standards for generative AI, RAG, agents and machine-learning services.
  • Design agent orchestration, routing, tools and workflow patterns using Azure AI Foundry and Databricks agent capabilities.
  • Design and build enterprise AI assistants using conversation orchestration, session context, tool calling, document and structured-data retrieval, vector and semantic search, citations, guardrails and abstention patterns.
  • Integrate approved LLM and embedding endpoints through governed AI gateways and enterprise APIs.
  • Develop assistant prompts, system instructions, conversation flows, tools, AI functions, APIs and reusable components using Python, SQL and modern AI frameworks.
  • Create golden conversation datasets and automated tests for assistant task completion, grounding, factuality, retrieval quality, safety, role isolation, latency and cost.
  • Implement MLflow experiment tracking, prompt/model/agent versioning, tracing, evaluation and release evidence.
  • Apply tenant and role isolation, managed identities, secrets management, prompt-injection defenses, auditability and human approval controls.
  • Operationalize AI services with CI/CD, monitoring, token and cost telemetry, failure handling, rollback and production support.
  • Lead code and design reviews, mentor AI engineers and collaborate with architecture, data, product, security, QA and DevOps teams.

Skills

Python
SQL
LLM engineering
Azure Databricks
AI agents
RAG
security governance

Education

Bachelor’s or Master’s degree in CS/AI/Data Science

Tools

Azure Databricks
Azure OpenAI / LLM API
MLflow
REST APIs
Docker
Kubernetes

Job description

Mphasis seeks a hands-on Lead AI Engineer with 10+ years of software, data or ML engineering experience to guide enterprise AI delivery on Microsoft Azure and Azure Databricks for Insurance and Benefits Management.

You will design and deliver secure, governed generative AI, retrieval-augmented generation, and agent-based solutions, oversee architecture, lead reviews, and mentor engineers across teams with emphasis on compliance, scalability, and cost efficiency.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Delivery Module Lead
Delivery Module Lead

Mphasis • New York (NY)

On-site
USD 63,000 - 135,000
AI/ML Engineering Lead: GenAI & Production ML on Azure
AI/ML Engineering Lead: GenAI & Production ML on Azure

Protective Life • United States

On-site
USD 125,000 - 180,000
Health insurance
Dental and vision insurance
401(k) with company match
+4
AI/ML Engineering Lead — GenAI, Azure & MLOps
AI/ML Engineering Lead — GenAI, Azure & MLOps

Protective Life • Nebraska

On-site
USD 125,000 - 180,000
Health insurance
401(k) with company matching
Paid time off
AI/ML Engineering Lead — GenAI & Production ML on Azure
AI/ML Engineering Lead — GenAI & Production ML on Azure

Protective Life • Birmingham (AL)

On-site
USD 125,000 - 180,000
Health insurance
401(k) with company match
Paid time off
Lead AI Architect for Enterprise Solutions
Lead AI Architect for Enterprise Solutions

Genpact • New York (NY)

Hybrid
USD 100,000 - 125,000
Remote Lead AI Engineer (Agentic & Generative AI)
Remote Lead AI Engineer (Agentic & Generative AI)

Highbrow LLC • United States

Remote
USD 150,000 - 190,000
AI / GenAI Architect / Sr. Lead (Contract)
AI / GenAI Architect / Sr. Lead (Contract)

TechDigital Group • Massachusetts

Hybrid
USD 150,000 - 210,000
AI/ML Engineering Lead — GenAI, MLOps on Azure
AI/ML Engineering Lead — GenAI, MLOps on Azure

Protective • Nebraska

Hybrid
USD 125,000 - 180,000
Health insurance
Dental insurance
Vision insurance
+2
Senior AI Solutions Engineer: Azure & GenAI
Senior AI Solutions Engineer: Azure & GenAI

Delphi Consulting • United States

Remote
USD 150,000 - 230,000
AI Engineer
AI Engineer

Madison-Davis • United States

Remote
USD 120,000 - 180,000