AI Engineering Leader for Production Systems

Inovalon, Inc.; United States; Hybrid; USD 170,000 - 230,000; Full time

Job summary

Inovalon is seeking a hands-on Manager of AI Engineering to lead a 5+ person team and deliver scalable AI solutions for healthcare. You will guide architecture, drive end-to-end execution, and partner with Product, Security, Legal, and Compliance to ensure compliant, production-ready AI systems.

Responsibilities include translating roadmaps into quarterly plans, shaping AI use cases with Product Managers, and balancing speed with reliability, safety, and cost.

Qualifications

• 10+ years in software engineering, ML, or data science with 3–5 years of people management leading teams of 3–5 engineers or scientists.
• Bachelor's or Master's in CS, AI, Data Science, Statistics, or related field, or equivalent experience.
• Proven experience delivering classical ML and LLM-based or agentic applications to production and owning end-to-end AI architecture.
• Experience with sensitive or regulated healthcare data preferred.
• Strong expertise in end-to-end AI solution design, ML, LLMs, document AI, RAG, vector databases, Python, SQL, CI/CD, Docker, Kubernetes, AWS, MLflow, observability tools, Spark or Airflow.

Responsibilities

• Lead and develop an existing team of 5+ engineers with clear expectations and structured feedback.
• Own end-to-end engineering execution including planning, prioritization, delivery quality, and incident response.
• Translate AI roadmap into quarterly plans with measurable outcomes and report progress to leadership.
• Collaborate with AI Product Managers to shape the roadmap and use cases.
• Guide architecture of production AI solutions using ML, LLMs, RAG, OCR, and document AI.
• Balance trade-offs on accuracy, latency, cost, safety, and scalability between classical ML and generative approaches.
• Review designs, code, and experiments; stay hands-on with prototypes to unblock challenges.
• Build reusable components, reference architectures, and internal platforms for scalable capabilities.
• Ensure AI systems comply with security standards and regulations through Security, Legal, and Compliance.
• Incorporate human-in-the-loop, explainability, and bias monitoring for decisions.

Skills

Leadership

Strategy & roadmap

Communication

Analytical thinking

Mentoring

Education

Bachelor's in CS/AI/Data Science

Master's in CS/AI/Data Science

Tools

Python

SQL

CI/CD

Docker

Kubernetes

AWS

MLflow

Spark

Airflow

Vector databases

RAG

OCR

Document AI

Job description

Inovalon is seeking a hands-on Manager of AI Engineering to lead a 5+ person team and deliver scalable AI solutions for healthcare. You will guide architecture, drive end-to-end execution, and partner with Product, Security, Legal, and Compliance to ensure compliant, production-ready AI systems.

Responsibilities include translating roadmaps into quarterly plans, shaping AI use cases with Product Managers, and balancing speed with reliability, safety, and cost.