Manager, AI Engineering

Inovalon; United States; Hybrid; USD 180,000 - 240,000; Full time

Job summary

Inovalon seeks a hands-on Manager, AI Engineering to lead an established team delivering AI systems at scale. You will guide architecture, review decisions, and partner with Product, Security, Legal, and Compliance to deploy compliant AI solutions.

You will oversee end-to-end delivery, shape quarterly plans, and balance classic ML with generative approaches, ensuring reliability and measurable impact in healthcare workflows.

Qualifications

• 10+ years in software engineering, ML, or data science with leadership experience.
• 3–5 years of people management leading teams of 3–5 engineers or data scientists.
• Proven experience delivering classical ML and LLM/agentic applications into production.
• Experience with sensitive or regulated data; healthcare experience preferred.
• Strong end-to-end AI solution design and architecture ownership.

Responsibilities

• Lead and develop an established team through coaching, 1:1s, and hiring support.
• Own end-to-end engineering execution: planning, delivery quality, and incident response.
• Translate AI roadmap into quarterly plans with measurable outcomes for leadership.
• Partner with AI Product Managers to shape roadmaps and scopes.
• Guide architecture of production AI solutions including ML, LLMs, RAG, and document AI.
• Make trade-offs on accuracy, latency, cost, safety, and scalability between ML approaches.
• Review designs, code, and experiments; stay hands-on with prototypes.
• Build reusable components and platforms to scale solutions.
• Ensure compliance with security standards; collaborate on audits and risk reviews.
• Incorporate human-in-the-loop, explainability, and bias monitoring where needed.

Skills

Python

SQL

CI/CD

Docker

Kubernetes

AWS

MLflow

Observability tools

Spark

Airflow

LLMs

RAG

Document AI

Education

Bachelor’s or Master’s degree in Computer Science, AI, Data Science, Statistics, or related field

Tools

Docker

Kubernetes

AWS

MLflow

Spark

Airflow

Job description

Who We Are

Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and economics. At Inovalon, we believe that when our customers are successful in their missions, healthcare improves. Therefore, we focus on empowering them with data-driven solutions. And the momentum is building.

Together, as ONE Inovalon, we are a united force delivering solutions that address healthcare’s greatest needs. Through our mission-based culture of inclusion and innovation, our organization brings value not just to our customers, but to the millions of patients and members they serve.

Who You Are

You are a hands-on technical leader who turns AI strategy into reliable, compliant products that create measurable value for healthcare organizations. As Manager, AI Engineering, you lead and develop an established team while staying close to the technology to guide architecture, review technical decisions, and help solve complex engineering problems. You sit within the AI organization, report to the Director of AI, and partner closely with Product, Security, Legal, Compliance, and executive stakeholders to deliver production AI systems at scale.

What You'll Do

• Lead, coach, and develop an existing team of 5+ engineers through clear expectations, regular one-on-ones, structured feedback, and support for hiring and onboarding.
• Own end-to-end engineering execution, including planning, prioritization, delivery quality, team health, and production incident response.
• Translate the AI roadmap into quarterly plans with measurable outcomes and report progress, risks, and impact metrics to leadership.
• Partner with AI Product Managers to shape the roadmap, scope use cases, and determine where AI creates the most value.
• Guide the architecture of production AI solutions using classical machine learning, generative AI, LLMs, RAG, OCR and document AI, and agentic workflows.
• Make sound technical trade-offs across accuracy, latency, cost, reliability, safety, and scalability, including choosing between classical ML and generative approaches.
• Review designs, code, and experiments, and stay hands-on with prototypes and proofs of concept to unblock the most difficult problems.
• Build reusable components, reference architectures, and internal platforms that turn one-off solutions into scalable capabilities.
• Ensure AI systems comply with Inovalon security standards and applicable regulations by partnering with Security, Legal, and Compliance on auditability, readiness, and risk reviews.
• Build human-in-the-loop review, explainability, and bias monitoring into AI systems where clinical or financial decisions may be affected.

What You'll Need

• 10+ years of total experience in software engineering, machine learning, or data science, with 3–5 years of people management experience leading teams of 3–5 engineers or data scientists.
• Bachelor’s or Master’s degree in Computer Science, AI, Data Science, Statistics, or a related field, or equivalent combination of education and experience required.
• Proven experience delivering both classical ML and LLM-based or agentic applications into production, and owning the technical architecture of AI systems end to end.
• Experience working with sensitive or regulated data, with healthcare strongly preferred.
• Strong expertise in end-to‑end AI solution design, classical ML, LLMs and document AI, agentic AI, RAG pipelines, vector databases, Python, SQL, CI/CD, Docker, Kubernetes, AWS, MLflow, observability tools, and data pipelines using Spark or Airflow.
• Experience coaching, mentoring, performance management, hiring, Agile/Scrum delivery, and communicating complex AI concepts to product, clinical, compliance, and executive stakeholders.
• Demonstrate Growth Potential & Learning Agility by quickly learning new AI methods, tools, and healthcare use cases and applying that learning to improve team performance and product outcomes.
• Demonstrate Leadership by developing engineers, influencing cross‑functional partners, building strong relationships across distributed teams, and balancing hands‑on technical work with management responsibilities.
• Demonstrate Adaptability by adjusting priorities, delivery plans, and technical approaches in response to ambiguity, changing business needs, and evolving product requirements.
• Demonstrate Creative Thinking by designing practical, innovative AI solutions that solve real business problems and create measurable value.
• Demonstrate Analytical Skills by evaluating technical and business trade-offs, identifying patterns in data and system performance, and using evidence to guide architecture and delivery decisions.
• Nice to have: Experience building AI products for healthcare organizations; experience training or pre‑training LLMs, including data curation, distributed training, and domain‑specific model evaluation; knowledge of the U.S. healthcare system, including payer and provider operations, reimbursement models, and healthcare regulations; publications, patents, or open‑source contributions in AI/ML or clinical NLP.

Our Shared Commitments

• Maintain compliance with Inovalon’s policies, procedures and mission statement;
• Adhere to all confidentiality and HIPAA requirements as outlined within Inovalon’s Operating Policies and Procedures in all ways and at all times with respect to any aspect of the data handled or services rendered in the undertaking of the position; and
• Fulfill those responsibilities and/or duties that may be reasonably provided by Inovalon for the purpose of achieving operational and financial success of Employer.

Work Environment

• This is primarily a computer-based role performed in a remote, hybrid, or office environment. The role requires prolonged periods of computer use and frequent communication and interaction with others, either virtually and/or in person. The role may occasionally require transporting or moving work-related equipment weighing up to 10 pounds, such as a laptop and related materials. Some travel may be required, depending on the needs of the role. Reasonable accommodations may be provided to enable qualified individuals with disabilities to perform the essential functions of the position, consistent with applicable law.

This position is not eligible for immigration sponsorship (e.g. H-1B, TN, or E-3). Applicants must be authorized to work in the United States as a condition of employment. (This is only applicable for US‑based positions)

By embracing inclusion, we enhance our work environment and drive business success. Inovalon strives to provide equal opportunities to the communities where we operate and to our clients and everyone whom we serve. We endeavor to create a culture of inclusion in which our associates feel empowered to bring their full, authentic selves to work and pursue their professional goals in an equitable setting. We understand that by fostering this type of culture, and welcoming different perspectives, we generate innovation and growth.

Inovalon is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirement.

To review the legal requirements, including all labor law posters, please visit this link

To review the California Consumer Privacy Statement: Disclosures for California Residents, please visit this link