Manager, AI Engineering

Inovalon, Inc.; United States; Hybrid; USD 170,000 - 230,000; Full time

Job summary

Inovalon is seeking a hands-on Manager of AI Engineering to lead a 5+ person team and deliver scalable AI solutions for healthcare. You will guide architecture, drive end-to-end execution, and partner with Product, Security, Legal, and Compliance to ensure compliant, production-ready AI systems.

Responsibilities include translating roadmaps into quarterly plans, shaping AI use cases with Product Managers, and balancing speed with reliability, safety, and cost.

Qualifications

• 10+ years in software engineering, ML, or data science with 3–5 years of people management leading teams of 3–5 engineers or scientists.
• Bachelor's or Master's in CS, AI, Data Science, Statistics, or related field, or equivalent experience.
• Proven experience delivering classical ML and LLM-based or agentic applications to production and owning end-to-end AI architecture.
• Experience with sensitive or regulated healthcare data preferred.
• Strong expertise in end-to-end AI solution design, ML, LLMs, document AI, RAG, vector databases, Python, SQL, CI/CD, Docker, Kubernetes, AWS, MLflow, observability tools, Spark or Airflow.

Responsibilities

• Lead and develop an existing team of 5+ engineers with clear expectations and structured feedback.
• Own end-to-end engineering execution including planning, prioritization, delivery quality, and incident response.
• Translate AI roadmap into quarterly plans with measurable outcomes and report progress to leadership.
• Collaborate with AI Product Managers to shape the roadmap and use cases.
• Guide architecture of production AI solutions using ML, LLMs, RAG, OCR, and document AI.
• Balance trade-offs on accuracy, latency, cost, safety, and scalability between classical ML and generative approaches.
• Review designs, code, and experiments; stay hands-on with prototypes to unblock challenges.
• Build reusable components, reference architectures, and internal platforms for scalable capabilities.
• Ensure AI systems comply with security standards and regulations through Security, Legal, and Compliance.
• Incorporate human-in-the-loop, explainability, and bias monitoring for decisions.

Skills

Leadership

Strategy & roadmap

Communication

Analytical thinking

Mentoring

Education

Bachelor's in CS/AI/Data Science

Master's in CS/AI/Data Science

Tools

Python

SQL

CI/CD

Docker

Kubernetes

AWS

MLflow

Spark

Airflow

Vector databases

RAG

OCR

Document AI

Job description

Who We Are

Inovalon was founded in 1998 on the belief that technology, and data specifically, would empower the transformation of the entire healthcare ecosystem for the better, improving both outcomes and economics. At Inovalon, we believe that when our customers are successful in their missions, healthcare improves. Therefore, we focus on empowering them with data-driven solutions. And the momentum is building.

Together, as ONE Inovalon, we are a united force delivering solutions that address healthcare's greatest needs. Through our mission-based culture of inclusion and innovation, our organization brings value not just to our customers, but to the millions of patients and members they serve.

Who You Are

You are a hands-on technical leader who turns AI strategy into reliable, compliant products that create measurable value for healthcare organizations. As Manager, AI Engineering, you lead and develop an established team while staying close to the technology to guide architecture, review technical decisions, and help solve complex engineering problems. You sit within the AI organization, report to the Director of AI, and partner closely with Product, Security, Legal, Compliance, and executive stakeholders to deliver production AI systems at scale.

What You'll Do

• Lead, coach, and develop an existing team of 5+ engineers through clear expectations, regular one-on-ones, structured feedback, and support for hiring and onboarding.
• Own end-to-end engineering execution, including planning, prioritization, delivery quality, team health, and production incident response.
• Translate the AI roadmap into quarterly plans with measurable outcomes and report progress, risks, and impact metrics to leadership.
• Partner with AI Product Managers to shape the roadmap, scope use cases, and determine where AI creates the most value.
• Guide the architecture of production AI solutions using classical machine learning, generative AI, LLMs, RAG, OCR and document AI, and agentic workflows.
• Make sound technical trade-offs across accuracy, latency, cost, reliability, safety, and scalability, including choosing between classical ML and generative approaches.
• Review designs, code, and experiments, and stay hands-on with prototypes and proofs of concept to unblock the most difficult problems.
• Build reusable components, reference architectures, and internal platforms that turn one-off solutions into scalable capabilities.
• Ensure AI systems comply with Inovalon security standards and applicable regulations by partnering with Security, Legal, and Compliance on auditability, readiness, and risk reviews.
• Build human-in-the-loop review, explainability, and bias monitoring into AI systems where clinical or financial decisions may be affected.

What You'll Need

• 10+ years of total experience in software engineering, machine learning, or data science, with 3-5 years of people management experience leading teams of 3-5 engineers or data scientists.
• Bachelor's or Master's degree in Computer Science, AI, Data Science, Statistics, or a related field, or equivalent combination of education and experience required.
• Proven experience delivering both classical ML and LLM-based or agentic applications into production, and owning the technical architecture of AI systems end to end.
• Experience working with sensitive or regulated data, with healthcare strongly preferred.
• Strong expertise in end-to-end AI solution design, classical ML, LLMs and document AI, agentic AI, RAG pipelines, vector databases, Python, SQL, CI/CD, Docker, Kubernetes, AWS, MLflow, observability tools, and data pipelines using Spark or Airflow.
• Experience coaching, mentoring, performance management, hiring, Agile/Scrum delivery, and communicating complex AI concepts to product, clinical, compliance, and executive stakeholders.
• Demonstrate Growth Potential & Learning Agility by quickly learning new AI methods, tools, and healthcare use cases and applying that learning to improve team performance and product outcomes.
• Demonstrate Leadership by developing engineers, influencing cross-functional partners, building strong relationships across distributed teams, and balancing hands-on technical work with management responsibilities.
• Demonstrate Adaptability by adjusting priorities, delivery plans, and technical approaches in response to ambiguity, changing business needs, and evolving product requirements.
• Demonstrate Creative Thinking by designing practical, innovative AI solutions that solve real business problems and create measurable value.
• Demonstrate Analytical Skills by evaluating technical and business trade-offs, identifying patterns in data and system performance, and using evidence to guide architecture and delivery decisions.
• Nice to have: Experience building AI products for healthcare organizations; experience training or pre-training LLMs, including data curation, distributed training, and domain-specific model evaluation; knowledge of the U.S. healthcare system, including payer and provider operations, reimbursement models, and healthcare regulations; publications, patents, or open-source contributions in AI/ML or clinical NLP.

Our Shared Commitments

• Maintain compliance with Inovalon's policies, procedures and mission statement;
• Adhere to all confidentiality and HIPAA requirements as outlined within Inovalon's Operating Policies and Procedures in all ways and at all times with respect to any aspect of the data handled or services rendered in the undertaking of the position; and
• Fulfill those responsibilities and/or duties that may be reasonably provided by Inovalon for the purpose of achieving operational and financial success of Employer.

Work Environment

• This is primarily a computer-based role performed in a remote, hybrid, or office environment. The role requires prolonged periods of computer use and frequent communication and interaction with others, either virtually and/or in person. The role may occasionally require transporting or moving work-related equipment weighing up to 10 pounds, such as a laptop and related materials. Some travel may be required, depending on the needs of the role. Reasonable accommodations may be provided to enable qualified individuals with disabilities to perform the essential functions of the position, consistent with applicable law.

This position is not eligible for immigration sponsorship (e.g. H-1B, TN, or E-3). Applicants must be authorized to work in the United States as a condition of employment. (This is only applicable for US-based positions)

If you don't meet every qualification listed but are excited about our mission and the work described, we encourage you to apply. Inovalon is most interested in finding the best candidate for the job, and you may be just the right person for this or other roles.

By embracing inclusion, we enhance our work environment and drive business success. Inovalon strives to provide equal opportunities to the communities where we operate and to our clients and everyone whom we serve. We endeavor to create a culture of inclusion in which our associates feel empowered to bring their full, authentic selves to work and pursue their professional goals in an equitable setting. We understand that by fostering this type of culture, and welcoming different perspectives, we generate innovation and growth.

Inovalon is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirement.

To review the legal requirements, including all labor law posters, please visit this link

To review the California Consumer Privacy Statement: Disclosures for California Residents, please visit this link

Work Location: If the US position is listed as remote, employees who reside within a 40-mile radius of one of our office locations in Tampa, FL; Canonsburg, PA; or Bowie, MD will follow a hybrid work schedule and are expected to work in the office two days per week (Tuesdays and Wednesdays).