Director, AI Platform Engineering

NYC Health + Hospitals; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

NYC Health + Hospitals seeks a Director of AI Platform Engineering to lead cloud, platform, and deployment infrastructure enabling clinical AI across the system. You will drive scalable AI deployments with secure, compliant operations and oversee multi‑disciplinary teams of platform and infrastructure engineers.

Responsibilities include shaping roadmaps for secure AI, managing CI/CD and AKS orchestration, and ensuring reliability, observability, and governance across AI products for safe patient

Qualifications

• Master’s degree in a relevant field with multi‑year healthcare IT/security experience, or
• Bachelor’s degree with extensive experience and management background in health IT

Responsibilities

• Provides strategic leadership for cloud, platform, and infrastructure engineering across AI products.
• Oversees CI/CD pipelines, infrastructure‑as‑code, and AKS orchestration for reliable AI deployment.
• Defines infrastructure for data pipelines, feature stores, and data access for training and serving AI models.
• Establishes reliability and monitoring frameworks for safe operation of AI systems.
• Implements platform controls and audit trails for Responsible AI, XAI, drift and bias checks.
• Partners with product, cybersecurity, MLOps, and interoperability teams for AI platform readiness.
• Leads incident management and root‑cause analysis to minimize clinical workflow disruptions.
• Ensures controls, logging, and audit capabilities meet compliance and safety standards.
• Develops resilience, disaster recovery, and cost optimization for system‑wide AI expansion.
• Standardizes the toolchain and APIs for ML lifecycle, including model tracking and testing.
• Manages a team of platform and infrastructure engineers.
• Performs other duties as assigned.

Education

Master’s Degree (CS/IS/Tech/HIT)

Bachelor’s Degree (CS/Engineering/IS)

Tools

AKS

Terraform

CI/CD (Azure DevOps, GitHub Actions, Jenkins)

Grafana / Azure Monitor

Docker

IAM / Secrets tooling

Job description

The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment infrastructure supporting Artificial Intelligence (AI) across the System. This role ensures AI systems used in clinical workflows operate safely, reliably, securely, and are in compliance with applicable laws and NYC Health + Hospitals rules and regulations. The Director leads platform engineering, cloud architecture, Continuous Integration and Continuous Delivery/Deployment (CI/CD) modernization, and reliability functions ensuring that AI tools enhance clinical excellence and protect patient safety.

Essential Duties and Responsibilities:

1. Provides strategic leadership for cloud, platform, and infrastructure engineering, developing and leading multi-year roadmaps, standards, and strategies for the secure and scalable deployment of AI products.

2. Oversees architecture and governance of CI/CD pipelines, infrastructure‑as‑code (Terraform), and Kubernetes/Azure Kubernetes Services (AKS) orchestration to support reliable AI deployment.

3. Defines and oversee the infrastructure for the high-volume, low-latency data pipelines, feature stores, and data access layers required for training and real-time serving of AI models.

4. Establishes enterprise-wide reliability, and monitoring frameworks to ensure stable, and safe operation of AI systems used by clinicians and care teams.

5. Implements platform controls and audit trails to monitor and ensure Responsible AI practices, model explainability (XAI), and checks for model drift and bias on an ongoing basis.

6. Partners with product management, product development, cybersecurity, Machine Learning Operations (MLOps) engineering, and interoperability teams to ensure AI platform readiness, safe integrations.

7. Leads incident management and root‑cause analysis, to minimize disruptions to clinical workflows and drive reliability improvements.

8. Ensures the AI platform and infrastructure provide the necessary controls, logging, and audit capabilities to meet compliance requirements and support AI safety frameworks.

9. Develops long‑term platform resilience, disaster recovery, and cost optimization strategies to support System‑wide AI expansion.

10. Defines and standardizes the platform's toolchain and Application Programming Interface (API) for the Machine Learning (ML) lifecycle, including model experimentation tracking (e.g., MLflow, ClearML), model registry, and automated testing/validation frameworks.

11. Manages a team of platform and infrastructure engineers.

12. Performs other duties as assigned.

1. Master's Degree from an accredited college or university in Computer Science, Information Systems or Technology, Cybersecurity, Hospital Administration, Health Care Planning, Business Administration, Mathematics, Engineering or Public Administration; and three (3) years of progressively responsible experience in health care information security, multifaced information technology, health and medical service administration, public administration, or a related discipline with an emphasis on systems programming, systems engineering, software developing, or providing technical support as a specialist; two (2) years of which must have been in a related administrative, managerial or supervisory capacity; or,

2. Bachelor’s Degree from an accredited college or university in disciplines, as listed in “1” above; and five (5) years of progressively responsible experience in health care information security, multifaced information technology, health and medical service administration, public administration, or a related discipline with an emphasis on systems programming, systems engineering, software developing, or providing technical support as a specialist; two (2) years of which must have been in a related administrative, managerial or supervisory capacity.

Minimum Qualifications:

1. Master’s degree from an accredited college or university in Computer science, Engineering, Information Systems, or related discipline; and,

2. Five (5) years of experience in Machine Learning Operations (MLOps), Machine Learning (ML) engineering, Artificial Intelligence (AI) platform engineering, or operating production Machine Learning (ML) / Large Language Model (LLM) system; or ten (10) years of experience in Software and Data Engineering.

Certifications Preferred:

1. Professional certifications in cloud architecture, ML/AI engineering, or DevOps from leading cloud platforms.

Preferred Knowledge Areas, Skills, Abilities, and other Qualifications:

1. Figma, Sketch, Adobe XD, or similar design and prototyping tools.

2. Expertise in Azure architecture, Kubernetes/ Azure Kubernetes Services (AKS), Terraform, Continuous Integration and Continuous Deployment (CI/CD), and automation frameworks.

3. Experience supporting production AI/ML systems or mission‑critical workloads.

4. Knowledge of observability tools, monitoring frameworks, and reliability engineering practices.

5. Understanding of security and compliance standards including Health Insurance Portability and Accountability Act of 1996 (HIPAA) and National Institute of Standards and Technology (NIST).

6. Demonstrated leadership, cross-functional collaboration, and technical communication skills.

7. Strong stakeholder engagement and change‑management skill.

8. Experience in healthcare, public sector, or other regulated environments.

9. Experience deploying or supporting AI/ML, LLM, or agentic AI systems in production.

10. Familiarity with Site Reliability Engineering (SRE) or platform engineering frameworks.

11. Experience Using the Following Software and/or Platforms:

- Azure cloud services, Docker, Kubernetes/AKS, Terraform, CI/CD platforms (Azure DevOps, GitHub Actions, Jenkins), monitoring/observability tools (Grafana, Azure Monitor), secrets/IAM security tooling.