Senior AI Engineer – Healthcare MLOps

NYU Langone Health; New York (NY); On-site; USD 98,000 - 140,000; Full time

Job summary

NYU Langone Health’s NYU Grossman School of Medicine invites applications for a Sr. Engineer I, AI to design and deploy MLOps/LLMOps pipelines in production healthcare environments, collaborating with data scientists to operationalize Generative AI models.

You will build scalable data and ML pipelines, implement monitoring, ensure HIPAA compliance, participate in CI/CD, and contribute to architecture and runbooks while staying current with Generative AI trends.

Qualifications

• Bachelor's degree in computer science, software engineering, or a related field.
• 1-3 years of hands-on AI solution development experience.
• Strong Python or equivalent programming skills.
• Solid knowledge of AI, ML, and deep learning concepts.
• Experience with PyTorch or TensorFlow.
• Experience building large-scale compute-intensive apps (HPC, Spark, Kubernetes).
• Understanding of software development principles and architectures.
• Excellent problem-solving and teamwork.
• Strong verbal and written communication.

Responsibilities

• Design and implement MLOps/LLMOps pipelines for production healthcare AI.
• Collaborate with data scientists to deploy or fine-tune Generative AI models.
• Develop scalable data and ML pipelines across RPM ecosystem.
• Implement monitoring and observability for AI apps and model versioning.
• Evaluate AI tools/frameworks; balance compliance, performance, and cost.
• Optimize inference performance and cost using batching, quantization, and caching.
• Ensure HIPAA compliance and data governance in AI apps.
• Create architecture/runbooks/docs; support technical reviews.
• Collaborate with clinicians/product stakeholders; participate in backlog refinement.
• Integrate CI/CD for AI deployments in cloud environments.
• Stay current with Generative AI trends and share learnings.
• Provide guidance and contribute to reusable AI components and standards.

Education

Bachelor's degree in computer science, software engineering, or a related field

Tools

PyTorch

TensorFlow

Kubernetes

MLflow

Kubeflow

Job description

NYU Langone Health’s NYU Grossman School of Medicine invites applications for a Sr. Engineer I, AI to design and deploy MLOps/LLMOps pipelines in production healthcare environments, collaborating with data scientists to operationalize Generative AI models.

You will build scalable data and ML pipelines, implement monitoring, ensure HIPAA compliance, participate in CI/CD, and contribute to architecture and runbooks while staying current with Generative AI trends.