Senior AI, Data Engineer

Sud Recruiting; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

Sud Recruiting seeks a Senior AI Data Engineer in New York to architect and deploy scalable cloud-based data and AI solutions across clinical and enterprise environments. The role focuses on integrating Epic/EHR and Snowflake to support predictive, generative, and agentic AI applications, while establishing MLOps and LLMOps practices.

You will lead design, governance, and deployment with cross-functional teams.

Qualifications

• Architect and design scalable AI/ML architectures for healthcare platforms.
• Lead end-to-end AI/ML platforms with secure, highly available deployments.
• Establish MLOps/LLMOps patterns including CI/CD, monitoring, and rollback.

Responsibilities

• Architect and deploy scalable cloud-based data and AI solutions across clinical and enterprise environments.
• Lead design, governance, deployment, and optimization of AI/ML models and pipelines.
• Integrate Epic/EHR with Snowflake to enable predictive, generative, and agentic AI apps.
• Establish MLOps and LLMOps practices including CI/CD, monitoring, and rollback.
• Mentor engineers and collaborate with cross-functional teams.

Skills

AI/ML architecture design

MLOps/LLMOps

Python

Education

Bachelor's degree in CS/Engineering/Math

Master’s preferred

Tools

Snowflake

Epic

Job description

Keywords: Healthcare Data architecture, Data Engineer, AI Engineer, Generative AI, Agentic AI, Python, Predictive Modeling, Model Deployment, Healthcare, Clinical Data

A leading, fully integrated healthcare system is seeking a Senior AI Data Engineer to architect and develop scalable cloud-based data and AI solutions across clinical and enterprise environments. The role will integrate platforms such as Epic/EHR and Snowflake to support predictive, generative, and agentic AI applications, while establishing modern data engineering, MLOps, and LLMOps practices. The engineer will lead technical design, production deployment, governance, and optimization of AI/ML solutions, collaborate with cross-functional teams, evaluate emerging technologies, and mentor team members. Must have Healthcare industry experience, particularly with provider organizations and clinical data platforms (e.g., Epic).

Qualifications

• Bachelor's in Comp. Science, Engineering, Mathematics, or a related field. Master’s preferred.
• 6+ years of experience designing, building, and supporting AI/ML platforms and solutions.
• Design and lead end-to-end AI/ML architectures for scalable, secure, and highly available healthcare AI platforms and applications.
• Define reference architectures for predictive ML, Generative AI, LLM, and Agentic AI solutions across clinical and enterprise use cases.
• Establish architectural patterns for MLOps and LLMOps, including CI/CD, automated model deployment, model/version management, evaluation, observability, monitoring, and rollback.
• Design and implement RAG and agentic AI architectures, including vector search, embeddings, prompt management, tool/function calling, agent orchestration, guardrails, and LLM evaluation.
• Strong experience developing and deploying machine learning models, including NLP and deep learning solutions.
• Proficiency in Python and modern machine learning frameworks.
• Strong experience with Snowflake and cloud-based AI services.