Senior AI Agent Engineer – Hybrid (Onsite 3 days)

Mount Sinai Health System; New York (NY); Hybrid; USD 132,000 - 198,000; Full time

Job summary

Mount Sinai Health System in New York is seeking a Machine Learning Engineer III to lead the design, deployment, and governance of AI agent ecosystems and autonomous workflows onsite/hybrid at 150 E 42nd Street, NYC. You will architect end-to-end AI solutions using LLMs, RAG, and orchestration frameworks, collaborating with data scientists and product managers to drive robust, scalable ml systems.

Ideal candidates have 4+ years of ML and back-end development experience, plus hands-on work with

Qualifications

• Bachelor’s degree in Computer Science, Data Science, or a related field.
• 4+ years of experience in machine learning and back-end software development.
• 1+ years building Generative AI, LLM, RAG, Copilot, or Agentic AI solutions in production.
• Experience with LLM platforms and frameworks such as Azure AI Foundry, Azure OpenAI, OpenAI, Anthropic, LangChain, LangGraph, Semantic Kernel, CrewAI, AutoGen, or similar.
• Experience building RAG architectures utilizing vector databases such as Pinecone, Azure AI Search, Elasticsearch, Weaviate, Chroma, or equivalent.

Responsibilities

• Own the design, development, deployment, governance, and evolution of AI agent ecosystems and autonomous workflows.
• Architect end-to-end agentic AI solutions leveraging LLMs, multi-agent systems, RAG, orchestration frameworks, and enterprise integrations.
• Lead collaboration with data scientists and product managers for deployment and maintenance of ML models.
• Oversee monitoring and updating of deployed models to ensure performance and reliability.
• Provide technical leadership and mentorship to ML Engineer I, II, and other team members.
• Establish best practices for ML system development including code reviews and documentation.

Skills

Leadership

ML Engineering

Cross-functional collaboration

Mentorship

DevOps

Model monitoring

Education

Bachelor’s degree in Computer Science, Data Science, or a related field

Tools

Azure OpenAI

OpenAI

LangChain

LangGraph

Semantic Kernel

Pinecone

Azure AI Search

Elasticsearch

Weaviate

Chroma

Job description

Mount Sinai Health System in New York is seeking a Machine Learning Engineer III to lead the design, deployment, and governance of AI agent ecosystems and autonomous workflows onsite/hybrid at 150 E 42nd Street, NYC. You will architect end-to-end AI solutions using LLMs, RAG, and orchestration frameworks, collaborating with data scientists and product managers to drive robust, scalable ml systems.

Ideal candidates have 4+ years of ML and back-end development experience, plus hands-on work with