Senior AI Engineer on Databricks & Gen AI

EY; City of Albany (NY); Remote; USD 107,000 - 193,000; Full time

Job summary

EY is seeking a Senior AI Engineer to lead scalable AI/ML initiatives on the Databricks platform. You will collaborate with client teams to design and deliver production-grade AI solutions, data pipelines, and governance models, while advancing MLOps practices and ensuring responsible AI.

This role involves frequent client interaction in a dynamic, hybrid environment. You will work within EY’s AI, Data & Engineering group, contributing to generative AI use cases and scalable platforms, with

Qualifications

• A Bachelor’s degree is required.
• 3-6 years of full-time working experience in AI and/or Machine Learning.
• Databricks Certification with a minimum of 1 professional and 1 associate certification.
• Strong skills in Python, PySpark, and/or Scala.
• Experience designing, building, and maintaining production AI/ML solutions on Databricks.
• Extensive experience in DevOps tools (Git, Azure DevOps) and AI-driven SDLC on Databricks.
• Experience with MLOps, LLMOps, and AgentOps on Databricks.

Responsibilities

• Researching and implementing scalable machine learning, generative AI, and agentic systems on Databricks.
• Building data engineering pipelines, AI solutions on Databricks.
• Evaluating, monitoring, and optimizing learning processes using MLflow.
• Designing and governing ontologies and semantic models for AI solutions.
• Travel to engage with external clients as needed.

Skills

Python

PySpark

Scala

Team collaboration

AI/ML on Databricks production

Education

Bachelor's degree

Tools

Git

Azure DevOps

Databricks

MLflow

Unity Catalog

Model Serving

Job description

EY is seeking a Senior AI Engineer to lead scalable AI/ML initiatives on the Databricks platform. You will collaborate with client teams to design and deliver production-grade AI solutions, data pipelines, and governance models, while advancing MLOps practices and ensuring responsible AI.

This role involves frequent client interaction in a dynamic, hybrid environment. You will work within EY’s AI, Data & Engineering group, contributing to generative AI use cases and scalable platforms, with