Senior AI Engineer: Gen AI & Data Pipelines (Databricks)

EY; Madison (WI); Remote; USD 107,000 - 193,000; Full time

Job summary

EY is seeking a Senior AI Engineer to lead scalable AI/ML and agentic systems on the Databricks platform. You will collaborate with clients and EY teams to shape generative AI use cases, build production-grade data and AI pipelines, and deliver measurable business value.

You will work with data scientists, engineers, and DevOps to enable end-to-end AI solutions while ensuring governance, scalability, and responsible engineering practices in a fast-paced consulting environment.

Qualifications

• Bachelor’s degree required.
• 3–6 years of full‑time AI/ML experience.
• Databricks Certification with at least one professional and one associate certification.
• Strong Python, PySpark and/or Scala skills.
• Experience building and deploying production AI/ML solutions on Databricks.

Responsibilities

• Research and implement scalable ML, generative AI, and agentic systems meeting business needs.
• Build data engineering pipelines and AI solutions on Databricks.
• Monitor and optimize learning processes; use MLflow for evaluation and tracing.
• Design and govern ontologies and semantic models for AI solutions.
• Travel may be required to engage with external clients.

Skills

Databricks

AI engineering

Machine Learning

Python

PySpark

Scala

DevOps

MLflow

Education

Bachelor's degree

Tools

Databricks

Azure DevOps

Job description

EY is seeking a Senior AI Engineer to lead scalable AI/ML and agentic systems on the Databricks platform. You will collaborate with clients and EY teams to shape generative AI use cases, build production-grade data and AI pipelines, and deliver measurable business value.

You will work with data scientists, engineers, and DevOps to enable end-to-end AI solutions while ensuring governance, scalability, and responsible engineering practices in a fast-paced consulting environment.