AI & Machine Learning Engineering Consultant - Databricks - Senior - Consulting - Location OPEN

EY; Indianapolis (IN); Hybrid; USD 120,000 - 180,000; Full time

Job summary

EY's AI, Data & Engineering team is building scalable AI solutions on Databricks for client engagements. You will work with cross-disciplinary teams to deliver production-grade AI/ML capabilities, including generative AI and agentic systems, while maintaining data integrity and governance across platforms.

This role focuses on shaping client solutions, researching new techniques, and delivering high-impact results with a strong emphasis on responsible engineering, collaboration, and continuous

Qualifications

• Bachelor's degree in a relevant field; master's preferred.
• 3-6 years’ AI/ML experience.
• Databricks Certification: Data Engineer/ML Engineer.
• Strong Python, PySpark, and Scala skills.

Responsibilities

• Research and implement scalable ML, generative AI, and agentic systems on Databricks.
• Build data pipelines and AI solutions for clients on Databricks.
• Evaluate and optimize learning processes with MLflow and tracing.
• Design and govern ontologies and semantic models for AI solutions.
• Travel to engage with external clients as needed.

Skills

Python

PySpark

Scala

Databricks

MLflow

Generative AI

Education

Bachelor's degree

Master's degree preferred

Tools

Databricks Platform

Unity Catalog

Model Serving

Git/Azure DevOps

Job description

Location: Anywhere in Country

At EY, we're all in to shape your future with confidence.

We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

The opportunity

Our AI, Data & Engineering team helps apply cutting edge technology and techniques to bring solutions to our clients. As part of that, you'll sit side-by-side with clients and diverse teams from EY to create a well-rounded approach to advising and solving challenging problems, some of which have not been solved before. No two days will be the same, and with constant research and development, you'll find yourself building knowledge that can be applied across a wide range of projects now, and in the future. You'll need to have a passion for continuous learning, stay ahead of the trends, and influence new ways of working so you can position solutions in the most relevant and innovative way for our clients. You can expect heavy client interaction in a fast-paced environment and the opportunity to develop your own career path for your unique skills and ambitions.

EY is experiencing significant growth in consulting services centered on Databricks, a market-leading data and AI platform. We are seeking an accomplished leader who combines strong business acumen, consulting experience, and technical credibility to help clients realize value from this strategic platform. In this role, you will collaborate with clients and Databricks account, sector, and leadership teams to shape and deliver generative AI use cases, advanced data and AI solutions, and scalable platforms.

As a Senior AI Engineer, you will be at the forefront of revolutionizing how businesses leverage artificial intelligence. Your role will involve researching, building, and implementing scalable AI, machine learning, generative AI, and agentic systems on Databricks that learn, reason, and generate outputs tailored to diverse business environments. You will enhance data pipelines to ensure data integrity and optimize learning processes, all while collaborating with a talented team of data and analytics professionals. You will deliver AI solutions on Databricks, from data pipelines to agents in production.

Your Key Responsibilities

In this role, you will contribute significantly to the delivery of innovative AI solutions. You will work with a wide variety of clients to deliver modern AI engineering, machine learning, and generative AI technologies. Your teams will design and build scalable solutions that unify, enrich, and derive insights from varied data sources across a broad technology landscape. You will help our clients navigate the complex world of modern data science, analytics, and software engineering. We'll look to you to provide guidance and perform technical development tasks to ensure AI solutions are responsibly engineered, evaluated, deployed, and maintained to support the ongoing business needs of our clients.

You will be joining a dynamic and interdisciplinary team of scientists and engineers who love to tackle the most challenging computational problems for our clients. We love to think creatively, build applications efficiently, and collaborate in both the ideation of solutions and the pursuit of new opportunities. Many on our team have advanced academic degrees or equivalent experience in industry.

You will spend your time on key responsibilities that include:

• Researching and implementing scalable machine learning, generative AI, and agentic systems that meet business requirements
• Building data engineering pipelines, AI solutions (machine learning, generative AI, and agentic AI), and the pipelines that support AI solutions on Databricks
• Evaluating, monitoring, and optimizing learning processes on Databricks to improve high-performance models, with tools like MLflow evaluation and tracing
• Designing, building, and governing domain ontologies and semantic models that define business concepts, relationships, and rules for AI solutions, knowledge graphs, and enterprise data products
• This position may have travel requirements as needed to engage with external clients regularly

Skills And Attributes For Success

To excel in this role, you will need a blend of technical expertise and interpersonal skills. Your ability to navigate complex challenges and deliver impactful solutions will be essential.

This role will work to deliver tech at speed, innovate at scale and put humans at the center. Provide technical guidance and share knowledge with team members with diverse skills and backgrounds. Consistently deliver quality client services focusing on more complex, judgmental and/or specialized issues surrounding emerging technology. Demonstrate technical capabilities and professional knowledge. Learn about EY and its service lines and actively assess and present ways to apply knowledge and services.

• Translating AI strategy into a implementable Model Engineering activities that aligns with the client’s goals, mission and vision
• Working with teams of AI engineers, data engineers, and data scientists to deliver production-grade data engineering pipelines and AI solutions—including machine learning, generative AI, and agentic AI—for clients on Databricks
• Implementing product-centric AI solutions on Databricks, from discovery and roadmap definition through iterative delivery, adoption, and continuous improvement, with measurable business and user outcomes
• Working across design, build, deploy, and operate phases to deliver production-grade data and AI pipelines, including governed business ontologies and semantic models on Databricks, so solutions remain reliable, reusable, and aligned with client business processes
• Applying a product-centric development approach to data and AI solutions by defining user outcomes, prioritizing reusable capabilities, managing roadmaps and backlogs, incorporating user feedback, measuring adoption and business value, and continuously improving products after launch
• Staying abreast of AI technology trends and provide directional guidance and recommendations around AIOps, MLOps, and AgentOps tools and solutions on Databricks that fit their needs and integrate with their existing ecosystem
• Applying combined business and technical knowledge to develop and execute ModelOps target architecture on Databricks that enables implementation and monitoring of AI at scale, with tools like Unity Catalog and Model Serving
• Collaborating with Data Scientists, Data Engineers, Cloud Engineers, and Platform Engineers, DevOps to implement and sustain solutions in the Databricks platform
• Understanding clients’ overall data, AI and technology landscape and business priorities and success measures
• Strong team collaboration and experience working with a diverse team in a hybrid model (on site and remote)
• Working on large-scale client engagements. Fostering relationships with client personnel at appropriate levels. Consistently delivering quality client services. Driving high-quality work products within expected timeframes and on budget
• Collaborating, influencing and building consensus through constructive relationships and effective listening
• Solving problems by incorporating data into decision making

To qualify for the role, you must have:

• A Bachelor's degree required (4-year degree).
• 3-6 years of full-time working experience in AI and/or Machine Learning
• Databricks Certification with a minimum of 1 professional and 1 associate certification that includes a combination of Data Engineer Associate or Professional, Machine Learning Associate or Professional, Generative AI Engineer Associate, and/or Context Engineering Associate
• Strong skills in Python, PySpark, and/or Scala
• Ability to collaborate and communicate effectively with diverse, hybrid, and global teams.
• Experience designing, building, and maintaining high-impact, high-value production AI/ML solutions on a major cloud platform using Databricks
• At least two years of experience building and deploying production AI/ML solutions on Databricks, including experience with Agent Bricks, Model Serving, or Lakeflow Jobs.
• Delivered models or agents to production on Databricks, with tracking, evaluation, and monitoring.
• Proficient in foundation models, generative AI, and agentic AI frameworks (e.g., Retrieval Augmented Generation (RAG)) and experienced with ML packages like scikit-learn and PyTorch, using Databricks tools including Agent Bricks, AI Search, Foundation Model APIs, and Unity Gateway
• Experience with natural language processing and deep learning
• Extensive experience in DevOps tools (Git, Azure DevOps) and AI-driven SDLC for developing, deploying, and scaling analytical solutions on Databricks, for example with Databricks Git folders, Declarative Automation Bundles, and the Databricks CLI and SDKs
• Experience with MLOps, LLMOps, and AgentOps and ML workflows on Databricks, including data ingestion, transformation, and evaluation, for example with MLflow, Models in Unity Catalog, and Model Serving
• Experience with model retraining and feedback loop methodologies on Databricks, for example with Lakeflow Jobs and Databricks Feature Store
• Experience evaluating and operating models and AI solutions on Databricks, including observability, monitoring, reporting, MLflow evaluation and tracing, and data quality monitoring.
• Understanding of data structures, Responsible AI practices, and data modelling, and software engineering best practices
• Strong foundation in mathematics, statistics, and operations research, with proficiency in data manipulation tools (SQL, Pandas, Spark) and deep learning techniques, using Databricks tools such as Databricks SQL and Delta Lake, using Databricks tools such as Databricks SQL and Delta Lake.
• Excellent communication skills for conveying findings and recommendations, with willingness to travel as needed for client engagements.

Ideally, you’ll also have:

• Master's degree Computer Science, Mathematics, Physical Sciences, or another quantitative field
• Databricks Solution Architect Champion Badge preferred
• Experience in hybrid collaboration and emotional agility
• A track record of working with diverse teams to drive outcomes through complex problem-solving of working with diverse teams to drive outcomes through complex problem-solving
• Knowledge of sustainability practices in technology
• A deep understanding of and ability to teach concepts, tools, features, functions, and benefits of different approaches to apply them
• Experience fine-tuning Generative AI models on Databricks, including with AI Runtime (serverless GPU)
• Experience with image processing techniques and/or speech and audio processing and analysis

What We Look For