Databricks Data Engineer: Build Scalable AI Pipelines

Deloitte France; Dallas (TX); On-site; USD 87,000 - 171,000; Full time

Job summary

Deloitte's Core AI & Data practice seeks a Databricks Data Engineer II to design, build, and optimize cloud-based data engineering solutions enabling large-scale transformation. You will collaborate with business and technology teams to modernize data environments, support AI use cases, and drive measurable business outcomes across client engagements.

The role emphasizes data pipelines, batch/streaming workloads, and data modeling to enhance platform performance and decision-making.

Qualifications

• Bachelor's degree in CS, Engineering, IS, Data Science, Mathematics, or Statistics.
• 3+ years of experience in data engineering, ETL, or data platform engineering.
• 2+ years building Databricks pipelines with Spark, Python, and SQL.
• Experience with data models, integration patterns, and cloud-based data processing workflows.
• Experience with AWS, Azure, or GCP.
• Ability to travel 50%, immigration sponsorship may be available.

Responsibilities

• Design, build, and maintain data pipelines using Databricks, Spark, Python, and SQL.
• Modernize data platforms with cloud-based ingestion, transformation, and storage patterns.
• Develop batch and streaming data workflows for reporting, analytics, and AI use cases.
• Apply data architecture, integration, and data modeling practices to improve data quality and performance.
• Collaborate with client and Deloitte teams to troubleshoot issues and deliver large-scale data transformations.

Skills

Databricks

Python

SQL

Communication

Leadership

Detail orientation

Team collaboration

Deadline driven

Education

Bachelor's degree in CS, Engineering, IS, Data Science, Mathematics or Statistics

Tools

Databricks

Apache Spark

Python

SQL

AWS/Azure/GCP

Git/CI-CD

Delta Lake

Unity Catalog

Job description

Deloitte's Core AI & Data practice seeks a Databricks Data Engineer II to design, build, and optimize cloud-based data engineering solutions enabling large-scale transformation. You will collaborate with business and technology teams to modernize data environments, support AI use cases, and drive measurable business outcomes across client engagements.

The role emphasizes data pipelines, batch/streaming workloads, and data modeling to enhance platform performance and decision-making.