Sr Databricks Data Engineer

Deloitte France; San Francisco (CA); On-site; USD 116,000 - 229,000; Full time

Job summary

Deloitte seeks a Databricks Engineer III to design, build, and optimize cloud-based data pipelines supporting large-scale transformation. You will work with leaders to modernize data platforms, enable analytics, and drive measurable business outcomes across enterprise data ecosystems.

A successful candidate will oversee governance, leverage CI/CD, and lead teams of data engineers and architects to deliver scalable solutions. This role requires travel up to 50% and strong collaboration skills.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years in data engineering with Databricks on AWS, Azure, or GCP.
• Experience with Lakehouse, Spark, Delta Lake, cloud data stores, and data quality.
• 1+ year leading cross-functional data projects and teams with Databricks tools.

Responsibilities

• Champion best practices for data architecture, integration, and modelling.
• Oversee design and maintenance of large-scale data pipelines and architectures.
• Improve data quality, efficiency, and scalability of processes.
• Lead teams of data engineers and architects; foster growth and delivery.
• Design governance, security, and compliance for cloud data ecosystems.
• Communicate technical concepts and business value to stakeholders.
• Oversee CI/CD deployments using Azure DevOps, Jenkins, or similar tools.

Skills

Travel 50%

Leadership

Collaboration

Communication

Attention to detail

Education

Bachelor's degree in CS/Engineering

Master's degree preferred

Tools

Databricks

AWS

Azure

GCP

Delta Live Tables

Autoloader

Structured Streaming

CI/CD pipelines

Airflow

Unity Catalog

Databricks Workflows

Delta Lake

Job description

Join Deloitte's AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business and technology leaders to modernize data platforms, enable analytics and artificial intelligence use cases, and drive measurable business outcomes. This role offers the opportunity to deliver enterprise-scale Databricks solutions that improve performance, expand digital capabilities, and help clients scale data-driven decision-making across the enterprise.

Recruiting for this role ends on 10/30/2026.

Work you'll do

As a Data Engineer III on the AI & Data team, you will be responsible for:

• Champion Best Practices: Establish, document, and promote best-in-class approaches for data architecture, integration, and modelling.
• Pipeline Ownership: Oversee the design, development, and maintenance of robust data pipelines and data architectures that support large-scale, enterprise data needs.
• Drive Excellence: Initiate and manage efforts to improve data quality, operational efficiency, and process scalability.
• Team and Technology Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring the organization remains at the cutting edge. Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery.
• Data Governance: Consult on, design, and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
• Communication: Communicate technical concepts and business value to diverse stakeholders, including executives, business leads, and technology teams.
• DevOps and Automation: Oversee the implementation of CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations.

A successful candidate would possess these skills:

• Ability to work independently and collaborate as part of a team
• Effective written and verbal communication skills
• Meticulous attention to detail and quality of work product
• Ability to build and sustain professional relationships
• Ability to lead projects or workstreams
• Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
• Strong interpersonal skills and professional demeanor
• Ability to meet deadlines

The team:

Deloitte's Core AI & Data practice helps organizations modernize data platforms, strengthen enterprise data foundations, and scale analytics and artificial intelligence capabilities across the business. The team works with clients to architect, engineer, and deploy cloud-based data solutions that improve decision-making, enable innovation, and support large-scale transformation. Practitioners collaborate across business and technology functions to solve complex challenges in data modernization, governance, platform engineering, and insight delivery.

Qualifications

Required:

• Bachelor's degree in Computer Science, Engineering, or a related field
• 5+ years of hands-on experience in data engineering with a focus on Databricks on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
• Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
• 1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated continuous integration and continuous deployment (CI/CD) pipelines, and performance optimization of data engineering pipelines, code, and compute resources
• Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
• Limited immigration sponsorship may be available.

Preferred:

• Master's degree in Computer Science, Engineering, or a related field
• Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services
• Experience tuning and optimizing performance in Databricks and Apache Spark environments
• Experience with Databricks Lakeflow
• Experience with artificial intelligence and machine learning solutions

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $116,200 to $ 229,100 .

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.