Senior Data Engineer - Databricks

Capgemini; Atlanta (GA); On-site; USD 89,000 - 166,000; Full time

Benefits offered by this job

Vacation: 12-25 days

Company paid holidays

Personal days

Sick leave

Medical, dental, and vision coverage

Retirement savings plans: 401(k) / RR$

Life and disability insurance

Employee assistance programs

Job summary

Capgemini is seeking a Senior Data Engineer in Atlanta, GA to design, build, and optimize scalable data solutions on the Databricks Lakehouse Platform. You will define end-to-end data architecture, lead large engineering teams, and manage senior client stakeholders to deliver value.

The role requires hands-on Databricks, PySpark/Python, SQL, and cloud experience across Azure/AWS/GCP, with Delta Lake production deployments and data modeling expertise.

Qualifications

• 6+ years of data engineering experience.

Responsibilities

• Define and deploy an end-to-end data architecture including Databricks medallion architecture.
• Lead large teams to deploy Databricks solutions and ensure deliverables.
• Manage senior client stakeholders and align technical work with business goals.

Skills

Data engineering

Databricks

PySpark/Python

SQL development

CI/CD

Airflow

Delta Lake

Delta Sharing

Databricks Apps

Databricks Genie

AI/BI

Data modeling

Tools

Cloud platforms: Azure/AWS/GCP

Delta Lake (production)

Infomatica

Talend

Matillion

Databricks Marketplace

Databricks Unity Catalog

Databricks Data Visualization

Job description

Capgemini is hiring a Senior Data Engineer to design, build, and optimize scalable data solutions on the Databricks Lakehouse Platform in Atlanta, GA.

Responsibilities

• Define and deploy an end-to-end data architecture that includes Databricks medallion architecture
• Lead large teams of engineers and developers to deploy Databricks solutions
• Manage senior client stakeholders effectively

Requirements

• 6+ years of experience in Data Engineering
• At least 4 years designing and delivering data engineering solutions with Databricks
• Expert hands-on development with PySpark/Python
• Expert hands-on SQL development skills
• Hands-on cloud platform experience in two of: Azure, AWS, Google Cloud
• Prior expertise deploying Delta Lake solutions into production
• Experience extracting value from large and complex data sets from various sources and databases
• Solid grasp of database engineering and design principles
• CI/CD familiarity desired
• Experience working with orchestration tools such as Airflow
• Strong knowledge of Unity Catalog
• Experience with ETL tools such as Infomatica, Talend, Matillion desired
• Experience with Delta Sharing and Marketplace expertise
• Experience working with Databricks Apps
• Working knowledge of Databricks Genie, AI/BI, and Databricks Data Visualization capabilities
• Conceptual, Logical, and Physical Data Modeling experience preferred

Technologies

• Databricks Lakehouse Platform
• Apache Spark, PySpark, Python
• Delta Lake
• Azure, AWS, GCP
• SQL
• Unity Catalog
• Airflow
• Infomatica, Talend, Matillion
• Delta Sharing, Databricks Marketplace
• Databricks Apps
• Databricks Genie, AI/BI
• Databricks Data Visualization
• CI/CD

Benefits

• Paid time off based on employee grade (A-F), per policy: Vacation: 12-25 days depending on grade
• Company paid holidays
• Personal days
• Sick leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

Location: Atlanta, GA (onsite)

Salary: USD 89,400 - 166,398 per yearly

Minimum Experience: 6 years