Senior Databricks Data Engineer — Hybrid Data Platform Lead

Capgemini; Atlanta (GA); Hybrid; USD 133,000 - 153,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Paid time off and holidays

Job summary

Capgemini in Atlanta, GA, is seeking a Senior Databricks Data Engineer to design, build, and lead enterprise data platform solutions. Hybrid role based in Atlanta, with collaboration across multiple cloud environments.

Strong leadership and hands-on Databricks experience are essential to deliver scalable data pipelines and governance. The role emphasizes end-to-end data architecture, Delta Lake production deployments, and partnership with business stakeholders to drive strategic insights.

Qualifications

• 6+ years of experience in Data Engineering.
• 4+ years of hands-on experience with Databricks.
• Experience architecting end-to-end data platforms using Databricks Medallion Architecture.
• Proficiency in PySpark, Python, and SQL.
• Production experience with Delta Lake.
• Experience leading and mentoring teams.

Responsibilities

• Design, develop, and deploy scalable data engineering solutions on the Databricks Lakehouse Platform.
• Lead teams of data engineers and developers in enterprise data modernization initiatives.
• Build and optimize data pipelines using PySpark, Python, and SQL.
• Implement Delta Lake, Delta Sharing, and Unity Catalog in production environments.
• Collaborate with stakeholders to gather requirements and communicate technical recommendations.
• Develop orchestration workflows using Apache Airflow and support CI/CD practices.

Skills

Databricks

PySpark

Python

SQL

Delta Lake

Airflow

Cloud platforms

Team leadership

Education

Bachelor's degree in Computer Science / Information Systems / Engineering

Tools

Databricks

Delta Sharing

Delta Lake

Unity Catalog

Airflow

Job description

Capgemini in Atlanta, GA, is seeking a Senior Databricks Data Engineer to design, build, and lead enterprise data platform solutions. Hybrid role based in Atlanta, with collaboration across multiple cloud environments.

Strong leadership and hands-on Databricks experience are essential to deliver scalable data pipelines and governance. The role emphasizes end-to-end data architecture, Delta Lake production deployments, and partnership with business stakeholders to drive strategic insights.