Databricks Data Engineer: Lakehouse & Real-Time Pipelines

Capgemini; New Hanover Township (NJ); On-site; USD 105,000 - 115,000; Full time

Benefits offered by this job

Vacation and holidays

401(k) retirement savings

Comprehensive benefits

Job summary

Capgemini in Hanover, NJ is hiring for a Data Engineering Development role focused on building scalable data pipelines with Databricks, PySpark and Delta Lake. You will design ETL/ELT workflows, develop data solutions, and support analytics and ML initiatives with cross‑functional partners.

Responsibilities include Databricks platform management, lakehouse architectures, data modeling, governance, and CI/CD for data pipelines on cloud platforms such as Azure, AWS or GCP.

Qualifications

• Experience designing and maintaining scalable data pipelines.
• Proficiency with PySpark, Spark SQL and Delta Lake.
• Hands-on experience with Databricks notebooks and ETL/ELT workflows.
• Familiarity with data governance and secure data movement.

Responsibilities

• Design, develop and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows for batch and real-time data processing.
• Develop data solutions using PySpark, Spark SQL and Databricks notebooks.
• Implement Delta Lake solutions to ensure data reliability, performance and governance.
• Integrate data from multiple sources including databases, APIs, files and streaming platforms.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

ETL/ELT

Data pipelines

CI/CD for data

Tools

Databricks notebooks

Job description

Capgemini in Hanover, NJ is hiring for a Data Engineering Development role focused on building scalable data pipelines with Databricks, PySpark and Delta Lake. You will design ETL/ELT workflows, develop data solutions, and support analytics and ML initiatives with cross‑functional partners.

Responsibilities include Databricks platform management, lakehouse architectures, data modeling, governance, and CI/CD for data pipelines on cloud platforms such as Azure, AWS or GCP.