Senior Data Engineer — Databricks & Cloud Lead (NYC Onsite)

Capgemini; New York (NY); On-site; USD 133,000 - 150,000; Full time

Benefits offered by this job

Paid time off

Health benefits

Retirement savings plans

Life and disability insurance

Job summary

Capgemini in New York City is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and lakehouse solutions. You will lead project delivery, manage resources, and communicate with stakeholders to ensure successful client outcomes.

Role involves collaborating with analytics and engineering teams, developing dashboards, and monitoring cloud costs across AWS/Azure/GCP. This position is onsite in NYC with Capgemini’s comprehensive benefits package.

Qualifications

• 5+ years of hands-on experience designing and developing ETL/ELT pipelines using Databricks, Apache Spark, and PySpark.
• Strong proficiency in Python, SQL, and PySpark.
• 5+ years of Project/Delivery Management experience.
• Experience with Delta Lake, Data Lakehouse architecture, streaming data, and data warehousing.
• Hands-on experience with AWS, Azure, or GCP.
• Knowledge of CI/CD, Git, DevOps practices, and performance tuning.

Responsibilities

• Design, build, and optimize scalable data pipelines and lakehouse solutions.
• Lead project delivery, resource planning, risk management, and stakeholder communication.
• Manage support operations, ensuring SLA compliance and high customer satisfaction.
• Collaborate with business, analytics, and engineering teams to deliver data-driven solutions.
• Develop dashboards, reports, and automation initiatives to improve operational efficiency.
• Monitor cloud and platform costs (GCP/Snowflake) and drive cost optimization efforts.

Skills

Databricks

Apache Spark

PySpark

Python

SQL

Delivery Management

Tools

Delta Lake

Data Lakehouse

AWS

Azure

GCP

CI/CD

Git

DevOps

Snowflake

Job description

Capgemini in New York City is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and lakehouse solutions. You will lead project delivery, manage resources, and communicate with stakeholders to ensure successful client outcomes.

Role involves collaborating with analytics and engineering teams, developing dashboards, and monitoring cloud costs across AWS/Azure/GCP. This position is onsite in NYC with Capgemini’s comprehensive benefits package.