Databricks Lakehouse Engineer: Governance & Streaming

Capgemini; New York (NY); On-site; USD 79,000 - 106,000; Full time

Benefits offered by this job

Paid time off

Medical, dental, and vision coverage

401(k) retirement plans

Life and disability insurance

Employee assistance programs

Job summary

Capgemini seeks a Data Platform Architect to design enterprise-scale Lakehouse architectures using Databricks in a New York setting. You will define target-state data platform architectures and migration roadmaps, develop reference architectures and accelerator solutions, and establish enterprise data governance, security, and operational standards.

The role requires hands-on Py-Spark development, familiarity with Airflow, CI/CD for data pipelines, and strong knowledge of Unity Catalog for

Qualifications

• Experience with data platform architectures and governance.
• ,

Responsibilities

• Design enterprise-scale Lakehouse architecture using Databricks.

Skills

PySpark

Airflow

Unity Catalog

Databricks

Delta Sharing

CI/CD

Data governance

RBAC

Tools

Databricks Apps

Delta Sharing

Job description

Capgemini seeks a Data Platform Architect to design enterprise-scale Lakehouse architectures using Databricks in a New York setting. You will define target-state data platform architectures and migration roadmaps, develop reference architectures and accelerator solutions, and establish enterprise data governance, security, and operational standards.

The role requires hands-on Py-Spark development, familiarity with Airflow, CI/CD for data pipelines, and strong knowledge of Unity Catalog for