Senior Databricks Lakehouse Architect

Capgemini; New York (NY); Hybrid; USD 111,000 - 145,000; Full time

Benefits offered by this job

Paid time off

Health, dental and vision coverage

Retirement plans

Life and disability insurance

Employee assistance programs

Job summary

Capgemini is seeking a skilled professional to design and implement enterprise-scale data architectures on the Databricks Lakehouse platform. You will define target-state architectures, migrate roadmaps, and develop reusable frameworks while ensuring governance and security.

Experience with PySpark, Unity Catalog, and streaming data integration is essential. The role includes establishing RBAC, data masking, and secure data sharing, with potential involvement in Airflow orchestration and CI/CD

Qualifications

• Design enterprise-scale Lakehouse architectures using Databricks.
• Define target-state data platform architectures and migration roadmaps.
• Establish enterprise data governance, security, and operational standards.
• Hands on experience with PySpark development and implementation.
• Familiarity with CI/CD methods.

Responsibilities

• Design enterprise-scale Lakehouse architectures using Databricks.
• Define target-state data platform architectures and migration roadmaps.
• Develop reference architectures, reusable frameworks, and accelerator solutions.
• Establish enterprise data governance, security, and operational standards.
• Knowledge of real-time and streaming integration.

Skills

Databricks

Pyspark

Unity Catalog

Data governance

Airflow

CI/CD

Delta sharing

Security & RBAC

Streaming knowledge

Large-scale architectures

Tools

Databricks

Airflow

Job description

Capgemini is seeking a skilled professional to design and implement enterprise-scale data architectures on the Databricks Lakehouse platform. You will define target-state architectures, migrate roadmaps, and develop reusable frameworks while ensuring governance and security.

Experience with PySpark, Unity Catalog, and streaming data integration is essential. The role includes establishing RBAC, data masking, and secure data sharing, with potential involvement in Airflow orchestration and CI/CD