Azure Databricks Engineer for Data Pipelines & Lakes

Capgemini

Greater London

Hybrid

GBP 70,000 - 100,000

Full time

40 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Disability Confident Employer (Level 2

Job summary

Capgemini seeks a Databricks Developer to build scalable data pipelines and analytics on the Azure Databricks platform. You will work across Spark, PySpark, Python, and SQL to ingest, transform and optimize data from multiple sources.

The role involves collaborating with data analysts and engineers in a hybrid setup with offices, client sites and remote work. You will design and maintain Bronze-Silver-Gold medallion data architectures, integrate ADLS Gen2, ADF and Synapse, and implement data

Qualifications

  • Hands-on experience with Spark, Python and SQL in cloud-based data engineering solutions.
  • Experience building scalable ETL/ELT pipelines on Azure Databricks.
  • Knowledge of data lakes and medallion architecture (Bronze/Silver/Gold).

Responsibilities

  • Design, develop and maintain scalable ETL/ELT pipelines using Azure Databricks.
  • Develop data processing solutions using PySpark, Spark SQL and Python.
  • Ingest, transform and optimize structured and unstructured data from multiple sources.

Skills

Azure Databricks
PySpark
Spark SQL
Python
Azure Data Factory
SQL
Azure Data Lake Storage
ETL/Data Warehousing
Git CI/CD DevOps
Data modelling & performance tuning

Tools

Azure Databricks

Job description

Capgemini seeks a Databricks Developer to build scalable data pipelines and analytics on the Azure Databricks platform. You will work across Spark, PySpark, Python, and SQL to ingest, transform and optimize data from multiple sources.

The role involves collaborating with data analysts and engineers in a hybrid setup with offices, client sites and remote work. You will design and maintain Bronze-Silver-Gold medallion data architectures, integrate ADLS Gen2, ADF and Synapse, and implement data

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Data Engineer (Databricks) - Real-Time Pipelines
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines

Capco • City of Edinburgh

Hybrid
GBP 70,000 - 100,000
Discretionary bonus
Health insurance
Pension
+3
Remote Data Engineer: Azure Databricks & Data Pipelines
Remote Data Engineer: Azure Databricks & Data Pipelines

MBN Solutions • United Kingdom

Remote
GBP 70,000 - 90,000
Azure Databricks Lead Engineer | Data & Platform Ops
Azure Databricks Lead Engineer | Data & Platform Ops

Sogeti • United Kingdom

Hybrid
GBP 70,000 - 110,000
Data Engineer - Azure Databricks Data Pipelines
Data Engineer - Azure Databricks Data Pipelines

SSE Enterprise • Reading

Hybrid
GBP 36,000 - 54,000
Private healthcare discounts
Gym memberships
Online GP service
+3
Azure Databricks Data Engineer: Pipelines & Delta Lake
Azure Databricks Data Engineer: Pipelines & Delta Lake

Wipro Ltd. • Warwick

Hybrid
GBP 65,000 - 90,000
Azure Databricks Architect — Senior Cloud Data Leader
Azure Databricks Architect — Senior Cloud Data Leader

Sogeti • Greater London

Hybrid
GBP 90,000 - 130,000
Azure Databricks Engineer — Hybrid Data Solutions
Azure Databricks Engineer — Hybrid Data Solutions

Capgemini • Greater London

Hybrid
GBP 70,000 - 110,000
Databricks Data Engineer: Azure Data Pipelines & AI-Ready
Databricks Data Engineer: Azure Data Pipelines & AI-Ready

Dufrain Consulting Ltd • England

On-site
GBP 70,000 - 100,000
Azure Data Engineer: Pipelines, Migrations & Analytics
Azure Data Engineer: Pipelines, Migrations & Analytics

Tata Consultancy Services Limited • East Midlands

On-site
GBP 60,000 - 80,000
Pension
Health care
Life assurance
+4
Databricks Data Engineer: Scalable Lakehouse Pipelines
Databricks Data Engineer: Scalable Lakehouse Pipelines

Pulse Group • Reading

On-site
GBP 63,000 - 77,000