Databricks Developer

Capgemini

Greater London

Hybrid

GBP 80,000 - 110,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Capgemini in London seeks a Databricks Developer to design and maintain scalable ETL/ELT pipelines on Azure Databricks. You will develop data processing solutions with PySpark, Spark SQL and Python, ingesting and optimizing data from diverse sources.

You will build data lakes with Bronze-Silver-Gold layers and integrate Databricks with ADF, ADLS Gen2, Synapse, and other cloud services while ensuring governance and security.

Qualifications

  • Hands-on experience with Azure Databricks platform and Spark-based tooling.
  • Strong SQL and Python coding skills for data engineering
  • Experience integrating with cloud services (ADF, ADLS Gen2) and data governance practices

Responsibilities

  • Design, develop and maintain scalable ETL/ELT pipelines using Azure Databricks
  • Develop data processing solutions using PySpark, Spark SQL and Python
  • Ingest, transform and optimize structured and unstructured data from multiple sources
  • Build and maintain data lakes and medallion architecture (Bronze, Silver, Gold)
  • Integrate Databricks with Azure Data Factory, ADLS Gen2, Synapse and other cloud services
  • Optimize Spark jobs for performance and cost efficiency
  • Implement data quality checks, monitoring and troubleshooting processes
  • Collaborate with business stakeholders, data analysts and architects to understand data requirements
  • Ensure adherence to data governance, security and compliance standards

Skills

Azure Databricks
PySpark
Spark SQL
Python
Azure Data Factory
ADLS Gen2
SQL
Git CI/CD
DevOps
Data modelling

Job description

About the Job you are considering:

We are seeking a skilled Databricks Developer with strong expertise in building scalable data pipelines data transformation and analytics solutions on the Azure Databricks platform. The ideal candidate should have Handson experience in Spark Python SQL and cloud based data engineering solutions.

Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

Your Role:
  • Design develop and maintain scalable ETLELT pipelines using Azure Databricks
  • Develop data processing solutions using PySpark Spark SQL and Python
  • Ingest transform and optimize structured and unstructured data from multiple sources
  • Build and maintain data lakes and medallion architecture Bronze Silver Gold layers
  • Integrate Databricks with Azure Data Factory ADF Azure Data Lake Storage ADLS Synapse and other cloud services
  • Optimize Spark jobs for performance and cost efficiency
  • Implement data quality checks monitoring and troubleshooting processes
  • Collaborate with business stakeholders’ data analysts and architects to understand data requirements
  • Ensure adherence to data governance security and compliance standards
Your Skills:
  • Strong experience with Azure Databricks
  • Expertise in PySpark Spark SQL and Python
  • Handson experience with Azure Data Factory ADF
  • Strong SQL programming and database concepts
  • Experience with Azure Data Lake Storage ADLS Gen2
  • Knowledge of ETL Data Warehousing concepts
  • Experience with Git CICD and DevOps practices
  • Understanding of data modelling and performance tuning
We are a Disability Confident Employer:

Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who: Declare they have a disability, and Meet the minimum essential criteria for the role. Please opt in during the application process.

Make It Real (what does it mean for you):

You’ll be joining an accredited Great Place to work for Wellbeing in 2024. Employee wellbeing is vitally important to us as an organisation. We see a healthy and happy workforce a critical component for us to achieve our organisational ambitions. To help support wellbeing we have trained ‘Mental Health Champions’ across each of our business areas, and we have invested in wellbeing apps such as Thrive and Peppy.You will be empowered to explore, innovate, and progress.You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard Manage Mentor, Cybersecurity qualifications and much more.You will join one of the World’s Most Ethical Companies®, as recognised by Ethisphere® for 13 consecutive years. We live our values by making ethical business choices every day. Working ethically is at the centre of our culture at Capgemini, meaning you will be helping to create a future we can all be proud of.

Why you should consider Capgemini:

Growing clients’ businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you’ll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what’s possible. It’s why, together, we seek out opportunities that will transform the world’s leading businesses, and it’s how you’ll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you’ll build the skills you want. You’ll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.

About Capgemini:

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of over 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2025 global revenues of €22.5 billion.

Make it real | www.capgemini.com

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Developer - London, UK
Databricks Developer - London, UK

Capgemini • Greater London

Hybrid
GBP 70,000 - 100,000
Disability Confident Employer (Level 2
Azure Databricks Technical Lead
Azure Databricks Technical Lead

Sogeti • United Kingdom

Hybrid
GBP 70,000 - 110,000
Azure Databricks Technical Lead
Azure Databricks Technical Lead

Sogeti • Manchester

Hybrid
GBP 70,000 - 120,000
Hybrid working
Career development
Azure Databricks Engineer
Azure Databricks Engineer

Capgemini • Greater London

Hybrid
GBP 70,000 - 110,000
Java Software Engineer (Python & AI)
Java Software Engineer (Python & AI)

Capgemini • Manchester

Hybrid
GBP 70,000 - 90,000
Asp.Net Developer
Asp.Net Developer

Capgemini • Manchester

Hybrid
GBP 60,000 - 80,000
Training and development opportunities
Access to numerous external certifications
Wellbeing programs
Microsoft Dynamics Developer- Manchester, UK
Microsoft Dynamics Developer- Manchester, UK

Capgemini • Manchester

Hybrid
GBP 60,000 - 90,000
Disability Confident Employer
Wellbeing program
Learning for life
Product Architect - Data Intelligent Platform
Product Architect - Data Intelligent Platform

Capgemini • Birmingham

Hybrid
GBP 110,000 - 150,000
Data and Insights Driven Solutions Lead
Data and Insights Driven Solutions Lead

Capgemini • Greater London

Hybrid
GBP 90,000 - 120,000
Azure Databricks Architect
Azure Databricks Architect

Sogeti • Greater London

Hybrid
GBP 90,000 - 130,000