Azure Databricks Developer

Atos; Wideopen; On-site; GBP 70,000 - 110,000; Full time

Benefits offered by this job

25 days leave + holidays

Pension scheme

Private medical cover

Income protection

Life assurance

Flex benefits program

Job summary

Atos UK is seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions using Azure Databricks and the broader Azure data platform. In this role, you will build robust data ingestion, transformation, and processing pipelines that enable advanced analytics, artificial intelligence, machine learning, and business intelligence capabilities.

Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, you will help deliver

Qualifications

• Expertise with Azure Databricks, Apache Spark, PySpark, Spark SQL.
• Strong Python and SQL development skills.
• Experience building enterprise-scale ETL/ELT pipelines within Azure environments.

Responsibilities

• Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads.
• Integrate data from multiple sources including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems.
• Implement data quality, validation, monitoring, and governance controls across the data lifecycle.
• Support platform engineering activities including CI/CD, environment promotion, performance optimization, and operational support.

Skills

Azure Databricks

Apache Spark

PySpark

Spark SQL

Python

SQL

Azure Data Lake Storage Gen2

Azure Data Factory

Job description

Atos is the Atos Group brand dedicated to AI-powered, secure, end-to-end digital services. Atos designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 54,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core IT systems, accelerate cloud and data transformation, strengthen cybersecurity, and deliver secure digital workplace environments to support its clients, its employees and society. Atos also provides consulting and advisory services through its Atos Amplify brand. A trusted partner in operating complex and mission-critical environments, Atos supports organizations across highly regulated and sovereign contexts.

About Atos Group

Atos Group is a global leader in digital transformation with c. 56,000 employees and annual revenue of c. €7.2 billion (at the go-forward perimeter), operating in 54 countries under two brands - Atos for services and Eviden for products and systems. European number one in cybersecurity and a leader in cloud, Atos Group is committed to a secure and decarbonized future and provides tailored AI-powered, end-to-end solutions for all industries. Atos Group is listed on Euronext Paris.

About The Practice

Our Data & AI Practice helps organisations unlock the value of their data through modern cloud platforms, data engineering, analytics, artificial intelligence, and machine learning solutions. We work with clients across the public and private sectors to design and deliver data platforms that drive innovation, improve decision‑making, and create measurable business outcomes.

Where purpose meets career

• Work on large-scale, cloud-native data platforms using cutting-edge Azure technologies.
• Collaborate with experienced architects, engineers, and data specialists on impactful projects.
• Develop your technical expertise across data engineering, AI, analytics, and modern DevOps practices.

About The Role

We are seeking an Azure Databricks Developer to design, develop, and support scalable data engineering solutions using Azure Databricks and the broader Azure data platform. In this role, you will build robust data ingestion, transformation, and processing pipelines that enable advanced analytics, artificial intelligence, machine learning, and business intelligence capabilities. Working closely with Data Architects, Data Engineers, Data Analysts, and Solution Architects, you will help deliver trusted, high-quality data products while ensuring compliance with security, governance, and operational standards.

Key Responsibilities

• Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
• Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads.
• Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on‑premise systems.
• Implement data quality, validation, monitoring, and governance controls across the data lifecycle.
• Support platform engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support.

Skills We Can’t Do Without

• Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise.
• Experience building enterprise‑scale ETL/ELT pipelines within Azure environments.
• Strong Python and SQL development skills.
• Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory.
• Git version control and software engineering best practices.

Skills We'd Like

• Experience with Microsoft Fabric, Azure Synapse Analytics, Azure Event Hubs, or Kafka.
• Knowledge of Azure DevOps, Terraform, Unity Catalog, MLflow, or Azure Machine Learning.

Additional Requirements

• Candidates must be eligible to obtain and maintain SC and NPPV3 clearance.
• Proven experience working with large-scale data processing and distributed computing technologies.
• Experience working within Agile delivery teams.

Location

UK-based. Remote working is available, with national mobility required.

Benefits

• 25 days paid leave + National Holidays
• Pension Scheme - contributions matched up to 10%
• Private Medical Cover
• Income Protection
• Life Assurance
• Flex Benefits Program

As a Disability Confident employer, we encourage applications from all applicants, especially, differently abled applicants. We aim to ensure that those who meet the minimum criteria for this position will be offered an interview. We are committed and willing to making reasonable adjustments to the application and assessment process to accommodate your needs.

Here at Atos, diversity and inclusion are embedded in our DNA. Read more about our commitment to a fair work environment for all.

Atos is a recognized leader in its industry across Environment, Social and Governance (ESG) criteria. Find out more on our CSR commitment.