Junior Databricks Engineer - Remote Azure Data Platform

Allscreens Nationwide Ltd; Greater London; Hybrid; GBP 28,000 - 50,000; Full time

Job summary

Allscreens Nationwide Ltd is seeking a Junior Databricks Engineer to join a client project in a hybrid/remote UK setup. The role focuses on building scalable data pipelines using Azure technologies, Delta Lake and Spark, under guidance from senior engineers.

You will work with ADLS Gen2, ADF, PySpark and Power BI integration, contributing to enterprise-scale data platforms and analytics.

Qualifications

• 2–5 years of experience in data engineering or related field.
• Experience with Azure Data Factory and PySpark in production.
• Familiarity with Azure Data Lake Storage Gen2 and Delta Lake.
• Experience building Lakehouse solutions with Apache Spark.
• Version control with Git; collaboration via Azure DevOps.

Responsibilities

• Design and implement ETL/ELT pipelines using Azure Data Factory.
• Write efficient SQL queries and transform data with Python/PySpark.
• Ingest, process, and store data in ADLS Gen2.
• Build and maintain Lakehouse solutions using Delta Lake and Spark.
• Monitor and optimise data pipelines for reliability and performance.
• Collaborate with senior engineers, analysts and stakeholders.
• Participate in code reviews and follow Git/Azure DevOps practices.
• Integrate datasets with Power BI and reporting tools.
• Document solutions and support continuous improvement.

Skills

SQL

Python

PySpark

ETL/ELT

Azure Data Factory

Tools

Azure Data Factory

Delta Lake

Apache Spark

ADLS Gen2

Git

Azure DevOps

Job description

Allscreens Nationwide Ltd is seeking a Junior Databricks Engineer to join a client project in a hybrid/remote UK setup. The role focuses on building scalable data pipelines using Azure technologies, Delta Lake and Spark, under guidance from senior engineers.

You will work with ADLS Gen2, ADF, PySpark and Power BI integration, contributing to enterprise-scale data platforms and analytics.