London Data Engineer - Azure Databricks Pipelines

eTeam; Greater London; Hybrid; GBP 56,000 - 76,000; Full time

Job summary

eTeam is seeking a data engineer to build and maintain data pipelines and infrastructure in London. The role involves hands-on work with Azure Databricks, Spark, and other big data tools to store and process data efficiently.

You will collaborate on design, development, and optimization of data workflows, ensuring reliability, scalability, and quality across the data platform and cloud environments.

Qualifications

• Experience designing data pipelines and ETL workflows.
• Strong knowledge of Azure Databricks and Spark.
• Proficient in Python and cloud technologies.

Responsibilities

• Design, develop, and optimize data pipelines.
• Ensure data reliability, scalability, and quality.
• Monitor and troubleshoot data workflows.

Skills

Azure Databricks

Spark

Big data tools

Python

ETL processes

Cloud technologies

CI/CD

Tools

Azure Databricks

Spark

CI/CD tooling

Job description

eTeam is seeking a data engineer to build and maintain data pipelines and infrastructure in London. The role involves hands-on work with Azure Databricks, Spark, and other big data tools to store and process data efficiently.

You will collaborate on design, development, and optimization of data workflows, ensuring reliability, scalability, and quality across the data platform and cloud environments.