Senior Data Engineer – Databricks & Airflow

Data Science Festival; Greater London; Hybrid; GBP 75,000 - 85,000; Full time

Job summary

Data Idols seeks a Senior Data Engineer in London with hybrid working arrangements to design and develop data foundations that enable data science and analytics products at scale.

You will build scalable pipelines and orchestration workflows using Airflow and Databricks, taking ownership of complex technical problems while collaborating closely with Data Scientists and product teams to deliver production-ready solutions.

Qualifications

• Strong commercial Data Engineering experience.
• Experience designing and building scalable data pipelines.
• Strong experience with Airflow.
• Experience working with Databricks.
• Experience working closely with Data Science or advanced analytics teams.
• Ability to take ownership of complex technical problems and drive solutions through to delivery.

Responsibilities

• Design and develop data foundations to enable data science teams to build, test and deliver data products.
• Build scalable data pipelines and orchestration workflows.
• Create production-ready data solutions with reliability and scalability.
• Collaborate with Data Scientists and other engineering/product teams.

Skills

Data Engineering

Data Pipelines

Airflow

Databricks

DS Collaboration

Ownership

Tools

Airflow

Databricks

Job description

Data Idols seeks a Senior Data Engineer in London with hybrid working arrangements to design and develop data foundations that enable data science and analytics products at scale.

You will build scalable pipelines and orchestration workflows using Airflow and Databricks, taking ownership of complex technical problems while collaborating closely with Data Scientists and product teams to deliver production-ready solutions.