Senior Data Engineer (Databricks)

DATAPAO; United Kingdom; Remote; GBP 70,000 - 100,000; Full time

Job summary

An innovative consulting company is seeking a Senior Data Engineer to join their dynamic team in the UK. This pivotal role involves working with leading clients on data engineering and cloud migration projects. You will leverage your expertise in Databricks, Apache Spark, and cloud platforms to solve complex data challenges. With a focus on collaboration and growth, this position offers the chance to make a significant impact as the first hire in the region. Enjoy the flexibility of remote work, learning opportunities, and a transparent culture that values diversity and innovation.

Benefits

Remote work

Learning opportunities

Flexible PTO

Paternity leave

Employee Assistance Program

Pension and private health insurance

High-quality equipment

Sign-up bonus of £1000

Transparent culture

Qualifications

• 5+ years in Data Engineering with a focus on cloud platforms.
• Proven experience with Databricks and data pipeline orchestration.

Responsibilities

• Deliver complex projects individually or by leading small teams.
• Manage customer relationships and support pre-sales efforts.

Skills

Data Engineering

Databricks

Apache Spark

SQL

Python

ETL/ELT

Cloud Platforms (AWS, Azure, GCP)

CI/CD Pipelines

Infrastructure as Code

Data Pipeline Orchestration

Tools

Databricks Workflows

Airflow

Azure Data Factory (ADF)

AWS Glue

Terraform

CloudFormation

Power BI

Tableau

Looker

Job description

Join to apply for the Senior Data Engineer (Databricks) role at DATAPAO

Get AI-powered advice on this job and more exclusive features.

This range is provided by DATAPAO. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from DATAPAO

At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company, recognized for our innovation and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year and have achieved a second consecutive appearance on the Financial Times FT1000 list.

We are currently looking for a Senior Data Engineer to join us remotely in the UK. We plan to set up a hub in the UK in the following 12-18 months to enable our GTM strategy, and this would be our first hire in the region. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles.

What will you do?

As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Our projects are fast-paced, typically 2 to 4 months long, and primarily use Apache Spark/Databricks on AWS/Azure. You will manage customer relationships either alone or with a Project Manager, and support our pre-sales, mentoring, and hiring efforts.

What does it take to fit the bill?

Technical Expertise

• 5+ years in Data Engineering, focusing on cloud platforms (AWS, Azure, GCP);
• Proven experience with Databricks (PySpark, SQL, Delta Lake, Unity Catalog);
• Extensive ETL/ELT and data pipeline orchestration experience (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, Step Functions);
• Proficiency in SQL and Python for data transformation and optimization;
• Knowledge of CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, Bicep);
• Hands-on experience with Databricks integration with BI tools (Power BI, Tableau, Looker).

Consulting & Client-Facing Skills

• Experience in consulting or product companies with a customer-facing mindset; ability to scope, gather requirements, design solutions, and communicate effectively;
• Successful delivery of Data Lakehouse and cloud migration projects;
• Ability to explain technical concepts to non-technical audiences and facilitate decision-making.

Operational & Soft Skills

• Ready to contribute immediately to live projects;
• Adaptability and problem-solving skills in a fast-paced environment;
• Excellent communication skills in writing and speaking.

What do we offer?

Opportunity to impact our growth as the first UK hire, with regional expansion leadership. Benefits include:

• Remote work with a one-month onboarding in Budapest and quarterly visits;
• Learning opportunities with Databricks courses, certifications, and internal resources;
• Flexible PTO;
• Paternity leave;
• Employee Assistance Program;
• Pension and private health insurance via Remote.com;
• High-quality equipment and a sign-up bonus of £1000;
• Transparent, high-trust culture.

The gross salary range is £70,000 to £100,000 per year, based on assessed seniority.

We are a trusted partner for Databricks and Microsoft, working with top global companies. We value diversity and are open to passionate candidates who may not meet every requirement. Your privacy is important to us, and your data will be used solely for recruitment purposes.