Principal Data Engineer (Databricks)

DATAPAO; United Kingdom; Remote; GBP 70,000 - 100,000; Full time

Job summary

DATAPAO, a leading Data Engineering and Data Science consulting company, is seeking a Principal Data Engineer (Databricks) to join remotely from the UK. As the first hire in this region, you will spearhead projects utilizing cutting-edge technologies while working closely with EMEA and US customers to solve data challenges. The role requires strong expertise in data pipelines, cloud platforms, and consulting skills, and offers the flexibility of remote work along with a comprehensive benefits package.

Benefits

Fully remote setup

World-class educational benefits

Flexible PTO days

4 weeks of paternity leave

Comprehensive health insurance plan

Top-notch working equipment

The chance to impact company culture

Qualifications

• 5+ years of experience in Data Engineering with a focus on AWS, Azure, GCP.
• Proven experience working with Databricks, including PySpark and SQL.
• Hands-on experience integrating Databricks with BI tools like Power BI and Tableau.

Responsibilities

• Deliver complex projects, managing customer relationships and mentoring juniors.
• Work independently or lead small teams, focusing on data engineering and ML solutions.
• Contribute to pre-sales processes and ensure operational readiness for client projects.

Skills

Data Engineering

Cloud Platforms

SQL

Python

Databricks

ETL/ELT Development

CI/CD Pipelines

Job description

Join to apply for the Principal Data Engineer (Databricks) role at DATAPAO

Join to apply for the Principal Data Engineer (Databricks) role at DATAPAO

Get AI-powered advice on this job and more exclusive features.

This range is provided by DATAPAO. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$70,000.00/yr - $100,000.00/yr

Direct message the job poster from DATAPAO

At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company, recognized for our innovation and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year and have achieved a second consecutive appearance on the Financial Times FT1000 list.

We are currently looking for a Senior Data Engineer to join us remotely in the UK. We plan to set up a hub in the UK in the following 12-18 months to enable our GTM strategy, and this would be our first hire in the region. You will work with our EMEA and US customers to help them solve their data engineering, ML, ML Ops, and cloud migration puzzles.

What will you do?

As a Senior Data Engineer, you are expected to deliver (across industries) on some of our most complex projects - individually or by leading small delivery teams. Although we work for the biggest multinational companies where years-long behemoth projects are the norm, our projects are fast-paced, typically 2 to 4 months long. Most are delivered using Apache Spark/Databricks on AWS/Azure and require you to directly manage the customer relationship alone or in collaboration with a Project Manager. Additionally, at this seniority level, we expect you to compound your impact across the team and the organization - by supporting our pre-sales process, mentoring more junior engineers, and contributing to hiring best-in-class data talent.

What does it take to fit the bill?

Technical Expertise

• You (ideally) have 5+ years of experience in Data Engineering, with a focus on cloud platforms (AWS, Azure, GCP);
• You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog);
• You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.);
• You’re proficient in SQL and Python, using them to transform and optimize data like a pro;
• You know your way around CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation, or Bicep);
• You’ve hands-on experience integrating Databricks with BI tools (Power BI, Tableau, Looker).

Consulting & Client-Facing Skills

• Ideally, you bring a proven history in consulting, from scoping to gathering requirements, designing solutions, and communicating effectively with stakeholders. If you bring a product company background with you, that's also fine as long as you can show a good consulting mindset and desire to be customer-facing;
• You’ve successfully delivered projects like Data Lakehouse buildouts and cloud data migrations
• You excel in explaining technical concepts to non-technical audiences and drive decision-making.

Operational Readiness & Soft Skills

• You’re (almost) ready to hit the ground running, immediately contributing to live client projects;
• In a fast-paced consulting environment, where no two days are the same, flexibility and problem-solving comes naturally to you. Furthermore, resilience and thriving on challenges are essential traits in our industry;
• Your communication skills are on point—whether you’re writing, speaking, or collaborating with stakeholders, you know how to keep everyone in the loop.

What do we offer?

You'll have the rare opportunity to join DATAPAO at a time when you can still meaningfully impact our growth trajectory and organizational success. Furthermore, as our first-ever UK hire, you’ll also get to spearhead our regional expansion.

Surely, we know everyone needs a little something to do their best work. Here is a list of some other extras we offer:

• The chance to work remotely - as we don't have a physical office in the UK yet, we offer a fully remote setup for the time being. However, given our strong community emphasis, we'd expect you to spend one month in our Budapest hub during onboarding and visit the office for one week every quarter;
• World-class educational benefits - there’s no shortage of learning opportunities at DATAPAO, meaning that you'll get access to Databricks' public and internal courses to learn all the tricks of Distributed Data Processing, MLOps, Apache Spark, Databricks, and Cloud Migration from the best. Additionally, we'll pay for various data & cloud certifications, you'll get dedicated time for learning during work hours, and access to our internal library;
• Flexible PTO days - we’re flexible with how many days you take off if that does not conflict with customer success and the work getting done;
• 4 weeks of paternity leave - because we think it’s important for both parents to be there when it matters the most;
• Employee Assistance Program (EAP) - life always happens! And we'd like to be there for you when it counts the most. Through EAP, we offer our employees access to psychology, financial, and legal consulting services via phone or in person;
• Pension scheme enrollment and a comprehensive private health insurance plan - offered via our EOR (Employer of Record) provider, Remote.com. Remote will be your official employer in the UK for the foreseeable future until we establish our own legal entity in the UK;
• Top-notch working equipment - working comfortably means working well. You will get a MacBook Pro, a phone, and a sign-up bonus of 1000 GBP gross (to be paid with your first payroll) to set up your home office or whatever else is needed to give your best;
• The chance to make an impact in a high-transparency culture - open feedback and no politics are things we value a lot at DATAPAO. Additionally, you'll get the chance to work in the field of data & AI and shape the future of a rapidly growing tech company.

IMPORTANT NOTE: Given that we are still sorting our ways out in the UK, this list will likely get an update in the following months, and we're also committed to growing it with us over time.

The gross salary for this position ranges from 70.000 to 100.000 GBP/year, depending on your assessed seniority level during the selection process.

@DATAPAO we are delivery partners and the preferred training provider for Databricks, the creators of Apache Spark. Additionally, we are Microsoft Gold Partners in delivering cloud migration and data architecture on Azure. Our delivery partnerships enable us to work in a wide range of industries and with some of the most prominent global companies such as Norsk-Hydro, Johnson&Johnson, Richter, Bayer, Shell, Essity, and Vonage to name just a few.

As a training provider, we deliver onsite and online courses globally for Databricks and on our own. We have been teaching professionals at Apple, Amazon, Uber, Microsoft, T-Mobile, GE, Ericsson, and many more to improve their impact with data.

We’re strong believers in scaling up a team without judgment or prejudice. What we really care about is working with the best people out there, no matter their background. And you should also not worry if you don't tick every single box in the requirements. If you’re passionate about data and learning new things you’ll fit right in, and we'd love to hear back from you.

And when we hear back from you we'd like for you to know that we are committed to your privacy and to keeping your data safe with us. We do not share your data with any third parties (except the ones we use to run our recruitment process) and keep your application for two years unless you ask us otherwise. We use your data solely for recruitment purposes like letting you know about new career opportunities at DATAPAO and/or managing your application.

If you want to find out more, you can always follow us on LinkedIn for all the good stuff or just hit our recruitment team at [e-mail]

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology, Consulting, and Engineering

• Industries

  Software Development, IT Services and IT Consulting, and Technology, Information and Internet

Referrals increase your chances of interviewing at DATAPAO by 2x

Sign in to set job alerts for “Data Engineer” roles.

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 2 months ago

Bristol, England, United Kingdom 2 months ago

London, England, United Kingdom 1 month ago

Manchester, England, United Kingdom 2 months ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 4 months ago

London, England, United Kingdom 6 days ago

London, England, United Kingdom 2 weeks ago

Edinburgh, Scotland, United Kingdom 1 day ago

Data Engineer – SQL + Python - Big tech sector experience

City Of Bristol, England, United Kingdom £50,000.00-£70,000.00 2 weeks ago

City Of London, England, United Kingdom 1 week ago

London, England, United Kingdom 1 month ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.