Senior Data Engineer - Data Platform

Spotify; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Spotify is seeking an experienced Data Engineer to design and build scalable data infrastructure in London. You’ll work within the Data Platform to collect, process, and enable data-driven personalization and testing. Strong backend in Java and SQL skills are required, with experience in BigQuery and JVM data frameworks.

You’ll contribute to reliable, scalable data architectures and collaborate across teams to solve complex data challenges while adhering to DevOps and CI/CD practices.

Qualifications

• You are an experienced Data Engineer with strong backend development skills in Java.
• You are comfortable working with large-scale datasets using SQL and platforms like BigQuery.
• You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark.
• You are familiar with DevOps practices, cloud infrastructure, containerized apps, and Kubernetes fundamentals.
• You have experience with data modeling and schema design.
• You value high-quality code and engineering practices like continuous delivery and automated testing.
• You thrive on experimentation, iterative development, and collaborative software practices.
• You can navigate ambiguity and use data and sound judgment to decide.

Responsibilities

• Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
• Build systems that collect and process user behaviour data at scale.
• Power Spotify’s personalization and recommendation systems and data testing tools.
• Design and evolve data architectures that support high data volumes for internal users.
• Improve reliability, scalability, and usability of data infrastructure.
• Work across disciplines to solve complex data challenges and make a global impact.

Skills

Java

SQL

Data modeling

DevOps

Kubernetes

BigQuery

Flink

Spark

Tools

Flink

Beam

Dataflow

Spark

BigQuery

Kubernetes

Job description

The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the infrastructure, tooling, frameworks, and capabilities needed to welcome a billion customers.

The Data Platform team develops and maintains the infrastructure that supports Spotify’s data ecosystem. Within Data Platform, the Data Collection product area builds infrastructure that makes it easier to collect and consume data at scale. You’ll join a team focused on making user behaviour data seamless and reliable for data teams across Spotify.

What You’ll Do

• Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
• Build systems that collect and process user behaviour data at scale.
• Help power Spotify’s personalization and recommendation systems, as well as the tools teams use to build and test new features.
• Design and evolve data architectures that support high data volumes and a broad range of internal users.
• Improve the reliability, scalability, and usability of our data infrastructure.
• Work across disciplines to solve complex data challenges and make an impact across Spotify.

Who You Are

• You are an experienced Data Engineer, and proficient in backend development using Java.
• You are comfortable working with large-scale datasets using SQL and platforms such as BigQuery.
• You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark.
• You are familiar with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals.
• You have experience with data modeling and schema design.
• You care about high-quality code and engineering practices such as continuous delivery and automated testing.
• You value experimentation, iterative development, and collaborative software development practices.
• You are comfortable navigating ambiguity and open-ended problems, using data and sound judgment to make decisions.

Where You’ll Be

• This role is based in London
• We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.