Senior Data Engineer - Data Platform

Spotify; Greater London; Hybrid; GBP 70,000 - 95,000; Full time

Job summary

Spotify in London is seeking an experienced Data Engineer to join the Data Platform. You will collaborate with product and engineering teams to build data infrastructure and datasets, and design systems that handle large-scale user behaviour data.

You will power personalization and recommendations by ensuring reliable data pipelines, modeling data and maintaining scalable architectures. Some in-person meetings will occur with flexible work-from-home options, fitting a hybrid setup.

Qualifications

• Experienced Data Engineer with backend Java development
• Proficient in SQL and BigQuery
• Experience with JVM data processing frameworks (Flink, Beam, Dataflow, Spark)
• Familiar with DevOps, cloud infra, containers and Kubernetes fundamentals
• Experience in data modeling and schema design
• Commitment to high-quality code and CI/CD practices
• Comfort with experimentation, iteration and collaborative development
• Able to navigate ambiguity and use data-driven judgment

Responsibilities

• Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
• Build systems that collect and process user behaviour data at scale.
• Power personalization and recommendation systems with reliable data pipelines.
• Design and evolve data architectures to support high data volumes and diverse internal users.
• Improve reliability, scalability, and usability of data infrastructure.
• Work across disciplines to solve complex data challenges and make an impact across Spotify.

Skills

Java

SQL

Data Modeling

CI/CD

Kubernetes

DevOps

Ambiguity handling

Tools

BigQuery

Spark

Flink

Beam

Dataflow

Job description

The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the infrastructure, tooling, frameworks, and capabilities needed to welcome a billion customers.

The Data Platform team develops and maintains the infrastructure that supports Spotify’s data ecosystem. Within Data Platform, the Data Collection product area builds infrastructure that makes it easier to collect and consume data at scale. You’ll join a team focused on making user behaviour data seamless and reliable for data teams across Spotify.

What You'll Do

• Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
• Build systems that collect and process user behaviour data at scale.
• Help power Spotify’s personalization and recommendation systems, as well as the tools teams use to build and test new features.
• Design and evolve data architectures that support high data volumes and a broad range of internal users.
• Improve the reliability, scalability, and usability of our data infrastructure.
• Work across disciplines to solve complex data challenges and make an impact across Spotify.

Who You Are

• You are an experienced Data Engineer, and proficient in backend development using Java.
• You are comfortable working with large-scale datasets using SQL and platforms such as BigQuery.
• You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark.
• You are familiar with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals.
• You have experience with data modeling and schema design.
• You care about high-quality code and engineering practices such as continuous delivery and automated testing.
• You value experimentation, iterative development, and collaborative software development practices.
• You are comfortable navigating ambiguity and open-ended problems, using data and sound judgment to make decisions.

Where You'll Be

• This role is based in London
• We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us. Find our AI notice here: https://lifeatspotify.com/ai-notice

Today, we are the world’s most popular audio streaming subscription service.