Senior Data Engineer - Data Platform

Lever, Inc.; Greater London; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Spotify is seeking a data engineer to join the Data Platform team in London. You will collaborate with product and engineering teams to build scalable data infrastructure and datasets, enabling reliable collection and processing of user behaviour data at scale.

You will work with JVM-based frameworks, SQL and BigQuery, and contribute to personalization and recommendation systems while upholding high-quality code and CI/CD practices.

Qualifications

• Experienced Data Engineer with backend Java development.
• Skilled with large-scale datasets using SQL and BigQuery.
• Experience with JVM data frameworks: Flink, Beam, Dataflow, or Spark.
• Familiar with DevOps, cloud infra, containers and Kubernetes.
• Proficient in data modeling and schema design.
• Commitment to high-quality code, CD and automated testing.
• Appreciates experimentation, iteration, and collaborative work.
• Comfortable with ambiguity and data-driven decision making.

Responsibilities

• Collaborate with product and engineering teams to build data infrastructure.
• Build systems that collect and process user behaviour data at scale.
• Support personalization and recommendation tools with reliable data.
• Design data architectures for high data volumes and broad user base.
• Improve reliability, scalability, and usability of data infrastructure.
• Work across disciplines to solve data challenges and make impact.

Skills

Java

SQL

BigQuery

Flink

Spark

Kubernetes

Cloud platforms

Data modeling

DevOps

Testing/CD

Tools

BigQuery

Spark

Flink

Beam

Dataflow

Kubernetes

Job description

The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the infrastructure, tooling, frameworks, and capabilities needed to welcome a billion customers.

The Data Platform team develops and maintains the infrastructure that supports Spotify’s data ecosystem. Within Data Platform, the Data Collection product area builds infrastructure that makes it easier to collect and consume data at scale. You’ll join a team focused on making user behaviour data seamless and reliable for data teams across Spotify.

What You’ll Do

• Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
• Build systems that collect and process user behaviour data at scale.
• Help power Spotify’s personalization and recommendation systems, as well as the tools teams use to build and test new features.
• Design and evolve data architectures that support high data volumes and a broad range of internal users.
• Improve the reliability, scalability, and usability of our data infrastructure.
• Work across disciplines to solve complex data challenges and make an impact across Spotify.

Who You Are

• You are an experienced Data Engineer, and proficient in backend development using Java.
• You are comfortable working with large-scale datasets using SQL and platforms such as BigQuery.
• You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark.
• You are familiar with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals.
• You have experience with data modeling and schema design.
• You care about high-quality code and engineering practices such as continuous delivery and automated testing.
• You value experimentation, iterative development, and collaborative software development practices.
• You are comfortable navigating ambiguity and open-ended problems, using data and sound judgment to make decisions.

Where You’ll Be

• This role is based in London
• We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.