Data Infrastructure Engineer - Data Platform

Spotify; Greater London; Hybrid; GBP 65,000 - 85,000; Full time

Job summary

A leading audio streaming service in London is seeking a Data Infrastructure Engineer to join their Data Collection Product Area. You will build and maintain large-scale backend systems and data pipelines, working with technologies such as Java and Apache Beam, while ensuring efficient infrastructure. Collaborating with multi-functional agile teams, this role offers flexibility to work from home with some in-person meetings, ensuring an inclusive environment for all candidates.

Qualifications

• Experience in backend and data engineering with Java and Scala.
• Understanding of distributed systems and cloud solutions.
• Familiarity with data structures and algorithms.

Responsibilities

• Build large-scale backend systems and data pipelines.
• Ensure reliable and efficient infrastructure.
• Collaborate with cross-functional agile teams.

Skills

Java

Scala

Apache Beam

Data processing frameworks

Cloud solutions

Job description

The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the frameworks, capabilities and tools needed to welcome a billion customers. Join us and help to amplify productivity, quality and innovation across Spotify.

We are looking for a Data Infrastructure Engineer to join our team in the Data Collection Product Area. We develop the heart of Spotify’s Event Delivery infrastructure, enabling hundreds of other teams to seamlessly collect more than a Trillion events per day and consume this data to empower Spotify's existing products as well as innovation of new products.

We are heavy users of Google Cloud Pub/Sub, GKE, Dataflow and many other GCP products and work closely with Google to improve their product offering. We also rely on internal backend and data platform products, built by other squads at Spotify.

What You’ll Do

• Work on our infrastructure together with the squad, making it reliable and efficient while delivering value to data producers and consumers within Spotify.
• Build large-scale Java and Apache Beam based backend systems and batch and real-time data pipelines with data processing frameworks like Scio and Apache Beam.
• Take an active part in the operational responsibilities for our own infrastructure.
• Work in an autonomous, multi-functional agile team and collaborate with other squads in our product area to continuously iterate and deliver on new product objectives.

Who You Are

• You have experience working with backend and data engineering in Java and Scala and have an understanding of that problem space and tooling ecosystem.
• You are curious about solving technical challenges and operating business-critical, huge scale distributed systems and cloud solutions.
• You have a good understanding of quality, system design, data structures, and algorithms.
• You appreciate agile software processes, data-driven development, reliability, and responsible experimentation.
• You use standard methodologies in continuous integration and delivery.
• You work well independently and collaboratively, and are open to giving and receiving feedback in order to learn as an individual and as a team.

Where You’ll Be

• This role is based in London.
• We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.

Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.