Backend Data Platform Engineer: Catalog & Lineage (Remote)

Lever, Inc.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

Spotify is seeking a backend data platform engineer to own data catalog, lineage, and publishing systems. You will design and operate core services and APIs behind our data catalog, ensuring correctness, performance and reliability.

Based in London or Stockholm, with flexibility to work from home and occasional in-person meetings. You will collaborate across teams, own end-to-end projects and help evolve standards for metadata and storage.

Qualifications

• Experience building and running backend services and APIs in production.
• Hands-on with SQL and data pipelines or cloud data warehouses.
• Understanding of data engineering concepts like orchestration, metadata management, data quality, governance and lineage.

Responsibilities

• Design, build and operate backend services and APIs for data catalog, lineage and publishing systems.
• Develop and run batch and streaming pipelines to keep metadata current and lineage traceable.
• Own end-to-end projects from design through delivery and production.
• Contribute to platform reliability, observability and automation, including AI tooling.

Skills

Java backend

API design

SQL

Data pipelines

Beam

Flink

Spark

Data governance

Tools

BigQuery

Snowflake

Databricks

OpenLineage

Apache Iceberg

Job description

Spotify is seeking a backend data platform engineer to own data catalog, lineage, and publishing systems. You will design and operate core services and APIs behind our data catalog, ensuring correctness, performance and reliability.

Based in London or Stockholm, with flexibility to work from home and occasional in-person meetings. You will collaborate across teams, own end-to-end projects and help evolve standards for metadata and storage.