Senior Data Platform Engineer

DEPOP; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid working options

Dog-friendly offices

Life Insurance

Pension matching

Free shipping on Depop

Job summary

Depop is seeking a Senior Data Platform (Enablement) Engineer to architect, build, and scale our data platform in London or remotely. You will empower teams to own, process, query and manage data with self-service capabilities.

You will work with data scientists, ML engineers, analytics engineers and other data teams to promote self-service tools, data governance, and robust pipelines using Databricks, Airflow and dbt.

Qualifications

• Experience with streaming ecosystems (Kafka, Flink, Confluent)
• Strong programming skills in Python or Scala
• Experience delivering data compliance & privacy solutions
• Experience with data governance, observability, data lineage
• Proven design/build of production-grade data platforms
• Experience with Airflow, dbt, Databricks and data observability/catalogue solutions
• Cloud familiarity: AWS, GCP, Azure
• Eagerness to learn and grow with dedicated time and resources

Responsibilities

• Pave data-as-a-product by introducing governance and observability tooling
• Develop microservices and data pipelines
• Design platform services enabling secure data access
• Lead initiatives with data scientists and ML engineers
• Uphold operational excellence with scalable services and incident response
• Collaborate with stakeholders to implement data solutions
• Mentor teammates and promote engineering standards
• Contribute to Depop's data culture and best practices

Skills

Streaming systems

Python

Scala

Data governance

Cloud platforms

Data products

Mentoring

Tools

Airflow

dbt

Databricks

Kafka

Terraform

Docker

Job description

Data is at the heart of what we do.

Depop is looking for a Senior Data Platform (Enablement) Engineer to help architect, build, and scale our data platform, empowering teams with self-serve capabilities. You'll combine hands-on technical expertise with strategic thinking to shape the foundation that supports our products and customers, enabling teams own, process, query, and manage their data with efficiency and ease.

You will work closely with people from a wide variety of domains: Product Data Scientists, Analytics Engineers, ML Engineers, MLOps, MarTech and other Data Engineering teams. You will help manage our growing data needs and support increasingly complex business problems by building and promoting self-service tools and data best practices that will be used across the organisation, including taking ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy).

You'll work with a modern, cutting-edge data stack and play a key role in shaping data-as-a-product practices. As we scale to meet Depop's bold growth ambitions, you'll help introduce the next generation of data capabilities.

Want to find out more about Depop & our engineering team?

We write about technology, people and smart engineering right here - https://engineering.depop.com/

What You'll Do

• Pave a path for data as product: Champion data as a first-class citizen by introducing robust data observability and governance tooling into the platform
• Software engineering: Develop microservices, libraries, data pipelines
• Technical design: implement and evolve platform services that enable teams to work with data efficiently and securely, using modern tooling such as Kafka, Terraform, Docker, and cloud-native patterns
• Lead technical initiatives: Lead initiatives working with end users: data scientists, ML engineers, analytics engineers, product engineers and beyond to enable, support and accelerate their data needs, embracing a platform as product mindset
• Uphold operational excellence: building scalable services, leading incident response and root cause analysis, and continuously improving the health and performance of our data platform. Champion scalable best practices through automation, clear documentation, and knowledge sharing via tutorials and training sessions
• Stakeholder collaboration: Work closely with both technical and non-technical stakeholders to define, design, and implement solutions within our Data Platform. Trusted relationship will be key for success
• Invest in others' growth: Mentoring and sharing knowledge, helping elevate technical standards and fostering a culture of continuous improvement
• Build on engineering culture You take an active role in improving the engineering culture at Depop and encourage others around you to follow these values

What You'll Bring

• Streaming knowledge: Experience with Kafka/Flink/Confluent or other streaming ecosystems, with a solid understanding of their components
• Advanced knowledge in a high-level programming language (e.g. Python, Scala) with solid foundation in software engineering best practices - testing, clean coding standards, code reviews, pair programming, automation-first mindset
• Experience delivering data compliance & privacy solutions, ensuring that we uphold data subject rights for our customers
• Experience introducing a data governance & observability stack enabling rich data lineage, data contracts, SLA/SLO, tagging and data quality monitoring capabilities both on our own platform but also for data owners
• Proven experience designing, building, and scaling data platforms and backend infrastructure in production environments - have worked to enable advanced data users: ML Engineers, analysts, analytics engineers and have a strong grasp of their needs and how they operate
• Big data technologies, with expertise in tools & platforms such as Airflow, dbt, Kafka, Databricks and data observability & catalogue) solutions (e.g. Monte Carlo, Atlan, Datahub)
• Cloud Platform proficiency: familiarity with AWS, GCP, or Microsoft Azure, with hands-on experience building scalable, reliable data solutions on cloud platforms
• A passion for learning new things and keeping on top of the latest developments and technologies in our field. We take pride in our learning and make sure to have dedicated time set aside for our growth and development (we offer personal development time and other platforms to share knowledge with your peers)

Nice To Have

• Knowledge of systems design within a modern cloud-based environment
• Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi
• Experience working with lakehouse / medallion architectures in Databricks
• Experience with experimentation support tooling (such as Optimizely)

Additional information

• Health + Mental Wellbeing PMI and cash plan healthcare access with Bupa Subsidised counselling and coaching with Self Space Cycle to Work scheme with options from Evans or the Green Commute Initiative Employee Assistance Programme (EAP) for 24/7 confidential support Mental Health First Aiders across the business for support and signposting Work/Life Balance: 25 days annual leave with option to carry over up to 5 days 1 company-wide day off per quarter Impact hours: Up to 2 days additional paid leave per year for volunteering Fully paid 4 week sabbatical after completion of 5 years of consecutive service with Depop, to give you a chance to recharge or do something you love.
• Flexible Working: MyMode hybrid-working model with Flex, Office Based, and Remote options *role dependant All offices are dog-friendly Ability to work abroad for 4 weeks per year in UK tax treaty countries
• Family Life: 18 weeks of paid parental leave for full-time regular employees IVF leave, shared parental leave, and paid emergency parent/carer leave Learn + Grow: Budgets for conferences, learning subscriptions, and more Mentorship and programmes to upskill employees Your Future: Life Insurance (financial compensation of 3x your salary) Pension matching up to 6% of qualifying earnings Depop Extras: Employees enjoy free shipping on their Depop sales within the UK.
• Special milestones are celebrated with gifts and rewards!