Staff Data Engineer — Scale Real-Time Pipelines (Hybrid)

Sponsor Finder; Greater London; Hybride; GBP 90 000 - 125 000; Plein temps

Résumé du poste

Sparta Commodities is building the next generation of commodity trading platforms and seeks a Staff Data Engineer. You will own scalable ETL pipelines, shape platform architecture, and mentor engineers while collaborating with stakeholders across product teams.

Hybrid work style with in-office days in the UK or Spain, and close alignment with real-time and analytical data needs for traders worldwide.

Qualifications

• 7+ years in data or software engineering delivering production data systems.
• 2+ years in a product-focused organisation with cross-functional teams.
• Proven experience building and scaling data pipelines in production.
• Deep understanding of stream and batch processing with Flink or Spark.
• Proficiency across Kotlin, Python, and TypeScript.
• Experience designing and deploying data infra in AWS or GCP.
• Hands-on with data infra tooling: Kafka, Redis, PostgreSQL.

Responsabilités

• Lead design, build and evolution of scalable data pipelines and ETL.
• Own health, latency, throughput, and reliability of the data platform.
• Collaborate with engineering and stakeholders to align data infra with product goals.
• Drive architectural decisions for reliability and scalability.
• Define target architecture for data ingestion, transformation, storage, and serving.
• Mentor engineers through reviews, discussions, and knowledge sharing.

Connaissances

7+ years experience

Product-focused

Data-intensive pipelines

Stream/batch processing

Kotlin

Python

TypeScript

Cloud infrastructure

Data infra tooling

Outils

Flink

Spark

Kafka

Redis

PostgreSQL

Description du poste

Sparta Commodities is building the next generation of commodity trading platforms and seeks a Staff Data Engineer. You will own scalable ETL pipelines, shape platform architecture, and mentor engineers while collaborating with stakeholders across product teams.

Hybrid work style with in-office days in the UK or Spain, and close alignment with real-time and analytical data needs for traders worldwide.