Senior Data Engineer - Real-Time Trading Data & APIs

DRW; Greater London; On-site; GBP 75,000 - 120,000; Full time

Job summary

DRW is a diversified trading firm that builds data engineering solutions to support trading activities. We own data products from concept through production and emphasize scalable batch and real-time streaming systems with robust APIs for fast data access.

We seek engineers with multi-language skills and deep experience in Linux-based high-throughput environments, plus exposure to streaming platforms like Kafka and data lake technologies such as Delta Lake or Apache Iceberg.

Qualifications

• 2+ years’ experience with Python, Java or C++ in data engineering.
• Experience with Linux, high-throughput, low-latency systems.
• Experience with Airflow or Dagster for pipelines; Kafka and data lakes.
• Bachelor's degree in CS/Math/Physics/Engineering or equivalent.

Responsibilities

• Collaborate with cross-functional teams to deliver data solutions for trading activities.
• Own data products from concept to production and guide them to stable production.
• Build and maintain batch processing and real-time streaming of time series data with high quality.
• Develop APIs for fast, intuitive retrieval of historical and live data.
• Provide on-call support as needed.

Skills

Programming in Python/Java/C++

Linux high-throughput systems

Airflow or Dagster

Kafka

Delta Lake / Iceberg

SQL / Relational databases

Education

Bachelor's or advanced degree in CS / Math / Physics / Engineering

Tools

Airflow

Kafka

Delta Lake

Apache Iceberg

Job description

DRW is a diversified trading firm that builds data engineering solutions to support trading activities. We own data products from concept through production and emphasize scalable batch and real-time streaming systems with robust APIs for fast data access.

We seek engineers with multi-language skills and deep experience in Linux-based high-throughput environments, plus exposure to streaming platforms like Kafka and data lake technologies such as Delta Lake or Apache Iceberg.