Data Engineer - Real-Time Lakehouse (Hybrid London)

Stanford Black Limited; England; Hybrid; GBP 90,000 - 110,000; Full time

Benefits offered by this job

Market leading Compensation and Benefit packages

Collaborative culture

Modern office in Central London

Job summary

A top market-leading Commodities Trading firm in Central London is seeking Data Engineers to join a greenfield initiative to build a modern data platform based on Lakehouse architecture. Applicants should have over 5 years of Python experience, expertise in end-to-end data Lakehouse development, and familiarity with tools like Apache Iceberg and Parquet. This full-time role offers competitive compensation in a hybrid working model, working 3 days on-site and allowing remote flexibility.

Qualifications

• 5+ years of Python development experience in an enterprise environment.
• Experienced with end-to-end involvement in building a data Lakehouse.
• Able to work in a modern software engineering environment.

Responsibilities

• Process real-time data streams and create scalable ingestion and transformation workflows.
• Define architecture and set engineering best practices.
• Drive the firm's transition to a modern data platform.

Skills

Python development

Data Lakehouse technologies

Agile methodology

DevOps tools

Education

Computer Science or Engineering background

Tools

Apache Iceberg

Parquet

Apache Hudi

Spark

Job description

A top market-leading Commodities Trading firm in Central London is seeking Data Engineers to join a greenfield initiative to build a modern data platform based on Lakehouse architecture. Applicants should have over 5 years of Python experience, expertise in end-to-end data Lakehouse development, and familiarity with tools like Apache Iceberg and Parquet. This full-time role offers competitive compensation in a hybrid working model, working 3 days on-site and allowing remote flexibility.