Data Engineer - Real-Time Lakehouse (Hybrid London)

Stanford Black Limited; England; Hybrid; GBP 90.000 - 110.000; Vollzeit

Benefits dieser Stelle

Market leading Compensation and Benefit packages

Collaborative culture

Modern office in Central London

Zusammenfassung

A top market-leading Commodities Trading firm in Central London is seeking Data Engineers to join a greenfield initiative to build a modern data platform based on Lakehouse architecture. Applicants should have over 5 years of Python experience, expertise in end-to-end data Lakehouse development, and familiarity with tools like Apache Iceberg and Parquet. This full-time role offers competitive compensation in a hybrid working model, working 3 days on-site and allowing remote flexibility.

Qualifikationen

• 5+ years of Python development experience in an enterprise environment.
• Experienced with end-to-end involvement in building a data Lakehouse.
• Able to work in a modern software engineering environment.

Aufgaben

• Process real-time data streams and create scalable ingestion and transformation workflows.
• Define architecture and set engineering best practices.
• Drive the firm's transition to a modern data platform.

Kenntnisse

Python development

Data Lakehouse technologies

Agile methodology

DevOps tools

Ausbildung

Computer Science or Engineering background

Tools

Apache Iceberg

Parquet

Apache Hudi

Spark

Jobbeschreibung

A top market-leading Commodities Trading firm in Central London is seeking Data Engineers to join a greenfield initiative to build a modern data platform based on Lakehouse architecture. Applicants should have over 5 years of Python experience, expertise in end-to-end data Lakehouse development, and familiarity with tools like Apache Iceberg and Parquet. This full-time role offers competitive compensation in a hybrid working model, working 3 days on-site and allowing remote flexibility.