Data Engineer

Stanford Black Limited; England; Hybrid; GBP 90,000 - 110,000; Full time

Benefits offered by this job

Market leading Compensation and Benefit packages

Collaborative culture

Modern office in Central London

Job summary

A top market-leading Commodities Trading firm in Central London is seeking Data Engineers to join a greenfield initiative to build a modern data platform based on Lakehouse architecture. Applicants should have over 5 years of Python experience, expertise in end-to-end data Lakehouse development, and familiarity with tools like Apache Iceberg and Parquet. This full-time role offers competitive compensation in a hybrid working model, working 3 days on-site and allowing remote flexibility.

Qualifications

• 5+ years of Python development experience in an enterprise environment.
• Experienced with end-to-end involvement in building a data Lakehouse.
• Able to work in a modern software engineering environment.

Responsibilities

• Process real-time data streams and create scalable ingestion and transformation workflows.
• Define architecture and set engineering best practices.
• Drive the firm's transition to a modern data platform.

Skills

Python development

Data Lakehouse technologies

Agile methodology

DevOps tools

Education

Computer Science or Engineering background

Tools

Apache Iceberg

Parquet

Apache Hudi

Spark

Job description

Get AI-powered advice on this job and more exclusive features.

Stanford Black Limited provided pay range

This range is provided by Stanford Black Limited. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from Stanford Black Limited

Compensation up to £100,000

Hybrid working 3 days on site Central London

A top market leading Commodities Trading Firm is looking for Data Engineers to join a greenfield initiative to build a brand-new data platform on the principles of a modern data Lakehouse architecture.

In this role, you will be a key member in the processing of real-time data streams and create scalable ingestion and transformation workflows using Python, SQL, and modern Lakehouse technologies such as Iceberg, Parquet, and Apache Hudi.

This is a rare opportunity to join at an early stage and become one of the most senior technical contributors, helping define architecture, set engineering best practices, and drive the firm's transition to a modern data platform that underpins critical trading decisions.

Required

• 5+ years of Python development experience in an enterprise environment.
• Experienced with end-to-end involvement in building a data Lakehouse.
• Solid knowledge of related data Lakehouse technologies like Parquet, Apache Iceberg, Apache Hudi, Spark (or similar).
• Strong Computer Science, Engineering (or a related subject) background.
• Able to work in a modern software engineering environment, using Agile and DevOps methodologies and tools including Scrum, git and CI/CD.
• Market leading Compensation and Benefit packages.
• Working in a modern office in the heart of London, with the ability to work from home when required.
• The opportunity to work for a top Commodities Trading firm in an incredibly collaborative culture.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology and Engineering

Referrals increase your chances of interviewing at Stanford Black Limited by 2x

Sign in to set job alerts for “Data Engineer” roles.

London, England, United Kingdom