Senior Azure Databricks Data Engineer | Commodities & Energy Trading | Greenfield Next-Gen Lake[...]

VirtueTech Recruitment Group; England; On-site; GBP 99,000 - 121,000; Full time

Job summary

A leading recruitment agency is looking for a Senior Azure Databricks Data Engineer specializing in energy and commodities trading. This hybrid role based in London offers a competitive salary of up to £110K plus bonuses and benefits. You will architect scalable data solutions and guide a small team, ensuring best practices in data engineering. The ideal candidate will have strong Python skills, familiarity with Azure, and experience with tools like Snowflake and Databricks. This position is suitable for those wanting to drive the future of data infrastructure in a dynamic trading environment.

Qualifications

• Solid grasp of modern data engineering concepts and workflows.
• Familiarity with Azure and related DevOps tools.
• Strong Python programming ability.

Responsibilities

• Architect and build scalable data solutions using Snowflake and Databricks.
• Establish and champion best practices for data engineering.
• Lead a small team of engineers and collaborate with other units.

Skills

Data engineering concepts

Python programming

Azure

Data orchestration

Power BI

Tableau

Tools

Snowflake

Databricks

Synapse/Fabric

Job description

Senior Azure Databricks Data Engineer | Commodities & Energy Trading | Greenfield Next-Gen Lakehouse | Up to £110K + Bonus + Benefits

We are recruiting a senior Data Engineer for one of the world's largest and most diverse general trading companies, specializing in energy and commodities trading. The role is based in London with a hybrid working model (3 days in office per week).

As a senior member of the core engineering team, you’ll guide a small team of data engineers, designing and maintaining a modern lakehouse-based data platform that supports day‑to‑day operations and long‑term business growth.

Details for the position:

• Salary: Up to £110,000 per annum + Bonus & Benefits
• Location: London (Hybrid – 3 days in the office per week)

In this role, you will:

• Architect and build scalable data solutions using Snowflake, Databricks, Synapse/Fabric, and PySpark.
• Establish and champion best practices for data engineering, including security, performance, and maintainability.
• Lead a small team of engineers and collaborate with the Head of Core Engineering and cross‑functional business units.
• Integrate data pipelines with visualization tools such as Power BI and Tableau.
• Drive the development of a greenfield enterprise foundation that serves as a gateway for business and trading teams.

Key Responsibilities:

• Solid grasp of modern data engineering concepts and workflows.
• Familiarity with Azure and related DevOps tools.
• Strong Python programming capability.
• Knowledge of data orchestration, pipeline development, and data modelling.
• Background in connecting data platforms with visualization tools like Power BI and Tableau.

Seniority Level: Mid‑Senior

Employment Type: Full‑time

Job Function: Information Technology

We look forward to receiving applications from motivated senior data engineers eager to shape the future of data infrastructure in a dynamic trading environment.