Senior Data Engineer - Azure Data Platform (Energy Trading)

Eaglecliff Recruitment; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

Eaglecliff Recruitment seeks a Senior Data Engineer with strong hands-on Azure experience to drive a data-centric project for a Global Energy Company. The role emphasizes data-driven thinking beyond IT, engaging business stakeholders and trading-focused data environments.

Key skills include Azure Databricks, PySpark, Python workflows, FastAPI APIs, Delta Lake, Medallion architecture, and Azure tools like Data Factory and ADLS. Trading experience is advantageous.

Qualifications

• Hands-on experience with Azure Databricks and PySpark.
• Python for data engineering workflows.
• Production APIs with FastAPI experience.
• Delta Lake and Medallion architecture knowledge.
• Azure Data Factory, ADLS and the Azure ecosystem familiarity.
• SQL, Git and CI/CD pipelines proficiency.
• Strong data quality focus and problem-solving skills.

Responsibilities

• Architect and implement data pipelines in Azure cloud.
• Collaborate with trading, energy, and business stakeholders to enable data-driven decisions.
• Build and maintain APIs and data services for production use.
• Ensure data quality and robust CI/CD for data workloads.

Skills

Python

PySpark

FastAPI

Data quality

Tools

Azure Databricks

Delta Lake

Medallion architecture

Azure Data Factory

ADLS

SQL

Git

CI/CD

Azure ecosystem

Job description

Eaglecliff Recruitment seeks a Senior Data Engineer with strong hands-on Azure experience to drive a data-centric project for a Global Energy Company. The role emphasizes data-driven thinking beyond IT, engaging business stakeholders and trading-focused data environments.

Key skills include Azure Databricks, PySpark, Python workflows, FastAPI APIs, Delta Lake, Medallion architecture, and Azure tools like Data Factory and ADLS. Trading experience is advantageous.