Junior Data Engineer – Databricks & Azure (Energy Trading)

VirtueTech Recruitment Group; Greater London; Hybrid; GBP 27,000 - 45,000; Full time

Benefits offered by this job

Strong bonus

Benefits

Job summary

VirtueTech Recruitment Group is partnering with a leading energy and commodities trading organisation in London to hire a Junior Data Engineer. The role focuses on modernising a large-scale data platform, building scalable batch and streaming data pipelines using Databricks, Python and SQL, and supporting a migration of legacy pipelines to a modern cloud-based architecture.

The position offers a hybrid working pattern (2-3 days in the office per week) and a compensation package up to £45,000

Qualifications

• Strong hands-on experience with Databricks for building and optimising enterprise-scale data platforms.
• Python development experience for building and orchestrating high-performance data pipelines.
• Proficient SQL skills for data validation, reconciliation and performance optimisation.

Responsibilities

• Design and engineer robust ingestion frameworks and migrate existing pipelines.
• Contribute to evolution of central data platform and governance.
• Collaborate with data and analytics teams to enable scalable real-time analytics.

Skills

Databricks

Python

SQL

Kafka

Azure

Tools

Azure

Kafka

Databricks

Job description

VirtueTech Recruitment Group is partnering with a leading energy and commodities trading organisation in London to hire a Junior Data Engineer. The role focuses on modernising a large-scale data platform, building scalable batch and streaming data pipelines using Databricks, Python and SQL, and supporting a migration of legacy pipelines to a modern cloud-based architecture.

The position offers a hybrid working pattern (2-3 days in the office per week) and a compensation package up to £45,000