Data Engineer

Insight Global; London; Hybrid; GBP 60,000 - 100,000; Full time

Job summary

An established industry player is seeking a Senior Data Engineer to join their dynamic European Trading team in London. This role offers the opportunity to lead innovative data-driven projects, collaborating closely with traders and quantitative analysts to enhance analytics and reporting solutions. The ideal candidate will have a strong background in Python, C#, and Azure, along with experience in building data pipelines and optimizing workflows. With a focus on collaboration and problem-solving, this role promises to be both challenging and rewarding, offering a chance to make a significant impact in a fast-paced environment.

Benefits

Medical insurance

Dental insurance

Vision insurance

HSA account options

FSA account options

401k retirement account access with employer matching

Qualifications

• Expert-level knowledge of Python, C#, .NET, Databricks, and Azure.
• Proficient in SQL with experience in designing databases and writing complex queries.

Responsibilities

• Lead the design and development of data-driven software solutions.
• Migrate existing applications and optimize data pipelines in Databricks.

Skills

Python

C#

.NET

Databricks

Azure

SQL

Git

CI/CD

Agile/Scrum

Problem-solving

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science, Engineering, or related field

Tools

Databricks

Azure Data Factory

Azure Synapse

Dash Plotly

scikit-learn

PyTorch

TensorFlow

Job description

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python, C#, .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work independently with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning features to serve trading and analytics needs.

The Senior Data Engineer will also collaborate with quantitative analysts, traders, and commercial stakeholders to design new application features, dashboards, and analytics for portfolio management, pricing, and risk analysis. Additionally, they will support broader IT initiatives by ensuring compliance with corporate standards, best practices, and robust architectural design. This position will be officially managed by the IT department but will work very closely with the trading team. It requires strong problem-solving skills, a willingness to learn new technologies and markets, and the ability to thrive in a highly collaborative, agile environment. Excellent communication and collaboration skills are essential, along with proven experience in the relevant technologies and processes.

This position is 3 days a week onsite in Mayfair, London. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.

Must Haves:

• Strong Python, C#, .NET development skills – proven ability to write efficient, production-quality code (e.g., data structures, error handling, code optimization).
• Proficiency in SQL – comfortable designing databases, writing complex queries, and handling performance tuning.
• Experience with Databricks (or a comparable Spark environment) – ability to build data pipelines, schedule jobs, and create dashboards/notebooks.
• Experience with Azure services (Data Factory, Synapse, or similar) and knowledge of cloud-based data solutions.
• Familiarity with version control (Git), CI/CD pipelines, and Agile/Scrum methodologies.
• Ability to communicate technical topics to non-technical stakeholders.
• Demonstrated problem-solving capabilities and willingness to learn new technologies, markets, and business concepts.

Plusses:

• Exposure to Dash Plotly (or similar Python frameworks like Streamlit) for dashboard creation.
• Experience with Machine Learning model development and data science workflows (including frameworks such as scikit-learn, PyTorch, or TensorFlow).
• Experience in Quantitative Finance or strong interest in mathematical/financial modeling, derivatives pricing, or algorithmic trading.
• Familiarity with ETRM platforms (e.g., OpenLink Endur).
• Master’s degree in computer science, Engineering, or a related technical field.
• Experience building highly scalable data applications in a cloud environment.

Send me alerts about jobs like this.

Please enter your email address to continue setting up an email alert for similar jobs to this one. By entering your email address and clicking apply you will sign up to Jobs4 and agree to our terms and conditions .

Job Overview

ID:

1459859

Date Posted:

Posted 1 day ago

Expiration Date:

30/05/2025

Location:

London

Competitive

Send me alerts about jobs like this.

Please enter your email address to continue setting up an email alert for similar jobs to this one. By entering your email address and clicking apply you will sign up to Jobs4 and agree to our terms and conditions .

Share

Complete the form below to send this job to a friend.

Job Location

Complete the form below to report this job.