Enable job alerts via email!

Data Engineer

Insight Global

Greater London

Hybrid

GBP 60,000 - 100,000

Full time

7 days ago

Be an early applicant

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

Job summary

An established industry player is seeking a Senior Data Engineer to join their European Trading team. This role involves leading the development of data-driven software solutions and optimizing data pipelines in Databricks. The ideal candidate will have expert knowledge in Python, C#, and Azure, and will work closely with quantitative analysts and traders to enhance application features for portfolio management and risk analysis. This position offers a collaborative environment with opportunities for innovation and growth, making it perfect for those passionate about data and technology.

Benefits

Medical insurance

Dental insurance

Vision insurance

HSA options

FSA options

401k with employer matching

Qualifications

Expert-level knowledge of Python, C#, .NET, and Databricks.
Proficiency in SQL for designing databases and writing queries.
Experience with Azure services and cloud-based data solutions.

Responsibilities

Lead design and development of data-driven software solutions.
Migrate Python-based applications from Azure SQL to Databricks.
Collaborate with trading team to shape quantitative strategies.

Skills

Python

.NET

SQL

Databricks

Azure

Git

Agile/Scrum

Problem-solving

Communication

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science or related field

Tools

Databricks

Azure Data Factory

Azure Synapse

Dash Plotly

3 weeks ago Be among the first 25 applicants

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python, C#, .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work independently with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning features to serve trading and analytics needs.

The Senior Data Engineer will also collaborate with quantitative analysts, traders, and commercial stakeholders to design new application features, dashboards, and analytics for portfolio management, pricing, and risk analysis. Additionally, they will support broader IT initiatives by ensuring compliance with corporate standards, best practices, and robust architectural design. This position will be officially managed by the IT department but will work very closely with the trading team. It requires strong problem-solving skills, a willingness to learn new technologies and markets, and the ability to thrive in a highly collaborative, agile environment. Excellent communication and collaboration skills are essential, along with proven experience in the relevant technologies and processes.

This position is 3 days a week onsite in Mayfair, London. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.

Must Haves:

Strong Python, C#, .NET development skills – proven ability to write efficient, production-quality code (e.g., data structures, error handling, code optimization).
Proficiency in SQL – comfortable designing databases, writing complex queries, and handling performance tuning.
Experience with Databricks (or a comparable Spark environment) – ability to build data pipelines, schedule jobs, and create dashboards/notebooks.
Experience with Azure services (Data Factory, Synapse, or similar) and knowledge of cloud-based data solutions.
Familiarity with version control (Git), CI/CD pipelines, and Agile/Scrum methodologies.
Ability to communicate technical topics to non-technical stakeholders.
Demonstrated problem-solving capabilities and willingness to learn new technologies, markets, and business concepts.

Plusses:

Exposure to Dash Plotly (or similar Python frameworks like Streamlit) for dashboard creation.
Experience with Machine Learning model development and data science workflows (including frameworks such as scikit-learn, PyTorch, or TensorFlow).
Experience in Quantitative Finance or strong interest in mathematical/financial modeling, derivatives pricing, or algorithmic trading.
Familiarity with ETRM platforms (e.g., OpenLink Endur).
Master’s degree in computer science, Engineering, or a related technical field.
Experience building highly scalable data applications in a cloud environment.

Seniority level

Seniority level
Mid-Senior level

Employment type

Employment type
Contract

Job function

Industries
Oil and Gas and Services for Renewable Energy

Referrals increase your chances of interviewing at Insight Global by 2x

London, England, United Kingdom 22 hours ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 3 weeks ago