Python Data Engineer (Front Office Trading)

Bonhill Partners; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

Bonhill Partners in London is seeking a hands-on Python Data Engineer to join the Front Office Data Engineering team. You'll design and build data pipelines and data products for trading applications, collaborating with traders and analysts.

The role emphasizes real-time data processing, application development and Python-based visualisation, enabling end-to-end ownership of solutions in a global trading environment.

Qualifications

• Strong SQL skills and experience with relational databases.
• Experience with data orchestration tools such as Airflow, Dagster or Prefect.
• Experience building applications, data products or technical solutions from scratch.
• Exposure to cloud environments such as Azure, AWS or GCP.
• Good understanding of application architecture and software engineering principles.
• Experience working with large datasets, data pipelines and complex data workflows.
• Strong communication skills, with the ability to work effectively with both technical and non-technical stakeholders.
• Experience taking ownership of development projects and delivering solutions through to completion.
• Experience developing Python-based dashboards and applications using Streamlit, Plotly Dash or similar frameworks.
• Exposure to streaming technologies such as Kafka or Azure Event Hubs.
• Experience with Docker, Kubernetes and containerisation.
• Familiarity with Azure services, including Blob Storage, Application Insights and Key Vault.
• Experience with CI/CD pipelines, Azure DevOps or similar development tools.
• Knowledge of database ORM frameworks such as SQLAlchemy.
• Experience working with Git and source control, with a personal GitHub profile or examples of development projects beneficial.
• Background within commodities, energy trading or wider Financial Services.
• Experience with Tableau or other data visualisation platforms.

Responsibilities

• Design, develop and maintain scalable data pipelines supporting Front Office trading applications and business processes.
• Build and enhance Python-based applications and data products used by traders and trading analysts.
• Work with large datasets and data streams, supporting both batch processing and real-time data requirements.
• Develop and optimise SQL queries, database schemas and data models.
• Implement and manage data workflows using orchestration tools such as Airflow, Dagster or Prefect.
• Develop interactive dashboards and data visualisations using Python frameworks such as Streamlit or Plotly Dash.
• Work closely with traders, analysts and wider business stakeholders to understand requirements and translate them into effective technical solutions.
• Take ownership of applications and projects end-to-end, from initial design and development through to testing, deployment and ongoing support.
• Contribute to technical design and application architecture decisions.
• Implement data quality controls, monitoring and alerting to ensure the reliability and accuracy of data products.
• Participate in code reviews and promote best practices across Python development and data engineering.
• Work with DevOps processes, supporting CI/CD, application deployment and ongoing operational management.

Skills

Python

SQL

Data pipelines

Front Office trading

Cloud (Azure/AWS)

Docker/Kubernetes

Streamlit/Plotly Dash

Airflow/Dagster/Prefect

Git

Education

Bachelor's degree in CS/SE/Math

Tools

Airflow

Dagster

Prefect

Docker

Kubernetes

Plotly Dash

Streamlit

Azure/AWS

Job description

Location: London (Hybrid – 3 days per week in office)

We are supporting a leading global energy trading business in the search for a Python Data Engineer to join its Front Office Data Engineering team. This is an excellent opportunity for a hands-on Python Developer or Data Engineer to work on business-critical trading applications, build innovative data products and take ownership of solutions from the ground up.

Working closely with traders, trading analysts and technical stakeholders, you'll play a key role in developing data-driven applications that support trading decisions and wider business processes. The team works with large volumes of internal and external data, supporting a range of Front Office applications, including analytical and prediction tools.

The business is continuing to expand its data capabilities, with a growing focus on real-time data processing, application development and Python-based visualisation. This is a role offering genuine ownership, technical variety and the opportunity to see the direct impact of your work within a global trading environment.

Key Responsibilities:

• Design, develop and maintain scalable data pipelines supporting Front Office trading applications and business processes.
• Build and enhance Python-based applications and data products used by traders and trading analysts.
• Work with large datasets and data streams, supporting both batch processing and real-time data requirements.
• Develop and optimise SQL queries, database schemas and data models.
• Implement and manage data workflows using orchestration tools such as Airflow, Dagster or Prefect.
• Develop interactive dashboards and data visualisations using Python frameworks such as Streamlit or Plotly Dash.
• Work closely with traders, analysts and wider business stakeholders to understand requirements and translate them into effective technical solutions.
• Take ownership of applications and projects end-to-end, from initial design and development through to testing, deployment and ongoing support.
• Contribute to technical design and application architecture decisions.
• Implement data quality controls, monitoring and alerting to ensure the reliability and accuracy of data products.
• Participate in code reviews and promote best practices across Python development and data engineering.
• Work with DevOps processes, supporting CI/CD, application deployment and ongoing operational management.

Required Experience:

• Strong SQL skills and experience working with relational databases.
• Experience with data orchestration tools such as Airflow, Dagster or Prefect.
• Experience building applications, data products or technical solutions from scratch.
• Exposure to cloud environments such as Azure, AWS or GCP.
• Good understanding of application architecture and software engineering principles.
• Experience working with large datasets, data pipelines and complex data workflows.
• Strong communication skills, with the ability to work effectively with both technical and non-technical stakeholders.
• Experience taking ownership of development projects and delivering solutions through to completion.
• Experience developing Python-based dashboards and applications using Streamlit, Plotly Dash or similar frameworks.
• Exposure to streaming technologies such as Kafka or Azure Event Hubs.
• Experience with Docker, Kubernetes and containerisation.
• Familiarity with Azure services, including Blob Storage, Application Insights and Key Vault.
• Experience with CI/CD pipelines, Azure DevOps or similar development tools.
• Knowledge of database ORM frameworks such as SQLAlchemy.
• Experience working with Git and source control, with a personal GitHub profile or examples of development projects beneficial.
• Background within commodities, energy trading or wider Financial Services.
• Experience with Tableau or other data visualisation platforms.

Ideal Candidate:

You are a hands-on Python Developer, Data Engineer or Software Engineer who enjoys building applications and solving complex data challenges. You have strong Python and SQL fundamentals and can demonstrate experience taking ownership of technical solutions, ideally building applications from scratch rather than simply maintaining existing systems.

You'll be comfortable working directly with traders and business stakeholders, understanding their requirements and translating them into practical technical solutions. Strong communication skills are important, alongside the ability to work independently, manage priorities and take projects through to completion.

We're ideally looking for candidates with 4+ years' relevant experience, although we're open to more junior individuals who demonstrate exceptional technical ability and a strong academic background in Computer Science, Mathematics, Engineering or a similar discipline.

A commodities or energy trading background would be advantageous but is not essential. We're equally interested in strong engineers from investment banking, financial services, technology or other data-intensive environments.

The real attraction here is the opportunity to build and own business-critical applications within a global trading business. You'll be working closely with the Front Office, developing solutions that directly support trading activity, while having the technical freedom to influence how applications and data products are built and developed.