Data Lead

UBS; Greater London; On-site; GBP 90,000 - 140,000; Full time

Job summary

UBS is seeking a senior data engineer to lead the Rates Principal Algo Data team in London. You will architect and operate large-scale data pipelines, leverage AI-enhanced workflows, and collaborate closely with quants, risk managers and traders to deliver robust analytics platforms.

The role requires 8+ years of production data engineering experience, strong Python, and hands-on expertise with Azure, Delta tables, Spark, and containerised workloads. An agile, collaborative culture awaits.

Qualifications

• 8+ years of hands-on data engineering in production environments, with strong Python used for reliable, well-tested systems.
• Design and operation of large-scale ETL/ELT pipelines with orchestration and reliability patterns.
• Deep experience with Azure including AKS, Helm, EventHub, observability tools and Terraform.

Responsibilities

• Lead development and maintenance of our Rates Principal Algo Data analytics platform.
• Collaborate with quants, risk managers and traders to deliver trustworthy data products.
• Drive automation and performance improvements in a fast-paced trading environment.

Skills

Python

ETL pipelines

Airflow

Prefect

Azure

AKS

Terraform

Delta tables

DuckDB

Apache Spark

PostgreSQL

KDB

Docker

Kubernetes

JupyterHub

PowerBI

Streamlit

Marimo

Batch processing

CI/CD for data pipelines

AI & prompt-driven workflows

Tools

Airflow

Prefect

Azure

AKS

Terraform

Delta tables

DuckDB

Apache Spark

PostgreSQL

KDB

Docker

Kubernetes

JupyterHub

PowerBI

Streamlit

Marimo

Job description

Job Type

Full Time

Job Reference #

344198BR

City

London

Key Responsibilities

• Are you excited by the prospect of engineering solutions in Rates Principal Algo Trading team? Are you passionate about building and delivering AI solutions?
• We are seeking a talented and self-driven candidate to join and lead our Rates Principal Algo Data team within UBS Global Markets
• This is a fast paced and collaborative team that are responsible for the development and enhancement of our growing trading analytics platform

The team

• A highly technical and innovative team leading automated trading in e‑Rates
• Focused on maximising automation and performance in order to drive e‑Trading revenues
• Operating in a highly agile manner, releasing to production multiple times per day
• The team is known for being collaborative and diverse, with a mandate to deliver meaningful change

Your Skills And Experience

• 8+ years of hands‑on data engineering in production environments, with strong, idiomatic Python used for reliable, well‑tested systems (not exploratory notebooks).
• Design and operation of large‑scale ETL/ELT pipelines, including orchestration (Airflow, Prefect, or similar) and reliability patterns such as retries, backfills, and exactly‑once semantics.
• Deep experience with Azure, including AKS, Helm, EventHub, observability tools (e.g. Log Analytics) and infrastructure‑as‑code (e.g. Terraform).
• Advanced experience operating Delta tables at scale, covering transaction semantics, schema evolution, partitioning, and compaction, alongside highly optimised analytical query execution using DuckDB or Apache Spark.
• Production‑grade relational database expertise, particularly PostgreSQL (query tuning, indexing, partitioning, replication, and schema design across OLTP and analytics).
• Strong KDB experience, covering key concepts such as tp/ctp/rdb/hdb and differences between real‑time vs historical queries and usage of gateways.
• Containerised data workloads using Docker and Kubernetes, with reproducible, environment‑agnostic deployment of data infrastructure.
• Analytical data modelling expertise including dimensional models or data vaults, schema evolution, slowly changing dimensions, and downstream impact analysis.
• Strong experience managing and troubleshooting environments based on visualization and data analytics technologies such as JupyterHub, PowerBI, Streamlit and Marimo.
• Batch and streaming processing proficiency, including late data handling, watermarking, backfills, and explicit throughput vs. latency trade‑offs.
• Production data reliability and observability mindset, covering lineage, data quality checks, SLAs, CI/CD for data pipelines, and close collaboration with quants, risk managers, and traders to deliver trustworthy data products.
• 2+ years of experience in Java, covering react‑based applications.
• Experience delivering business facing solutions enhanced by AI and using AI assisted development (including prompt driven workflows and MCP servers) to reduce context switching and accelerate reliable delivery.
• You’re curious to explore how AI can improve how we build, deliver, and optimise workflows. You do this with sound judgment – validating outputs and aligning with policies, risk standards, and ethical use.

About Us

UBS is a leading and truly global wealth manager and the leading universal bank in Switzerland. We also provide diversified asset management solutions and focused investment banking capabilities. Headquartered in Zurich, Switzerland, UBS is present in more than 50 markets around the globe.

We know that great work is never done alone. That’s why we place collaboration at the heart of everything we do. Because together, we’re more than ourselves.

Join us

At UBS, we know that it's our people, with their diverse skills, experiences and backgrounds, who drive our ongoing success. We’re dedicated to our craft and passionate about putting our people first, with new challenges, a supportive team, opportunities to grow and flexible working options when possible. Our inclusive culture brings out the best in our employees, wherever they are on their career journey. And we use artificial intelligence (AI) to work smarter and more efficiently. We also recognize that great work is never done alone. That’s why collaboration is at the heart of everything we do. Because together, we’re more than ourselves.

We’re committed to disability inclusion and if you need reasonable accommodation/adjustments throughout our recruitment process, you can always contact us.

Disclaimer / Policy statements

UBS is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce.