AI Data Engineer for Front-Office Trading Platform

Caspian One; City of Edinburgh; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading technology company in the UK is seeking a Data Engineer to design, build, and maintain data pipelines for trading systems. The role focuses on developing machine learning and AI-driven platforms, where you will directly impact trading strategies. Candidates should have 5-10 years of experience in data engineering, strong skills in Python, and familiarity with AWS services like Kinesis and Glue. Ideal for those passionate about innovative engineering and collaboration within a fast-paced team.

Qualifications

• 5 – 10 years of experience in data engineering, ideally in platform or infra roles.
• Strong programming skills in Python; passion for code quality and testing.
• Experience working in a fast-paced environment in either engineering or analytical roles.

Responsibilities

• Design, build, and maintain robust data pipelines for batch and streaming workloads.
• Model and store large-scale datasets optimised for analytics and machine learning.
• Build real-time data pipelines using Databricks and streaming technologies.

Skills

Data pipeline design

Python programming

Experience with Databricks

AWS services

Collaboration and teamwork

Tools

Databricks

AWS (S3, Glue, Kinesis, Lambda)

Kubernetes

Hadoop ecosystem

Job description

A leading technology company in the UK is seeking a Data Engineer to design, build, and maintain data pipelines for trading systems. The role focuses on developing machine learning and AI-driven platforms, where you will directly impact trading strategies. Candidates should have 5-10 years of experience in data engineering, strong skills in Python, and familiarity with AWS services like Kinesis and Glue. Ideal for those passionate about innovative engineering and collaboration within a fast-paced team.