Senior Data Engineer | Global Trading Technology Firm

Quality Control Specialist - Pest Control; London; On-site; GBP 60,000 - 90,000; Full time

Job summary

A global trading technology firm is seeking a Senior Data Engineer to develop and scale data infrastructure for their innovative trading and research platforms. The ideal candidate will possess over 5 years of data engineering experience, strong Python and SQL skills, and a collaborative mindset. This role offers competitive compensation and the opportunity to be part of a high-caliber team driving next-generation AI solutions.

Benefits

Competitive compensation

Long-term growth potential

Qualifications

• 5+ years of experience in data engineering, with a strong focus on building scalable data platforms.
• Proficiency in Python and modern data libraries (e.g. Pandas, PySpark, Dask).
• Strong SQL skills and experience with cloud-native data tools (AWS, GCP, or Azure).

Responsibilities

• Develop and maintain scalable data pipelines to support AI, analytics, and trading systems.
• Collaborate with data scientists and researchers to support model development and fine-tune data retrieval processes.
• Streamline ETL processes to reduce manual overhead and improve data operations.

Skills

Data Engineering

Python

SQL

Cloud Tools (AWS, GCP, Azure)

Data Pipelines

ETL Processes

NLP Pipelines

Collaboration

Tools

Airflow

Spark

Kafka

Snowflake

Job description

We're working with a global trading technology firm at the forefront of AI and data-driven innovation. As they expand their Data & AI capabilities, they're looking for a Senior Data Engineer to help design and scale the infrastructure that powers their trading and research platforms.

This is a hands-on role suited to someone who enjoys building robust systems in a fast-paced, research-led environment, and who's comfortable working across teams to deliver high-quality data solutions

Key Responsibilities:

• Build and Scale Data Infrastructure: Develop and maintain scalable data pipelines to support AI, analytics, and trading systems-particularly for time-series, unstructured, and text-heavy datasets.
• Collaborate with AI and Research Teams: Partner with data scientists and researchers to support model development, fine-tune data retrieval processes, and operationalise RAG systems.
• Support Experimentation and Prototyping: Contribute to flexible data systems that enable rapid experimentation and smooth transitions from prototype to production.
• Automate and Optimise Workflows: Streamline ETL processes, reduce manual overhead, and improve the performance and reliability of data operations.
• Ensure Data Quality and Monitoring: Implement validation frameworks, monitoring tools, and alerting systems to maintain high data integrity and availability.
• Contribute to Best Practices: Help shape documentation standards, coding practices, and data governance processes.

Requirements:

• 5+ years of experience in data engineering, with a strong focus on building scalable data platforms.
• Proficiency in Python and modern data libraries (e.g. Pandas, PySpark, Dask).
• Strong SQL skills and experience with cloud-native data tools (AWS, GCP, or Azure).
• Hands-on experience with tools like Airflow, Spark, Kafka, or Snowflake.
• Experience working with unstructured data, NLP pipelines, and time-series databases.
• Familiarity with deploying AI/ML models and supporting MLOps workflows.
• Interest in or experience with Retrieval-Augmented Generation (RAG) systems.
• Strong communication skills and a collaborative, proactive mindset.

Nice to Have:

• Experience with LLM pipelines and vector databases (e.g. Pinecone, FAISS).
• Familiarity with data versioning and experiment tracking tools (e.g. DVC, MLflow).
• Background in supporting AI/ML research teams or trading environments.

On Offer:

• A role contributing to the development of next-generation AI and trading systems.
• Exposure to a high-calibre team of engineers, researchers, and data scientists.
• Competitive compensation and long-term growth potential in a fast-evolving space.

If you're a data engineer looking to work on impactful systems in a collaborative, forward-thinking environment, we'd love to hear from you.