Data Engineer (Trade Surveillance)

TP ICAP; Belfast City District; On-site; GBP 70,000 - 110,000; Full time

Job summary

TP ICAP in Belfast seeks a Data Ops Engineer to design and maintain end-to-end data pipelines for market surveillance. You’ll implement data quality checks, govern data lineage, and work with AWS, Terraform/CDK, and analytics tools to ensure accurate, timely data delivery across platforms.

You will collaborate with analysts, developers and testers, optimise performance, and help scale data ingestion in a fast-paced financial services environment.

Qualifications

• Strong ETL/ELT data pipeline design, build, and maintenance for financial data.
• Background in software engineering, product management or data analytics.
• Proficient in Python or Java, SQL, and data pipeline frameworks with AWS.
• Good problem-solving and collaborative skills in fast-paced settings.
• Bachelor’s degree in CS/Engineering/Data Science or related field.
• Experience in Data Ops and Data Engineering.

Responsibilities

• Design and maintain end-to-end data pipelines across sources and targets.
• Implement data completeness checks, validation rules, and reconciling processes.
• Identify critical data elements and implement failover/recovery strategies.
• Build AWS infra with Terraform or CDK; write tests; monitor data quality.
• Ensure data governance and lineage across surveillance platforms.
• Collaborate with analysts, developers, and testers to translate rules into specs.
• Optimize performance and costs with cloud infrastructure teams.

Skills

ETL/ELT pipelines

Python/Java

SQL

Airflow/dbt/Spark

AWS ecosystem

CI/CD

Data governance

Data quality checks

Education

Bachelor’s degree in CS/Engineering/Data Science

Tools

Terraform

CDK

Kafka/Kinesis

S3/DynamoDB

Snowflake

Grafana

Airflow

Job description

Group Overview

The TP ICAP Group is a world leading provider of market infrastructure. Our purpose is to provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our people and technology, we connect clients to superior liquidity and data solutions. The Group is home to a stable of premium brands. Collectively, TP ICAP is the largest interdealer broker in the world by revenue, the number one Energy & Commodities broker in the world, the world’s leading provider of OTC data, and an award winning all-to-all trading platform. The Group operates from more than 60 offices in 27 countries. We are 5,300 people strong. We work as one to achieve our vision of being the world’s most trusted, innovative, liquidity and data solutions specialist.

Role Overview

Effective Market Abuse Surveillance is highly dependent on data of multiple types and from many different sources. Trade Surveillance requires complete Trade and Pre-Trade transactional data, Instrument and Client Reference Data and Market Data. Communications Surveillance requires ingestion of messages from multiple electronic platforms. This role will play a critical role in ensuring the reliability, scalability, and compliance of data pipelines that support surveillance systems across communications and trading activities, covering the above structured and unstructured data. The role bridges engineering and operations, enabling robust data ingestion, transformation, and monitoring to meet regulatory and internal compliance requirements. The Data Ops Engineer will play a critical role in collaborating with upstream teams to ensure data completeness, accuracy, and timeliness is as expected and that any data completeness or quality issues are visible. The role will also work on other Surveillance data initiatives such as persisting Surveillance Alerts in the firm’s data lake for analytics purposes.

Role Responsibilities

• Design, build, maintain and optimise end-to-end data pipelines and workflows between the source data points and target destinations, working with the wider Surveillance Technology team to prioritise automation, scalability and strategy at the heart of the design.
• Implement automated data completeness and quality checks, validation rules, and reconciliation processes to ensure accuracy, completeness, and timeliness of the data ingested and to make visible any data that is not processed.
• Identify Critical Data Elements and implement failover and recovery strategies for the respective Data Flows.
• Build AWS infrastructure using Terraform or CDK Write unit, integration, and infrastructure tests Monitor, investigate and resolve data anomalies through collaboration with, Business Analysts, Developers, and Testers across functions and verticals.
• Implement data management and governance frameworks to ensure data is ingested and loaded per the requirements of the consuming platform; Scila for Trade Surveillance, and Global Relay for Communications Surveillance.
• Partnering with the Data Strategy and Data Infrastructure team to ensure Data Lineage, auditability and retention policies are enforced across all necessary pipelines.
• Ensuring that Data consumed and processed is compliance with regulatory, legal, and security protocols.
• Work closely with surveillance analysts, compliance officers, and engineering teams to translate business rules into technical specifications.
• Partnering closely with stakeholders and subject matter experts such as the Cloud Infrastructure team to optimise performance and costs.

Experience / Competences

Essential

• Strong experience ETL/ELT data pipeline builds from design, to implementation, to maintenance in relation to financial market messaging platforms, and trade & order systems.
• Solid understanding of CI/CD pipelines, ideally with a background in software engineering, product management or data analytics.
• Strong proficiency in Python or Java, SQL, and data pipeline frameworks (e.g., Airflow, dbt, Spark), with solid experience with the AWS ecosystem.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Bachelor’s degree in Computer Science, Data Science, Engineering, or related field.
• Previous experience in Data Ops and Data Engineering.
• Strong communication and collaboration skills to engage with technical and non-technical stakeholders.
• Strong experience with Agile software delivery.

Desired

• Experience with market data ingestion, metadata extraction, and event-driven architectures.
• Experience with some of EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, Snowflake, Terraform and Transfer Family.
• Knowledge of streaming technologies (Kafka, Kinesis) and API integrations, and hands-on experience with monitoring tools (e.g. Grafana) and observability practices.
• Proficient with Terraform or CDK (infrastructure-as-code).
• Experience in Business Communications Technology e.g. Bloomberg, ICE, Symphony, Teams Chat, etc.
• Familiarity with security best practices, IAM, and VPN configuration.
• Experience with regulatory compliance and data security in financial services.
• Knowledge of financial markets and trading platforms.
• Experience with GitLab, Qliksense & Alation.
• Certifications in DataOps, cloud platforms, or related areas.
• Strong understanding of modern foundation models, including Claude (Sonnet / Opus), OpenAI GPT models, and other leading LLMs.
• Practical experience building applications using agentic or multi-agent workflows (e.g., tool use, planning, orchestration, retrieval, reasoning patterns).

Band & Level

Professional, 5 #LI-Hybrid #LI-MID #NIJobs

Not The Perfect Fit?

Concerned that you may not meet the criteria precisely? At TP ICAP, we wholeheartedly believe in fostering inclusivity and cultivating a work environment where everyone can flourish, regardless of your personal or professional background. If you are enthusiastic about this role but find that your experience doesn't align perfectly with every aspect of the job description, we strongly encourage you to apply. You may be the ideal candidate for this position or another opportunity within our organisation. Our dedicated Talent Acquisition team is here to assist you in recognising how your unique skills and abilities can be a valuable contribution. Don't hesitate to take the leap and explore the possibilities. Your potential is what truly matters to us.

Company Statement

We know that the best innovation happens when diverse people with different perspectives and skills work together in an inclusive atmosphere. That's why we're building a culture where everyone plays a part in making people feel welcome, ready and willing to contribute. TP ICAP Accord - our Employee Network - is a central to this. As well as representing specific groups, TP ICAP Accord helps increase awareness, collaboration, shares best practice, and holds our firm to account for driving continuous cultural improvement.

Location

UK - City Quays 3 - Belfast

More about us

TP ICAP connects people, platforms, ideas, and insight across the world’s financial, energy and commodities markets. As a global leader in market infrastructure and data-led solutions, we enhance market access, increase efficiencies, and unlock possibilities. Work with us:Joining TP ICAP puts you at the heart of markets that matter. You’ll have the freedom to innovate and act on your initiative. We’ll train you and build your abilities in your specialist area, so that you can become an expert in your field. And all within a connected network that’s there to set you up for success.

TP ICAP

We connect.