Data Ops Engineer - Trade Surveillance & Pipelines

TP ICAP Group; Belfast City District; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

TP ICAP Group is seeking a Data Ops Engineer to design and maintain data pipelines for market surveillance. You will ensure data completeness, quality and timeliness across Tra de and communications data, collaborating with upstream teams and analysts.

The role emphasises data governance, cloud infrastructure and scalable solutions within a regulatory framework. You will work with the Surveillance Technology team in Belfast.

Qualifications

• Strong ETL/ELT data pipeline experience for financial market data.
• CI/CD understanding; background in software engineering, product management or data analytics.
• Proficiency in Python or Java, SQL, and data pipeline tools with AWS experience.
• Excellent problem-solving skills in a fast-paced environment.
• Bachelor's degree in CS/Data Science/Engineering; prior Data Ops/Engineering work.
• Strong communication and collaboration with technical and non-technical stakeholders.

Responsibilities

• Design, build, maintain and optimise end-to-end data pipelines for surveillance data.
• Implement data quality checks, validation rules and reconciliation processes.
• Identify critical data elements and implement failover/recovery strategies.
• Build AWS infrastructure using Terraform or CDK and write tests.
• Collaborate with analysts, developers and testers to resolve data issues.
• Implement data governance, lineage, retention and security controls.
• Translate business rules into technical specs for surveillance platforms.

Skills

Python/Java

SQL

Airflow

dbt

Spark

Agile

Education

Bachelor's degree in Computer Science/Data Science/Engineering

Tools

Terraform

CDK

AWS

Lambda

Kinesis

Grafana

Job description

TP ICAP Group is seeking a Data Ops Engineer to design and maintain data pipelines for market surveillance. You will ensure data completeness, quality and timeliness across Tra de and communications data, collaborating with upstream teams and analysts.

The role emphasises data governance, cloud infrastructure and scalable solutions within a regulatory framework. You will work with the Surveillance Technology team in Belfast.