Data Ops Engineer: Surveillance Pipelines & AWS

tp; Manila; Hybrid; PHP 1,200,000 - 2,400,000; Full time

Job summary

TP ICAP seeks a Data Ops Engineer to design and maintain end-to-end data pipelines for surveillance and trading data. You will ensure data completeness, quality, and timely delivery, collaborating with analysts, developers, and testers to uphold regulatory compliance.

The role emphasizes automation, scalable architectures on AWS, and governance across data flows, enabling reliable analytics in a fast-paced environment.

Qualifications

• Experience building ETL/ELT data pipelines for financial market data and surveillance platforms.
• Strong understanding of CI/CD and software engineering practices.

Responsibilities

• Design, build, maintain end-to-end data pipelines between source data and targets.
• Implement data quality checks and reconciliation processes to ensure accuracy.
• Identify critical data elements and implement failover/recovery strategies.
• Build AWS infrastructure using Terraform or CDK.
• Write unit, integration, and infrastructure tests.
• Monitor and resolve data anomalies with cross-functional teams.
• Ensure data governance and lineage across pipelines for compliance.
• Collaborate with stakeholders to translate business rules into technical specs.

Skills

ETL/ELT pipelines

CI/CD pipelines

AWS services

Python

SQL

Airflow / dbt / Spark

Agile methodology

Communication

Education

Bachelor's in CS / Data Science / Engineering

Tools

Terraform

CDK

Snowflake

Kinesis

Grafana

Job description

TP ICAP seeks a Data Ops Engineer to design and maintain end-to-end data pipelines for surveillance and trading data. You will ensure data completeness, quality, and timely delivery, collaborating with analysts, developers, and testers to uphold regulatory compliance.

The role emphasizes automation, scalable architectures on AWS, and governance across data flows, enabling reliable analytics in a fast-paced environment.