Data Engineer: End-to-End Pipelines for Quant Research

IO Tech Solutions Limited; Hong Kong; On-site; HKD 450,000 - 650,000; Full time

Job summary

IO Tech Solutions Limited in Hong Kong is seeking a data engineer to build and maintain end-to-end data pipelines that ingest, process and transform vendor and exchange data into research-ready datasets.

You will onboard new data sources, develop derived datasets, optimise databases for performance and cost, and improve data quality through automated validation, monitoring and alerting. Strong Python coding and English communication are essential.

Qualifications

• 3+ years of experience building and maintaining production data pipelines.
• Strong Python programming skills and writing clean, maintainable code.
• Experience in data engineering areas such as ingestion, transformation, storage or query optimization.
• Good written and verbal English communication skills.

Responsibilities

• Build and maintain end-to-end data pipelines to ingest, process and transform vendor and exchange data.
• Onboard new data sources and develop derived datasets for quantitative research.
• Manage and optimise databases and storage for performance and cost efficiency.
• Improve data quality through automated validation, cleaning, monitoring and production alerting.
• Document data sources, structures and usage for research teams.

Skills

Python programming

Data pipeline development

Problem solving

English communication

Tools

Snowflake

ClickHouse

PySpark

Job description

IO Tech Solutions Limited in Hong Kong is seeking a data engineer to build and maintain end-to-end data pipelines that ingest, process and transform vendor and exchange data into research-ready datasets.

You will onboard new data sources, develop derived datasets, optimise databases for performance and cost, and improve data quality through automated validation, monitoring and alerting. Strong Python coding and English communication are essential.