Data Engineer: End-to-End Pipelines for Quant Research

IO TECH SOLUTIONS LIMITED; Hong Kong; On-site; HKD 480,000 - 900,000; Full time

Job summary

IO TECH SOLUTIONS LIMITED in Hong Kong is seeking a Data Engineer to build and maintain end-to-end data pipelines, ingest data from multiple sources, and create research-ready datasets.

The role involves optimizing databases for performance and cost, improving data quality through automated checks, and documenting data sources for cross-team use. Strong Python skills and English communication are essential.

Qualifications

• 3+ years of experience building and maintaining production data pipelines.
• Strong Python programming skills and the ability to write clean, reliable and maintainable code.
• Experience in data engineering areas such as ingestion, transformation, storage or query optimisation.
• Practical problem-solving mindset, strong learning agility and ability to adapt to new tools and technologies.
• Good written and verbal English communication skills.

Responsibilities

• Build and maintain end-to-end data pipelines to ingest, process and transform vendor and exchange data into research-ready datasets.
• Onboard new data sources and develop derived datasets to support quantitative research.
• Manage and optimise databases and storage systems for query performance and cost efficiency.
• Improve data quality through automated validation, cleaning, monitoring, and production alerting.
• Document data sources, structures and usage to help research teams work effectively with the data.

Skills

Data Pipelines

Python

Data Eng

Problem Solving

English

Tools

Snowflake

ClickHouse

PySpark

Job description

IO TECH SOLUTIONS LIMITED in Hong Kong is seeking a Data Engineer to build and maintain end-to-end data pipelines, ingest data from multiple sources, and create research-ready datasets.

The role involves optimizing databases for performance and cost, improving data quality through automated checks, and documenting data sources for cross-team use. Strong Python skills and English communication are essential.