Data Engineer

IO TECH SOLUTIONS LIMITED; Hong Kong; On-site; HKD 480,000 - 900,000; Full time

Job summary

IO TECH SOLUTIONS LIMITED in Hong Kong is seeking a Data Engineer to build and maintain end-to-end data pipelines, ingest data from multiple sources, and create research-ready datasets.

The role involves optimizing databases for performance and cost, improving data quality through automated checks, and documenting data sources for cross-team use. Strong Python skills and English communication are essential.

Qualifications

• 3+ years of experience building and maintaining production data pipelines.
• Strong Python programming skills and the ability to write clean, reliable and maintainable code.
• Experience in data engineering areas such as ingestion, transformation, storage or query optimisation.
• Practical problem-solving mindset, strong learning agility and ability to adapt to new tools and technologies.
• Good written and verbal English communication skills.

Responsibilities

• Build and maintain end-to-end data pipelines to ingest, process and transform vendor and exchange data into research-ready datasets.
• Onboard new data sources and develop derived datasets to support quantitative research.
• Manage and optimise databases and storage systems for query performance and cost efficiency.
• Improve data quality through automated validation, cleaning, monitoring, and production alerting.
• Document data sources, structures and usage to help research teams work effectively with the data.

Skills

Data Pipelines

Python

Data Eng

Problem Solving

English

Tools

Snowflake

ClickHouse

PySpark

Job description

What You'll Do

• Build and maintain end-to-end data pipelines to ingest, process and transform vendor and exchange data into research-ready datasets.
• Onboard new data sources and develop derived datasets to support quantitative research.
• Manage and optimise databases and storage systems for query performance and cost efficiency.
• Improve data quality through automated validation, cleaning, monitoring and production alerting.
• Document data sources, structures and usage to help research teams work effectively with the data.

What We're Looking For

• 3+ years of experience building and maintaining production data pipelines, with flexibility for more senior candidates who remain hands-on.
• Strong Python programming skills and the ability to write clean, reliable and maintainable code.
• Experience in one or more areas of data engineering, such as data ingestion, transformation, pipeline development, storage or query optimisation.
• A practical problem-solving mindset, strong learning agility and the ability to adapt to new tools and technologies.
• Good written and verbal English communication skills.

Nice to Have

• Experience with financial market data, exchange feeds, securities data or crypto data streams.
• Background in quantitative finance, hedge funds, fintech or other data-intensive environments.
• Familiarity with Snowflake, ClickHouse, PySpark or similar data technologies.

Why Consider This Opportunity?

You'll have the opportunity to take ownership of data engineering work, improve existing data workflows and help build the data foundation supporting quantitative investment activities.