Big Data Engineer

Finloop Finance Technology Services Limited; Hong Kong; On-site; HKD 700,000 - 1,100,000; Full time

Job summary

Finloop Finance Technology Services Limited seeks a data engineer to design and implement an enterprise data warehouse (EDW) and drive data governance and quality initiatives. You will unify metric standards, automate metrics, and enable self-service analytics with dashboards and reporting.

You will also build AI-driven data analysis capabilities using LLMs and data pipelines, optimize ETL processes, and ensure stable, cost-effective warehouse performance across big data and AI services.

Qualifications

• Bachelor’s degree or above in Computer Science, Big Data, Statistics, or a related field.
• 3–5 years of big data development experience with hands-on experience in 0-to-1 data warehouse construction, metrics framework development, and BI reporting.
• Systematic thinking and strong data modeling capabilities; interest in AI + data technologies; self-driven and cross-team collaboration.
• Proficient in big data stack (Spark, Flink, Hive, Kafka, ClickHouse) with experience in offline and real-time processing.
• Strong data warehouse modeling, metadata, governance, and data quality management.
• Proficient in at least one of Java / Scala / Python; experience in BI system development a plus.

Responsibilities

• Design, model, and implement the enterprise data warehouse (EDW) and drive data governance and data quality initiatives.
• Unify metric standards and enable metric automation with monitoring and alerting.
• Build and develop the BI system, data visualization, and reporting framework for self-service analytics and dashboards.
• Combine LLMs / AI agents to build AI-driven data analysis capabilities and scenarios like data Q&A and anomaly detection.
• Own big data ETL development and data integration across data pipelines (LLM / RAG / vector databases).
• Optimize data warehouse and compute task performance, ensure stability, and manage costs; resolve production-critical challenges.

Skills

EDW design

Data governance

Data quality

ETL development

BI reporting

Big data stack

Spark

Flink

Hive

Kafka

ClickHouse

Docker

Kubernetes

MySQL

Java/Python/Scala

System design

AI/Data technologies

Education

Bachelor’s degree in Computer Science/Big Data/Statistics

Tools

Spark

Flink

Hive

Kafka

ClickHouse

Docker

Kubernetes

MySQL

Vector databases

Job description

Finloop Finance Technology Services Limited View all jobs

Design, model, and implement the enterprise data warehouse (EDW); drive data governance and data quality initiatives, unify metric standards, and enable metric automation with monitoring and alerting. Build and develop the BI system, data visualization, and reporting framework to support self-service analytics, decision dashboards, and data-driven operations. Combine LLMs / AI agents to build AI-driven data analysis capabilities, delivering scenarios such as data Q&A, anomaly detection, and intelligent analysis. Own big data ETL development and data integration, connecting the full data pipeline across big data and AI services (LLM / RAG / vector databases). Optimize data warehouse and compute task performance, ensure stability, and manage costs; resolve production-critical technical challenges. Track the convergence of big data and AI technologies, and work with the team to deliver integrated Data + AI + BI solutions that improve development and analytical efficiency.

Key responsibilities

Design, model, and implement the enterprise data warehouse (EDW); drive data governance and data quality initiatives, unify metric standards, and enable metric automation with monitoring and alerting

Build and develop the BI system, data visualization, and reporting framework to support self-service analytics, decision dashboards, and data-driven operations

Combine LLMs / AI agents to build AI-driven data analysis capabilities, delivering scenarios such as data Q&A, anomaly detection, and intelligent analysis

Own big data ETL development and data integration, connecting the full data pipeline across big data and AI services (LLM / RAG / vector databases)

Optimize data warehouse and compute task performance, ensure stability, and manage costs; resolve production-critical technical challenges

Track the convergence of big data and AI technologies, and work with the team to deliver integrated Data + AI + BI solutions that improve development and analytical efficiency

About you

Bachelor's degree or above in Computer Science, Big Data, Statistics, or a related field

3–5 years of big data development experience, with hands-on experience in 0-to-1 data warehouse construction, metrics framework development, and BI reporting

Systematic thinking and strong data modeling capabilities; sensitive to AI + data technologies; self-driven and skilled at cross-team collaboration

Proficient in the big data stack (Spark / Flink / Hive / Kafka / ClickHouse), with solid experience in offline and real-time data processing

Strong command of data warehouse layered modeling, dimensional modeling, data governance, metadata, and data quality management

Proficient in metric design and metric calculation development; experience in BI system development is a plus

Data visualization expertise, with the ability to build reporting and self-service analytics platforms

Understanding of LLM / RAG / agent principles, able to combine AI for data analysis and metric-driven applications

Proficient in relational databases such as MySQL; familiar with vector databases; experienced with Docker / K8s and job scheduling tools

Proficient in at least one of Java / Scala / Python, with system design and architecture optimization capabilities