SENIOR DATA ENGINEER

P2P; Hong Kong; On-site; HKD 900,000 - 2,000,000; Full time

Job summary

A leading crypto exchange in Hong Kong is seeking a skilled professional to design and maintain real-time and batch data processing pipelines using Flink. You will develop and architect Flink streaming systems, collaborate with various teams including AI and engineering, and tackle performance issues to ensure system stability. Candidates should possess deep expertise in Apache Flink, have at least 10 years of relevant experience, and a background in FinTech or blockchain is preferred. Strong English communication skills are essential.

Qualifications

• Deep expertise in Apache Flink for real-time data streaming.
• At least 10 years of experience in relevant fields.
• Experience in FinTech or blockchain preferred.
• Experience designing and delivering streaming architectures with real-time data pipelines

Responsibilities

• Design, develop, and maintain data processing pipelines.
• Architect Flink streaming systems for complex requirements.
• Collaborate with cross-functional teams to provide data solutions.
• Work with AI, compliance, risk, and engineering teams to deliver robust data solutions
• Troubleshoot performance bottlenecks and ensure system stability in real-time processing
• Improve data integrity and system performance across streaming pipelines

Skills

Apache Flink

Feature engineering

English communication

Spark

Data pipelines

Hologres

ClickHouse

English fluency

Education

Bachelor’s in CS/IS/EE

Tools

Alibaba Cloud Hologres

Spark

Doris/Clickhouse

Job description

At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.

About the Team

What You’ll Be Doing:

• Design, develop, and maintain real-time and batch data processing pipelines using Flink, ensuring high performance and scalability.
• Responsible for the architecture design and development of Flink streaming systems, tailoring solutions to complex business requirements.
• Collaborate with data scientists to support feature engineering and develop feature stores for machine learning models in production.
• Work closely with cross-functional teams, including AI, compliance, risk, and engineering, to provide robust and scalable data solutions.
• Troubleshoot and resolve performance bottlenecks and technical challenges in real-time stream processing, ensuring system stability and scalability.
• Improve system performance and data integrity, addressing complex issues in real-time data pipelines.

What We Look For In You:

• Deep expertise in Apache Flink for real-time data streaming and processing, with experience in designing and developing streaming architecture.
• Familiarity with data platforms such as Alibaba Cloud Hologres, Doris/Clickhouse, and Spark.
• Experience in feature engineering and feature store development to support machine learning applications in production environments.
• At least 10 years of relevant work experience, especially in large enterprises or international Fintech companies
• Background in FinTech or blockchain companies.
• Strong English communication skills to work effectively in a cross-national team
  • Bonus Points: Experience in developing feature stores.
  • Experience with blockchain technology.