Staff/Senior Staff Web3 Big Data Engineer

OKX; Hong Kong; On-site; HKD 600,000 - 800,000; Full time

Benefits offered by this job

Competitive total compensation

Comprehensive insurance coverage

Job summary

Join OKX in Hong Kong as a Big Data Engineer. You will own the architecture and optimization of our big data platform, design data pipelines, and work on AI-driven applications for blockchain data. A solid understanding of Web3 and strong programming skills in Java, Scala, or Python are key.

We offer competitive compensation, comprehensive insurance, and a dynamic work environment!

Qualifications

• 7+ years of big data development experience.
• Experience building batch/real-time data warehouses.
• Understanding of blockchain fundamentals.

Responsibilities

• Own the architecture and optimization of the big data platform.
• Design and build real-time/batch data pipelines for on-chain data.
• Build and maintain the data warehouse/lake.

Skills

Big data development

Java/Scala/Python

SQL tuning

AI knowledge

Cross-cultural communication

Education

Bachelor's degree in Computer Science or related field

Tools

Hadoop

Spark

Flink

Hive

Kafka

Job description

Who We Are

At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Pay, OKX Wallet, OKLink and more.

Responsibilities

• Platform Architecture: Own the architecture, development, and optimization of our big data platform, supporting large-scale collection, processing, and analysis of on-chain data, trading behavior, and user profiles.
• On-Chain Data Pipelines: Design and build real-time/batch data pipelines for on-chain data — blockchain transactions, smart contract events, wallet address behavior.
• Data Warehouse & Lake: Build and maintain the data warehouse/lake, define data-layering standards, and ensure data quality, consistency, and timeliness.
• AI-Driven Data Applications: Combine big data with LLM capabilities to build intelligent applications — on-chain anomaly/fraud detection, smart risk models, user behavior prediction, and natural-language data querying (Text2SQL).
• AI Infrastructure: Build data infrastructure for AI use cases — vector databases, feature platforms, and Embedding pipelines supporting RAG retrieval and Agent data supply.
• Cross-Team Collaboration: Partner with Algorithm/AI teams on large-scale data processing and pipelines for model training data and feature engineering; partner with Product, Risk, and Growth teams on data needs for trading analytics, anti-fraud, growth, and operations.
• Performance & Reliability: Optimize performance and resource efficiency of big data jobs, ensuring stability and SLAs on core pipelines.
• Technical Direction: Track industry developments in big data, Web3 data infrastructure, and AI, driving technology selection and architecture evolution.
• Global Collaboration: Communicate and document in English with overseas colleagues and partners (exchanges, public chain teams, etc.).

Requirements

Big Data Engineering

• Bachelor's degree or above in Computer Science, Software Engineering, or related field; 7+ years of big data development experience.
• Proficiency with Hadoop, Spark, and Flink, with experience building batch/real-time data warehouses.
• Familiarity with Hive, Kafka, HBase, ClickHouse, and Doris, with large-scale cluster tuning experience.
• Strong big data development skills in Java/Scala/Python, with solid SQL tuning ability.
• Experience with data governance, data quality monitoring, or metadata management is a plus.

AI Capabilities

• Understanding of LLM fundamentals and application patterns, with hands-on experience in prompt engineering and RAG.
• Experience with vector databases (e.g. Milvus, Pinecone, Weaviate, pgvector) or Embedding data processing.
• Familiarity with emerging AI application architectures such as AI Agents or MCP (Model Context Protocol) is a plus.
• Experience connecting big data platforms with AI/ML training and inference pipelines (e.g. feature platforms, real-time feature serving).
• Experience using LLMs to accelerate data engineering (automated data quality checks, intelligent ETL generation, Text2SQL) is a plus.
• Basic ML/deep learning knowledge and ability to collaborate effectively with algorithm teams is a plus.

Web3 Industry Knowledge

• Understanding of blockchain fundamentals (account model/UTXO, consensus mechanisms, gas mechanics).
• Understanding of on-chain data structures for major public chains (Ethereum, BSC, Solana, Bitcoin, etc.) — blocks, transactions, event logs, token transfers (ERC-20/ERC-721).
• Experience with on-chain data collection/parsing is a plus — e.g. building or integrating with The Graph, Dune, Etherscan API, or node RPCs.
• Understanding of DeFi, NFT, or cross-chain bridge business models and their data characteristics is a plus.
• Data engineering experience at an exchange, wallet, DeFi protocol, or on-chain analytics company is a plus.

Language & Soft Skills

• Fluent English reading/writing; able to independently read English technical documentation (e.g. Ethereum Yellow Paper, RFCs/EIPs, AI papers) and write technical proposals and weekly reports in English.
• Able to communicate in English with overseas teams, communities, or partners, with strong cross-cultural communication skills.
• Clear logical thinking, strong problem decomposition and troubleshooting ability, and a strong appetite for learning new AI technology.
• Strong team player, able to deliver consistently in a fast-paced, high-uncertainty Web3 environment.

Nice-to-Haves

• Basic smart contract knowledge (Solidity); able to read contract code logic.
• Contribution experience in open-source big data / blockchain data / AI infrastructure projects.
• Relevant technical certifications (e.g. AWS/GCP big data or AI certifications).
• Experience using AI coding agents (e.g. Claude Code) to improve data engineering efficiency.

Perks & Benefits

• Competitive total compensation
• Comprehensive insurance coverage for employees and their dependants
• More that we love to tell you along the process!