Senior Web3 Big Data Architect

United States Digital Space LLC; Hong Kong; On-site; HKD 900,000 - 1,300,000; Full time

Job summary

United States Digital Space LLC is seeking a Senior Big Data Engineer in Hong Kong to own the architecture, development, and optimization of a large-scale data platform. You will design real-time/on-chain data pipelines, build data warehouses/lakes, and deliver AI-driven analytics with LLM integration.

Collaboration with AI/Algorithm teams and cross-functional partners is essential for trading analytics and fraud prevention.

Qualifications

• 7+ years of big data development experience.
• Proficiency with Hadoop, Spark, and Flink; experience building batch/real-time data warehouses.
• Familiarity with Hive, Kafka, HBase, ClickHouse, and Doris; large-scale cluster tuning experience.
• Strong big data development skills in Java/Scala/Python, with solid SQL tuning ability.
• Experience with data governance, data quality monitoring, or metadata management is a plus.

Responsibilities

• Platform Architecture: Own the architecture, development, and optimization of our big data platform for large-scale on-chain data, trading behavior, and user profiles.
• On-Chain Data Pipelines: Design real-time/batch pipelines for blockchain transactions, smart contract events, and wallet behavior.
• Data Warehouse & Lake: Build and maintain the data warehouse/lake with data-layering standards and data quality.
• AI-Driven Data Applications: Combine big data with LLMs for anomaly/fraud detection, risk models, user behavior predictions, and Text2SQL queries.
• AI Infrastructure: Create vector DBs, feature platforms, and embedding pipelines to support RAG and Agent data.
• Cross-Team Collaboration: Partner with Algorithm/AI, Product, Risk, Growth for data needs and model training data.
• Performance & Reliability: Optimize big data jobs for stability and SLA compliance.
• Technical Direction: Track Web3 data infra trends and drive architecture evolution.
• Global Collaboration: Communicate in English with overseas partners.

Skills

Big data architectures

Java

Scala

Python

SQL tuning

Hadoop

Spark

Flink

Hive

Kafka

HBase

ClickHouse

Doris

Milvus

Pinecone

Weaviate

pgvector

LLM fundamentals

Prompt engineering

RAG

Education

Bachelor's degree or above in CS/SE

Tools

Milvus

Pinecone

Weaviate

pgvector

ClickHouse

Doris

Kafka

Hive

Job description

United States Digital Space LLC is seeking a Senior Big Data Engineer in Hong Kong to own the architecture, development, and optimization of a large-scale data platform. You will design real-time/on-chain data pipelines, build data warehouses/lakes, and deliver AI-driven analytics with LLM integration.

Collaboration with AI/Algorithm teams and cross-functional partners is essential for trading analytics and fraud prevention.