Big Data Engineer, Web3

P2P; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive total compensation package

L&D programs and education subsidy

Job summary

OKX is building foundational data infrastructure for a world-leading crypto exchange in Singapore. We are hiring a Big Data Platform Engineer to design, build, and evolve core platform services that power data engineers and analysts to move fast and ship reliable pipelines.

You will work on AI-native platform layers, multi-site orchestration, cost-aware resource tuning, and scalable data processing across batch and real-time workloads, with a focus on reliability and developer experience.

Qualifications

• Experience with large-scale data platforms and distributed systems.
• Strong programming skills in Java/Scala/Python and API-first design.

Responsibilities

• Design and operate large-scale distributed data systems and pipelines.
• Build AI-native platform layers and tooling for MCP interfaces.
• Improve reliability, performance, and developer experience across batch and real-time workloads.
• Define and enforce platform contracts and governance across multi-cloud environments.

Skills

Big data platforms

Java/Scala/Python

Airflow

Multi-cloud

LLM integration

MCP framework

Distributed storage/compute

Tools

Hadoop

Spark

Flink

MaxCompute

Hologres

ClickHouse

Hive

DolphinScheduler

Airflow

Job description

OKX prioritises applicants with current right to work in Singapore and does not require visa sponsorship.

Who We Are

At OKX, we believe that the future will be reshaped by crypto and contribute to every individual's freedom. OKX is a leading crypto exchange and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications. OKX is trusted by hundreds of large institutions seeking access to crypto markets and is backed by Proof of Reserves. Across our offices globally, we are united by core principles: We Before Me, Do the Right Thing, and Get Things Done. OKX is part of OKG, which brings the value of Blockchain to users around the world through OKX, OKX Wallet, OKLink and more.

About The Opportunity

We are building foundational data infrastructure that powers one of the world’s leading crypto exchanges. As a Big Data Platform Engineer, you will design, build, and evolve core platform services that enable data engineers and analysts to move fast and ship reliable pipelines. You will be at the forefront of our AI agent initiative—embedding LLM‑driven capabilities directly into the platform layer so that scheduling, cost optimization, and incident response increasingly run autonomously.

What You’ll Be Doing

• Platform Core: Design and operate large-scale distributed data systems. Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark). Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy. Drive reliability and performance improvements across batch and real-time pipelines.
• AI Integration: Build the AI-native platform layer. Develop and expose MCP (Model Context Protocol) tool interfaces so AI agents can interact with platform APIs. Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity. Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection. Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases.
• Tooling & DX: Evolve the developer experience. Own the internal data development platform — IDE integrations, code review automation, deployment tooling. Build APIs-first tools (backfill, ingestion automation) designed for future MCP integration. Collaborate with data warehouse and service teams to define platform contracts.
• Ops & Governance: Drive operational excellence. Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets. Build automated incident response and root-cause analysis pipelines. Define and enforce infrastructure policies across multi-cloud environments.

AI Agent Ownership — Platform Tier

• Scheduling Agent: auto-configure task dependencies, engine selection, cost/performance trade-offs, and alert tiers.
• Operations Agent: detect pipeline latency, performance degradation, and schema drift; trigger remediation.
• Incident Response Agent: trace SLA breaches to root cause, assign accountability, generate post-mortems.
• MCP Tool Layer: design and maintain the cross-platform tool interfaces that all agents call into.

What We Look For In You

• 5+ years of experience building large-scale data platforms (Hadoop/Spark/Flink or equivalent)
• Deep expertise in distributed storage and compute systems (MaxCompute, Hologres, ClickHouse, Hive)
• Strong software engineering skills in Java, Scala, or Python; experience with API-first design
• Hands-on experience with task scheduling systems (Airflow, DolphinScheduler, or in-house equivalents)
• Solid understanding of multi-cloud architectures and cost governance
• Familiarity with LLM integration patterns: tool calling, RAG pipelines, context management
• Experience with MCP or similar agent-tool frameworks is a strong plus
• Passion for building systems that make other engineers 10x more productive

Perks & Benefits

• Competitive total compensation package
• L&D programs and education subsidy for employees\' growth and development
• Various team building programs and company events
• Wellness and meal allowances
• Comprehensive healthcare schemes for employees and dependants
• More that we love to tell you along the process!

Notice: All official OKX vacancies are published on this website. While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. If in doubt, please apply directly through our official careers website.

Information collected and processed as part of the recruitment process is subject to OKX\'s Candidate Privacy Notice.