Big Data Platform Engineer — AI-Driven Crypto Infra

Blockchain Academics; Singapore; Sur place; SGD 120 000 - 180 000; Plein temps

Avantages offerts par ce poste

Competitive pay package

Education subsidy for growth

Team events

Wellness and meal allowances

Healthcare coverage

Résumé du poste

OKX is building foundational data infrastructure in Singapore. The Big Data Platform Engineer will design, build, and evolve core platform services enabling data engineers and analysts to move fast and ship reliable pipelines.

You will embed AI agent capabilities into the platform layer for autonomous scheduling, cost optimization, and incident response. You will own the platform's core compute/storage stack (MaxCompute/ODPS, Hologres, Spark), multi-site orchestration, and performance

Qualifications

• 5+ years building large-scale data platforms.
• Expertise in distributed storage and compute systems.
• Strong coding skills in Java, Scala, or Python; API-first design.
• Hands-on with task scheduling systems (Airflow, DolphinScheduler).
• Experience with multi-cloud architectures and cost governance.
• Familiarity with LLM integration patterns.

Responsabilités

• Design and operate large-scale distributed data systems.
• Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark).
• Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy.
• Drive reliability and performance improvements across batch and real-time pipelines.
• AI Integration: Build the AI-native platform layer.
• Develop and expose MCP tool interfaces so AI agents can interact with platform APIs.
• Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity.
• Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection.
• Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases.
• Tooling & DX: Evolve the developer experience.
• Own the internal data development platform — IDE integrations, code review automation, deployment tooling.
• Build APIs-first tools (backfill, ingestion automation) designed for MCP integration.
• Collaborate with data warehouse and service teams to define platform contracts.
• Ops & Governance: Drive operational excellence.
• Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets.
• Build automated incident response and root-cause analysis pipelines.
• Define and enforce infrastructure policies across multi-cloud environments.

Connaissances

Big data platforms

Distributed systems

Java/Scala/Python

Airflow/Scheduling

Multi-cloud architectures

Outils

MaxCompute

ODPS

Hologres

Spark

ClickHouse

Hive

Airflow

DolphinScheduler

Description du poste

OKX is building foundational data infrastructure in Singapore. The Big Data Platform Engineer will design, build, and evolve core platform services enabling data engineers and analysts to move fast and ship reliable pipelines.

You will embed AI agent capabilities into the platform layer for autonomous scheduling, cost optimization, and incident response. You will own the platform's core compute/storage stack (MaxCompute/ODPS, Hologres, Spark), multi-site orchestration, and performance