Senior AI Platform & Agentic Infrastructure Engineer

OKX

San Jose (CA)

On-site

USD 178,000 - 321,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

L&D programs
Team events
Wellness & meals
Healthcare coverage

Job summary

OKX is hiring a Senior AI Platform & Agentic Infrastructure Engineer in San Jose, CA. You will own a cloud-native, highly available agentic platform, including the runtime, governance, and data foundation, and drive AI enablement across the internal audit function.

You will architect scalable systems on AWS or GCP, integrate multiple model providers, and ensure compliance, security, and production readiness while collaborating with cross-functional teams.

Qualifications

  • Production-grade backend/platform systems experience.
  • Strong understanding of data models and provenance.
  • Experience with multi-cloud and agentic infrastructure is a plus.

Responsibilities

  • Architect and operate a resilient backend platform with HA/DR and observability.
  • Develop the agentic runtime and harness for multi-model workflows.
  • Build governance, security, and data-protection controls for production use.

Skills

Python
Go
TypeScript/Node
SQL
System design
On-call ownership

Tools

Terraform
Kubernetes
AWS/GCP
CI/CD pipelines

Job description

Senior AI Platform & Agentic Infrastructure Engineer

San Jose, California, United States

Who We Are

At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.

About the Opportunity

OKX’s Internal Audit function has an early but working AI-native capability: a multi-agent platform (Hive Mind), agentic workflows, data pipelines, and AI-enabled tools that let a very small team punch far above its weight. Your job is not to rebuild it at today’s maturity. Your job is to take it to a regulator-grade production standard and well beyond, and to drive AI Enablement across the department. You own the foundation, the agent runtime, and the harness: a resilient cloud platform, the agentic runtime and evaluation harnesses that make agents trustworthy in a regulated setting, and the governed data and AI infrastructure everything else depends on. We hire on demonstrated building, not on claims or credentials. We expect you to be more capable than the hiring manager in your domain: you will co‑own and challenge the tooling strategy, not just implement it. This is a two‑person engineering team: you deploy, debug, and hotfix your counterpart’s stack when needed.

Cloud on AWS or GCP. Claude as the starting point in a deliberately multi‑model architecture (Anthropic, OpenAI, Google), using the right model for each job, including the plugins and integrations you build. Google Workspace for reporting and evidence. JIRA for the audit team’s workflow. Lark for team communications, alert bots, and the corporate wiki. You inherit a working Google‑native prototype estate (Apps Script web apps, Drive‑synced automation, locally scheduled jobs, Claude Code agent tooling) and evolve it without breaking daily use. Infrastructure‑as‑code, CI/CD, and observability throughout. Treat this stack as the starting point, not a constraint: you build production‑grade systems end to end on what exists today, and you are expected to propose, prove, and adopt better components as demand and capabilities evolve. Production‑grade here means service levels sized for an internal assurance platform: board‑cycle windows are sacred, recovery is measured in hours, and this is not a 24/7 pager culture.

In your first year
  • Hive Mind runs in the cloud with HA, DR, SLOs, and audit logging that passes an internal controls review.
  • A governed data foundation with provenance and lineage is live across multiple audit domains, integrated with OKX's group data infrastructure where it exists.
  • An agentic runtime and harness with evaluation and red‑teaming gates what reaches production.
  • The hiring manager is out of the operational loop: no scheduled job runs on a personal machine, every system has a runbook and a non‑founder owner. Decommissioning the founder’s laptop as infrastructure is a literal milestone. When these goals compete, the priority order is: keep the estate alive, then the cloud migration with observability, then the harness gating production, then the data foundation.
How we assess demonstrated building

We assess demonstrated building in ways that respect your time and your confidentiality obligations to current and former employers: a portfolio deep‑dive (walk us through systems you built and kept running, at the level of detail your obligations allow; we want architecture, decisions, and trade‑offs, never proprietary code, data, or documents), a short, time‑capped build exercise on a synthetic problem unrelated to OKX's business (a small agentic workflow with an evaluation harness, used for assessment only and never put to use by OKX; the work remains yours) that you defend live, walking us through your design decisions and extending it on the spot, a systems‑design session on taking a prototype estate to production, and references focused on whether you built and operated systems in production.

Trust and compliance

This role handles highly sensitive audit data at a global crypto exchange. Expect background checks, confidentiality obligations, and personal‑trading and material‑non‑public‑information

What You’ll Be Doing
  • Inherit, operate, and progressively migrate the working prototype estate (Google Workspace‑native automation across Apps Script, Drive, and the Docs/Sheets/Slides APIs; locally scheduled jobs; and Claude Code agent tooling) to the target platform without interrupting daily and board‑cycle workflows. Working software wins arguments; migrate by strangling, not rewriting. Reuse and integrate with OKX's prevailing and evolving AI capabilities and data infrastructure, including enterprise‑approved models and gateways, Model Context Protocol (MCP) servers and connectors, security tooling, and group data platforms, before building parallel capability.
  • Re‑architect Hive Mind into a resilient AWS or GCP platform with high availability (HA), disaster recovery (DR), defined service‑level objectives (SLOs), and full observability, and own it in production.
  • Build the agentic runtime and harness: orchestration, multi‑model routing that sends each task to the right model, tool, MCP, and plugin integration across model providers, and the evaluation, red‑team, and regression harnesses that grade agents before and after production, with evaluation gates, judge calibration, and cost controls that hold for each model, including prompt‑injection and data‑exfiltration threat modeling for agents that read untrusted content.
  • Build the Responsible‑AI and model‑governance layer: hallucination, bias, and drift controls, output validation, guardrails, and complete logging. Extend the existing governance design (human‑calibrated judge gates, golden‑set regression, provenance registry) rather than replacing it. New model providers enter through the same governance and approved‑tooling review, not around it.
  • Build data infrastructure with provenance and lineage: immutable audit trails, versioned evidence, reproducible pipelines, and traceability from source to report.
  • Engineer data protection: encryption, key and secrets management, least‑privilege access, sensitive‑data handling, residency, and defensible retention.
  • Stand up the computer‑assisted audit technique (CAAT) and continuous‑monitoring data foundation: analytics over full populations, with exceptions streamed in real time. Auditors and the hiring manager define the audit logic; you make it run at production grade.
  • Own the cloud foundation: infrastructure‑as‑code, CI/CD, identity, networking, observability, and cost controls, and make the platform examinable.
What We Look For In You
  • 7+ years building and operating resilient backend or platform systems in production, including on‑call ownership over time.
  • Proven brownfield migrations: you have taken a founder‑built or prototype system to production grade while it stayed in daily use.
  • Strong engineering fundamentals: data structures and algorithms, fluent Python, strong SQL and data modeling, plus one additional systems language (TypeScript/Node or Go), with the full‑stack range to connect the infrastructure yourself.
  • Agentic runtime and harness engineering, proven by building: the field is too young to demand years of it, so we weigh real systems shipped over tenure. You have genuinely built model‑agnostic agent orchestration, model routing and evaluation across providers, agent SDKs (Claude Agent SDK or equivalent), MCP servers, skill‑and‑hook‑based agent tooling, and the evaluation and red‑team harnesses that grade agent behavior, with responsible‑AI controls (hallucination, bias, drift).
  • Data engineering with provenance and lineage, and security and data‑protection engineering by default (encryption, identity and access management, secrets, retention). You build systems that could withstand external audit, by design.
  • Cloud (AWS or GCP) plus resilience engineering: infrastructure‑as‑code (Terraform), CI/CD, HA, DR, SLOs, and observability, backed by automated testing and documentation.
  • You ship inside locked‑down enterprise environments (TLS‑intercepting proxies, endpoint detection and response tooling, restricted installs, security guardrails, OAuth admin consent) without treating security as someone else’s problem.
  • Partnership: you translate audit needs into systems, explain technical risk to non‑engineers, and drive adoption.
Nice to Haves
  • Multi‑agent orchestration frameworks, MCP servers, and tooling and plugin development across the Anthropic, OpenAI, and Google model ecosystems.
  • Model‑risk or AI‑governance program experience; frameworks such as the NIST AI Risk Management Framework.
  • Continuous‑auditing or continuous‑controls‑monitoring platforms; streaming and real‑time data at scale; statistical anomaly detection and applied machine learning beyond LLMs; vector stores and retrieval; LLM cost engineering.
  • Experience passing external audit, SOC 2, or SOX (helpful, not required).
  • Crypto and blockchain literacy; regulated financial‑services, fintech, or crypto experience.
Benefits and Perks
  • "L&D programs and Education subsidy for employees' growth and development"
  • "Various team building programs and company events"
  • "Wellness and meal allowances"
  • "Comprehensive healthcare schemes for employees and dependants"

OKX is committed to equal employment opportunities regardless of race, color, genetic information, creed, religion, sex, sexual orientation, gender identity, lawful alien status, national origin, age, marital status, and non‑job related physical or mental disability, or protected veteran status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

The salary range for this position is $178,000 - $321,000

The salary offered depends on a variety of factors, including job‑related knowledge, skills, experience, and market location. In addition to the salary, a performance bonus and long‑term incentives may be provided as part of the compensation package, as well as a full range of medical, financial, and/or other benefits, dependent on the position offered.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Full-Stack / Applications Engineer
Senior AI Full-Stack / Applications Engineer

OKX • San Jose (CA)

On-site
USD 178,000 - 321,000
L&D programs
Wellness allowance
Meal allowances
+2
Sr Software Engineer, Front End
Sr Software Engineer, Front End

OKX • San Jose (CA)

On-site
USD 178,000 - 269,000
Wellness and meal allowances
Comprehensive healthcare
Education subsidy
+1
Principal AI Engineer, AI Agent Development San Jose, California, United States
Principal AI Engineer, AI Agent Development San Jose, California, United States

OKX • San Jose (CA)

On-site
USD 313,000 - 450,000
Performance bonus
Full range of medical benefits
Long-term incentives
Director, Compliance Data Science & AI
Director, Compliance Data Science & AI

Okx • San Jose (CA)

On-site
USD 313,000 - 376,000
L&D programs
Wellness and meal allowances
Comprehensive healthcare
Senior Software Engineer, AI Trading
Senior Software Engineer, AI Trading

OKX • San Jose (CA)

On-site
USD 223,000 - 269,000
Competitive total compensation package
L&D programs and Education subsidy
Wellness and meal allowances
+1
Principal AI Engineer, AI Agent Development
Principal AI Engineer, AI Agent Development

OKX • San Jose (CA)

On-site
USD 313,000 - 450,000
Performance bonus
Medical benefits
Financial benefits
AI Native Platm Architect
AI Native Platm Architect

Framework Ventures • Rockville (MD)

On-site
USD 170,000 - 210,000
Competitive total compensation package
L&D programs and Education subsidy
Team building programs and companys'\n
+3
Senior Software Engineer, AI Trading
Senior Software Engineer, AI Trading

P2P • San Jose (CA)

On-site
USD 223,000 - 269,000
Competetive total compensation package
L&D programs and Education subsidy
Wellness and meal allowances
Senior/Staff Machine Learning Engineer
Senior/Staff Machine Learning Engineer

OKX • San Jose (CA)

On-site
USD 214,000 - 322,000
Senior/Staff Machine Learning Engineer
Senior/Staff Machine Learning Engineer

Unchain Data • San Jose (CA)

On-site
USD 223,000 - 269,000