Sr. Software Engineer, Machine Learning & Data Infrastructure

OKX

San Jose (CA)

On-site

USD 179,000 - 268,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

OKX in San Jose, CA, is seeking a Sr. Software Engineer, Machine Learning & Data Infrastructure to build and optimize the ML infrastructure behind risk and fraud systems.

You will move models from experimentation to production, improve inference latency, and build data pipelines using Databricks and Spark, plus feature services for decision systems. Collaboration across ML, data engineering, cloud, security, and product teams is expected.

Qualifications

  • Experience building and operating distributed systems or ML infrastructure.
  • Hands-on experience improving production model performance (latency, throughput, cost).
  • Strong Python and SQL, plus one backend language (Java/Scala/Go/C++).
  • Experience with Databricks and Spark, including optimization and data correctness.

Responsibilities

  • Improve model inference latency, throughput, and resource utilization while preserving quality.
  • Build infrastructure for packaging, deployment, serving, monitoring, and rollback across cloud platforms.
  • Develop offline data pipelines with Databricks and Spark; optimize data models and costs.
  • Support feature pipelines and data integrations for risk models and decision systems.
  • Collaborate with ML, data engineering, cloud, security, and product teams; code reviews.

Skills

Python
SQL
Distributed systems
ML infrastructure
Production model perf.

Tools

Databricks
Spark
ONNX Runtime
TensorRT
Delta Lake
MLflow
Kafka
Flink

Job description

Sr. Software Engineer, Machine Learning & Data Infrastructure

San Jose, California, United States

Who We Are

At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er.

About the Opportunity

We are looking for a seasoned engineer to build and improve the ML and data infrastructure behind our risk and fraud prevention systems. You will work hands-on to move models from experimentation into reliable production services, improve model execution performance, and develop data pipelines that support training, evaluation, and real-time decisions. You will take ownership of your work, identify improvements proactively, and deliver with limited guidance

What You’ll Be Doing
  • Improve model inference latency, throughput, resource utilization, and cost. Profile the prediction path—from feature retrieval and preprocessing to model execution and implement measurable improvements while preserving model quality.
  • Build and maintain infrastructure for model packaging, versioning, deployment, serving, monitoring, and rollback across cloud platforms and regions.
  • Develop and optimize offline data pipelines using Databricks, Apache Spark , and warehouse or lakehouse technologies. Address data modeling, partitioning, joins, shuffles, skew, incremental processing, and cost.
  • Work on offline and online feature pipelines, supporting point-in-time correctness, consistent feature definitions, freshness, lineage, and reproducible backfills.
  • Build and maintain reliable feature services and data integrations for risk models and decision systems.
  • Take ownership of projects and operational issues, communicate progress and tradeoffs, and collaborate with ML, data engineering, cloud infrastructure, security, and product teams.
  • Contribute to technical discussions, share knowledge, and help teammates through code reviews and collaboration.
What We Look For In You
  • Experience building and operating distributed systems, ML infrastructure, or data platforms, with ownership of meaningful production components.
  • Hands-on experience improving production model performance, such as latency, throughput, resource utilization, or cost.
  • Strong experience with Databricks and Spark, or comparable offline data platforms, including execution plans, distributed query optimization, storage layouts, data correctness, and workload cost management.
  • Experience with the model lifecycle, including training and serving integration, validation, deployment, observability, and rollback.
  • Strong Python and SQL skills, plus proficiency in at least one backend or systems language such as Java, Scala, Go, or C++.
  • Ability to work independently through loosely defined problems, make sound implementation decisions, and deliver maintainable systems with limited guidance.
Nice to Haves

SageMaker, Alibaba Cloud PAI/EAS, or comparable ML platforms.

Inference optimization using tools such as ONNX Runtime, TensorRT, or Triton.

Delta Lake, MLflow, feature stores, Kafka, Flink, and low-latency data stores.

Fraud detection or financial risk systems.

Fluency in Mandarin

L&D programs for employees' growth and development

Various team building programs and company events

Wellness and meal allowances

Comprehensive healthcare schemes for employees and dependants

More that we love to tell you along the process!

OKX Statement:

OKX is committed to equal employment opportunities regardless of race, color, genetic information, creed, religion, sex, sexual orientation, gender identity, lawful alien status, national origin, age, marital status, and non-job related physical or mental disability, or protected veteran status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

The salary range for this position is $178,888 to $268,333

The salary offered depends on a variety of factors, including job-related knowledge, skills, experience, and market location. In addition to the salary, a performance bonus and long-term incentives may be provided as part of the compensation package, as well as a full range of medical, financial, and/or other benefits, dependent on the position offered.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, Machine Learning & Data Infrastructure
Staff Engineer, Machine Learning & Data Infrastructure

OKX • San Jose (CA)

Hybrid
USD 215,000 - 322,000
Performance bonus
Long-term incentives
Medical benefits
Sr. Software Engineer, Machine Learning & Data Infrastructure
Sr. Software Engineer, Machine Learning & Data Infrastructure

Unchain Data • San Jose (CA)

On-site
USD 179,000 - 268,000
Competitive compensation package
Learning & Development programs
Team events & company gatherings
+2
Staff Engineer, Machine Learning & Data Infrastructure
Staff Engineer, Machine Learning & Data Infrastructure

Unchain Data • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive total compensation package
Wellness and meal allowances
Healthcare coverage
Staff Engineer, Machine Learning & Data Infrastructure
Staff Engineer, Machine Learning & Data Infrastructure

Okx • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive compensation
L&D programs
Team building events
+2
Sr. Software Engineer, Machine Learning & Data Infrastructure OKX Est. $80,000 - $125,000 San Jose, California, United States Engineering Software Machine Learning San Jose, California, United States 18 hours ago
Sr. Software Engineer, Machine Learning & Data Infrastructure OKX Est. $80,000 - $125,000 San Jose, California, United States Engineering Software Machine Learning San Jose, California, United States 18 hours ago

SportsTechJobs • San Jose (CA)

On-site
USD 179,000 - 268,000
Competitive total compensation
Wellness and meal allowances
Healthcare schemes
Sr. Software Engineer, Machine Learning & Data Infrastructure OKX San Jose, California, United States $179–268K Engineering check more →
Sr. Software Engineer, Machine Learning & Data Infrastructure OKX San Jose, California, United States $179–268K Engineering check more →

Neobankbeat • San Jose (CA)

On-site
USD 179,000 - 268,000
Competitive compensation package
Wellness and meal allowances
Comprehensive healthcare for employees
Staff Engineer, Machine Learning & Data Infrastructure OKX Est. $210,000 - $265,000 San Jose, California, United States Engineering Machine Learning Data San Jose, California, United States 17 hours ago
Staff Engineer, Machine Learning & Data Infrastructure OKX Est. $210,000 - $265,000 San Jose, California, United States Engineering Machine Learning Data San Jose, California, United States 17 hours ago

SportsTechJobs • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive total compensation
Wellness and meal allowances
Healthcare for employees and dependn/$
+1
Machine Learning Engineer — Risk & AI
Machine Learning Engineer — Risk & AI

Unchain Data • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive total compensation package
L&D programs for growth
Team building programs and company ife
+2
Staff Machine Learning Engineer — Risk & AI
Staff Machine Learning Engineer — Risk & AI

Okx • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive total compensation package
L&D programs for employees' growth and
Team building programs and company-"s
Sr/Principal Data Scientist, Risk Strategy
Sr/Principal Data Scientist, Risk Strategy

Okx • San Jose (CA)

On-site
USD 223,661 - 268,333
Competitive total compensation package
L&D programs and education subsidy
Team building programs and company events
+2