Staff Engineer: ML Data Infrastructure & Pipelines

D8 LooP

San Jose (CA)

On-site

USD 180,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OKX in San Jose is seeking a Staff Engineer to design and optimize offline data pipelines for ML infrastructure, working with Databricks, Spark, and warehouse technologies. You will implement scalable data foundations for training, evaluation, and real-time decisions, with a focus on cost and performance.

Collaborate across teams to move models from experimentation to production, ensure reproducibility with feature backfills, and build reusable infrastructure for packaging, versioning,

Qualifications

  • Proficient in building incremental offline data pipelines with Databricks/Spark and warehousing concepts.
  • Strong Python and SQL, plus at least one backend language (Java/Scala/Go/C++).
  • Deep knowledge of Databricks/Spark, including execution plans and cost management.
  • Experience building reusable model infrastructure across cloud platforms and regions.
  • Knowledge of model lifecycle, including training/serving, validation, observability, and rollback.
  • Experience connecting offline and online feature pipelines with correct backfills.
  • Focus on cost and performance optimization.

Responsibilities

  • Design and optimize data pipelines for ML model training and deployment.
  • Improve model inference latency and throughput while managing resource costs.
  • Build and maintain data foundations for training, evaluation, and real-time decisions.
  • Collaborate to move models from experimentation to production.
  • Ensure data correctness, lineage, and backfill strategies.

Skills

Python
SQL
Spark
Databricks
Java/Scala/Go/C++
Cloud platforms (AWS/GCP)
Model lifecycle
Streaming
Backfills & idempotency
Warehousing

Tools

Databricks
Spark
AWS
GCP

Job description

OKX in San Jose is seeking a Staff Engineer to design and optimize offline data pipelines for ML infrastructure, working with Databricks, Spark, and warehouse technologies. You will implement scalable data foundations for training, evaluation, and real-time decisions, with a focus on cost and performance.

Collaborate across teams to move models from experimentation to production, ensure reproducibility with feature backfills, and build reusable infrastructure for packaging, versioning,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff ML Engineer: Data Infrastructure for Risk
Staff ML Engineer: Data Infrastructure for Risk

SportsTechJobs • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive total compensation
Wellness and meal allowances
Healthcare for employees and dependn/$
+1
Senior ML & Data Infrastructure Engineer
Senior ML & Data Infrastructure Engineer

OKX • San Jose (CA)

On-site
USD 179,000 - 268,000
Staff Engineer, ML & Data Infrastructure - Hybrid
Staff Engineer, ML & Data Infrastructure - Hybrid

OKX Group • San Jose (CA)

Hybrid
USD 215,000 - 322,000
Performance bonus
Long-term incentives
Medical benefits
Senior ML & Data Infra Engineer — Production ML
Senior ML & Data Infra Engineer — Production ML

Neobankbeat • San Jose (CA)

On-site
USD 179,000 - 268,000
Competitive compensation package
Wellness and meal allowances
Comprehensive healthcare for employees
Senior ML & Data Infrastructure Engineer
Senior ML & Data Infrastructure Engineer

SportsTechJobs • San Jose (CA)

On-site
USD 179,000 - 268,000
Competitive total compensation
Wellness and meal allowances
Healthcare schemes
Staff Engineer, Machine Learning & Data Infrastructure Staff
Staff Engineer, Machine Learning & Data Infrastructure Staff

D8 LooP • San Jose (CA)

On-site
USD 180,000 - 270,000
Staff ML & Data Infrastructure Engineer (Risk & Fraud)
Staff ML & Data Infrastructure Engineer (Risk & Fraud)

Okx • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive compensation
L&D programs
Team building events
+2
Staff ML & Data Infra Architect
Staff ML & Data Infra Architect

Unchain Data • San Jose (CA)

On-site
USD 215,000 - 322,000
Competitive total compensation package
Wellness and meal allowances
Healthcare coverage
Senior ML Engineer, Data Infrastructure & Pipelines
Senior ML Engineer, Data Infrastructure & Pipelines

Unity Enterprise • Mountain View (CA)

Hybrid
USD 200,000 - 261,000
Comprehensive health insurance
Life and disability insurance
Employee stock ownership
+3
Senior ML & Data Infra Engineer, Risk & Fraud
Senior ML & Data Infra Engineer, Risk & Fraud

Unchain Data • San Jose (CA)

On-site
USD 179,000 - 268,000
Competitive compensation package
Learning & Development programs
Team events & company gatherings
+2