Principal ML Data Pipeline Architect

Adobe

Seattle (WA)

On-site

USD 206,000 - 388,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Adobe is seeking a Principal ML Engineer to optimize the economics of multimodal foundation-model data pipelines at scale. You will own the end-to-end cost per asset, drive throughput across GPU/CPU, storage, and data movement, and partner with modeling and data-platform teams to deliver cost-efficient, high-quality training data.

This is a senior individual contributor role with broad influence. You will distill larger models, experiment with cascades, and build evaluations to ensure data

Qualifications

  • 10+ years in ML systems, ML infrastructure, or applied ML engineering.
  • Proven ability to cut costs in large-scale ML pipelines.
  • Deep expertise in optimizing inference for large models (VLMs/LLMs).
  • Experience with data curation for training generative or multimodal models.
  • Strong Python plus a systems language (C++, Rust, Go, or Java).
  • Excellent cross-team communication across modeling, infrastructure, and data teams.

Responsibilities

  • Own cost per asset across the full pipeline, including compute, storage, data access and movement, and reprocessing.
  • Optimize pipeline DAGs to cut cost by smart filtering and reducing waste.
  • Improve throughput of pipelines for VLMs, LLMs, captioners, embeddings, and quality models via batching and serving optimizations.
  • Distill larger models into smaller, cheaper ones without sacrificing labeling/ filtering quality.
  • Decide where specialized/general models or cascades give best cost/quality tradeoffs.
  • Build evaluation frameworks to ensure efficiency gains preserve data quality.
  • Develop understanding of what makes data valuable for training LLMs, VLMs, and diffusion models; encode in filtering/ scoring/ selection.
  • Partner with modeling teams to connect pipeline changes to training outcomes.
  • Work with data platform teams on orchestration (e.g., Ray), scheduling, and storage for cost-efficient ML workloads.

Skills

ML systems expertise
Cost optimization
Large-model inference optimization
Data curation for generative multimod
Python
C++/Rust/Go/Java
Distributed frameworks (Ray or Spark)

Education

Bachelor's, Master's, or Ph.D. in CS/Engineering/ML

Tools

Ray
Spark

Job description

Adobe is seeking a Principal ML Engineer to optimize the economics of multimodal foundation-model data pipelines at scale. You will own the end-to-end cost per asset, drive throughput across GPU/CPU, storage, and data movement, and partner with modeling and data-platform teams to deliver cost-efficient, high-quality training data.

This is a senior individual contributor role with broad influence. You will distill larger models, experiment with cascades, and build evaluations to ensure data

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal ML Engineer — Scalable Data Pipelines
Principal ML Engineer — Scalable Data Pipelines

Adobe (old) • San Jose (CA)

On-site
USD 268,000 - 388,000
Architect, Multimodal ML Training Pipelines
Architect, Multimodal ML Training Pipelines

Electronic Arts • Redwood City (CA)

On-site
USD 227,000 - 345,000
Principal ML Engineer, Training Pipelines (Hybrid)
Principal ML Engineer, Training Pipelines (Hybrid)

Electronic Arts • Redwood City (CA)

Hybrid
USD 180,000 - 320,000
Health insurance
401(k)
Paid time off
+5
Principal Data Platform Architect & ML Pipelines Lead
Principal Data Platform Architect & ML Pipelines Lead

McKinsey • Boston (MA)

On-site
USD 180,000 - 240,000
Competitive salary
Global McKinsey community
Learning and coaching programs
ML Systems Architect: Multimodal Training Pipelines
ML Systems Architect: Multimodal Training Pipelines

Electronic Arts • Redwood City (CA)

On-site
USD 227,000 - 345,000
Paid time off
Sick time
Holidays
+5
Senior ML Data Pipeline Engineer — Equity Eligible
Senior ML Data Pipeline Engineer — Equity Eligible

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 140,000 - 270,000
Equity
Benefits
Principal Data Product Manager – ML & GenAI
Principal Data Product Manager – ML & GenAI

Figure • San Francisco (CA)

On-site
USD 154,000 - 231,000
Comprehensive medical, dental, and)
401(k) and commuter benefits
Paid family leave
Senior Data Engineer: AI/GenAI Data Pipelines Lead
Senior Data Engineer: AI/GenAI Data Pipelines Lead

McKinsey • Atlanta (GA), Boston (MA), Chicago (IL), New York (NY)

On-site
USD 176,000 - 180,000
Competitive salary
Comprehensive benefits package
Career growth opportunities
Lead ML & Media Infrastructure Architect
Lead ML & Media Infrastructure Architect

Pinterest, Inc. • San Francisco (CA)

On-site
USD 285,000 - 450,000
Senior ML Data Pipeline Architect
Senior ML Data Pipeline Architect

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 140,000 - 224,000
Equity
Benefits