Senior ML Data Pipeline Architect

Adobe

San Francisco

On-site

VES 188,574,000 - 354,662,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Adobe seeks a Principal ML Engineer to optimize cost per asset and boost throughput across ML pipelines behind multimodal foundation models. You will own end-to-end economics of turning billions of raw assets into training-ready data, influencing modeling and infrastructure teams.

The role requires 10+ years in ML systems, strong Python and systems languages, and experience scaling data pipelines. You will collaborate with data platforms and modeling teams to deliver cost-efficient, high-quality

Qualifications

  • 10+ years in ML systems, ML infrastructure, or applied ML engineering at scale.
  • Proven track record cutting the cost of large-scale ML data pipelines.
  • Deep expertise in optimizing inference for VLMs/LLMs and distillation.
  • Experience with data curation and data quality for training generative or multimodal models.
  • Strong Python and at least one systems language (C++, Rust, Go, Java); distributed frameworks such as Ray or Spark.
  • Clear communication across modeling, infrastructure, and data teams.
  • Bachelor's, Master's, or Ph.D. in CS, Engineering, ML, or a related field.

Responsibilities

  • Own cost per asset across the full pipeline, including compute, storage, data access and movement, and reprocessing.
  • Optimize pipeline DAGs to cut cost, such as running cheap filters first to reduce waste.
  • Improve throughput of pipelines running VLMs, LLMs, captioners, embedding and quality models via batching, parallelism, quantization, and serving optimizations.
  • Distill larger models into smaller, cheaper ones while preserving labeling and filtering quality.
  • Decide where specialized models, general models, or cascades give the best cost/quality tradeoff.
  • Build evaluation frameworks to ensure efficiency gains don't degrade data quality.
  • Develop a deep understanding of what makes data valuable for training LLMs, VLMs, and diffusion models, encoding it into filtering, scoring and selection.
  • Partner with modeling teams to connect pipeline changes to training outcomes.
  • Work with data platform teams on orchestration (e.g., Ray), scheduling, and storage for cost-efficient ML workloads.

Skills

ML systems
ML infra
Python
C++
Rust
Ray
Spark
Communication

Education

Bachelor's/Master's/PhD in CS/Engineering/ML

Tools

Ray
Spark

Job description

Adobe seeks a Principal ML Engineer to optimize cost per asset and boost throughput across ML pipelines behind multimodal foundation models. You will own end-to-end economics of turning billions of raw assets into training-ready data, influencing modeling and infrastructure teams.

The role requires 10+ years in ML systems, strong Python and systems languages, and experience scaling data pipelines. You will collaborate with data platforms and modeling teams to deliver cost-efficient, high-quality

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer: Big Data & Marketing Optimization
ML Engineer: Big Data & Marketing Optimization

Adobe • San Francisco

On-site
VES 93,601,000 - 184,872,000
Staff ML Engineer, Security AI & Anomaly Detection
Staff ML Engineer, Security AI & Anomaly Detection

Adobe • San Francisco

On-site
VES 157,678,000 - 280,279,000
Principal AI Data Product Manager
Principal AI Data Product Manager

Adobe • San Francisco

On-site
VES 135,375,000 - 257,861,000
Senior Platform Engineer — AI-Driven Deployment & Scale
Senior Platform Engineer — AI-Driven Deployment & Scale

Adobe • San Francisco

On-site
VES 190,402,000 - 275,686,000
Principal Scientist - Data Pipeline Engineer
Principal Scientist - Data Pipeline Engineer

Adobe • San Francisco

On-site
VES 188,574,000 - 354,662,000
Senior ML Engineer - NLP & LLM, Remote Impact
Senior ML Engineer - NLP & LLM, Remote Impact

BairesDev • Venezuela

Remote
VES 107,431,000 - 143,241,000
Remote work
USD salary
Home office setup
+4
Senior Full-Stack Engineer, AI Agentic Product
Senior Full-Stack Engineer, AI Agentic Product

Adobe • San Francisco

On-site
VES 143,165,000 - 271,223,000
Sr / Staff Machine Learning Engineer
Sr / Staff Machine Learning Engineer

Adobe • San Francisco

On-site
VES 157,678,000 - 280,279,000
Principal Product Manager, GenAI Training Data
Principal Product Manager, GenAI Training Data

Adobe • San Francisco

On-site
VES 135,375,000 - 257,861,000
ML Engineer Intern — Build AI Systems & Gen AI
ML Engineer Intern — Build AI Systems & Gen AI

Adobe • San Francisco

Hybrid
VES 56,665,000 - 69,258,000
Hybrid work arrangement
Exposure to cutting-edge AI research
Top locations