Senior ML Data Pipeline Architect

Adobe; San Jose (CA); On-site; USD 268,000 - 388,000; Full time

Job summary

Adobe is seeking a Principal ML Engineer to architect and scale the multimodal data processing pipelines and infrastructure behind Firefly’s multimodal foundation models (image, video, audio). You will build distributed, GPU‑accelerated systems turning billions of raw assets into training‑ready data at scale, influencing throughput, reliability, and data quality for model training.

This senior individual contributor role requires deep expertise in data engineering, ML infrastructure, and

Qualifications

• 10+ years in data engineering, ML infrastructure, or distributed systems.
• Experience with large-scale data processing frameworks.
• Proficient in Python and systems languages (C++, Rust, Go, or Java).
• Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or ML.

Responsibilities

• Architect and optimize large‑scale distributed data pipelines processing billions of assets.
• Scale up inference throughput across pipelines to improve training data speed and cost.
• Design and manage data infrastructure for storage, indexing, and retrieval at scale.
• Collaborate with modeling teams to align data curation with training goals.

Skills

Python

Distributed systems

Data pipelines

Ray

Spark

C++

Go

Java

Data processing

ML inference

Education

Computer Science degree

Tools

Ray

Spark

Job description

Adobe is seeking a Principal ML Engineer to architect and scale the multimodal data processing pipelines and infrastructure behind Firefly’s multimodal foundation models (image, video, audio). You will build distributed, GPU‑accelerated systems turning billions of raw assets into training‑ready data at scale, influencing throughput, reliability, and data quality for model training.

This senior individual contributor role requires deep expertise in data engineering, ML infrastructure, and