Staff Data Infra Architect – High-Scale ML Pipelines

Rhoda AI; Palo Alto (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Rhoda AI in Palo Alto seeks a senior data infrastructure leader to architect, build, and scale a high-throughput data platform handling billions of video clips. You will own systems from storage to indexing, focusing on reliability, latency, and cost efficiency while collaborating with research and ML teams.

You will design observable pipelines, optimize throughput, manage data artifacts and lineage, and develop internal tools to enable researchers to explore datasets at scale.

Qualifications

• 5+ years in data infrastructure, distributed systems, ML infrastructure, or related field.
• Experience building and operating large-scale data pipelines (1B+ samples or petabyte-scale).
• Strong understanding of distributed databases, storage, and cloud architectures.
• Proven ability to optimize throughput, balance workloads, and manage costs in cloud environments.
• Experience with Ray or Spark for large-scale processing and transformation.
• Strong observability, monitoring, and reliability practices for high-scale systems.
• Ability to own end-to-end systems from design to production.
• Staff-level candidates should define technical direction and own architectural decisions.

Responsibilities

• Architect, build, and scale high-throughput data infrastructure for billions of video clips with reliability, latency, and cost guarantees.
• Design and optimize large-scale storage systems for multimodal datasets.
• Build efficient indexing and retrieval systems for fast dataset querying and iteration.
• Develop observability frameworks for data pipelines including monitoring and failure recovery.
• Implement intelligent workload balancing across distributed compute and storage.
• Manage data artifacts, versioning, and lineage for reproducibility across training runs.
• Build internal tools to enable researchers and engineers to explore and analyze large datasets at scale.
• Support integration of vision-language models within data pipelines for screening and metadata generation.

Skills

Data infrastructure

Distributed systems

ML infrastructure

Cloud storage architectures

Observability & reliability

End-to-end ownership

Education

Bachelor's degree in Computer Science or related

Tools

Ray

Spark

BigQuery

Redshift

Job description

Rhoda AI in Palo Alto seeks a senior data infrastructure leader to architect, build, and scale a high-throughput data platform handling billions of video clips. You will own systems from storage to indexing, focusing on reliability, latency, and cost efficiency while collaborating with research and ML teams.

You will design observable pipelines, optimize throughput, manage data artifacts and lineage, and develop internal tools to enable researchers to explore datasets at scale.