Senior Software Engineer, Data Platform

Avala; San Francisco (CA); Ibrido; USD 170.000 - 220.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health, dental, vision coverage

FSA

Unlimited PTO

Equity

Descrizione del lavoro

Avala is building a data platform to ingest, store, and curate multi-sensor recordings from autonomous vehicle and robotics fleets. You will design systems handling petabytes of LiDAR, camera, and radar data with sub-second query performance.

Role focuses on high-throughput pipelines, dataset curation, and API design for web UI and SDKs. Strong Python/TypeScript and distributed data processing experience required, with cloud storage expertise.

Competenze

• 5+ years building data infrastructure or platform engineering systems
• Strong Python and/or TypeScript with production systems experience
• Experience with distributed data processing (Spark, Flink, or custom pipelines)
• Deep knowledge of PostgreSQL, Redis, and cloud storage (S3/GCS)
• Experience designing APIs for developer platforms

Mansioni

• Design and build high-throughput data ingestion pipelines for fleet sensor data
• Implement dataset curation tools - search, filter, slice, and export at scale
• Build the Sessions system that groups recordings into logical units for annotation
• Optimize storage and retrieval for petabyte-scale multi-modal datasets
• Integrate with customer data lakes (S3, GCS) via zero-copy indexing
• Design APIs that power both the web UI and Python/TypeScript SDKs

Conoscenze

Python

TypeScript

Distributed data processing

PostgreSQL

Redis

APIs for developer platforms

Strumenti

Spark

Flink

S3/GCS

Descrizione del lavoro

Posted 6 months ago San Francisco, CA full-time

About This Role

Build Avala's data platform - the ingestion, storage, and curation layer that processes multi-sensor recordings from production autonomous vehicle and robotics fleets. You'll design systems that handle petabytes of LiDAR, camera, and radar data with sub-second query performance.

What You'll Do

• Design and build high-throughput data ingestion pipelines for fleet sensor data
• Implement dataset curation tools - search, filter, slice, and export at scale
• Build the Sessions system that groups recordings into logical units for annotation
• Optimize storage and retrieval for petabyte-scale multi-modal datasets
• Integrate with customer data lakes (S3, GCS) via zero-copy indexing
• Design APIs that power both the web UI and Python/TypeScript SDKs

Requirements

• 5+ years building data infrastructure or platform engineering systems
• Strong Python and/or TypeScript with production systems experience
• Experience with distributed data processing (Spark, Flink, or custom pipelines)
• Deep knowledge of PostgreSQL, Redis, and cloud storage (S3/GCS)
• Experience designing APIs for developer platforms

Nice to Have

• Experience with robotics data formats (MCAP, ROS bags, nuScenes)
• Familiarity with sensor fusion or multi-modal data pipelines
• Experience building search/indexing systems at scale

What We Offer

• Competitive salary and meaningful equity in the team building Fleet Learning Infrastructure for Physical AI
• Full health, dental, and vision coverage, plus FSA and unlimited PTO
• Work on the closed-loop data infrastructure that the next generation of autonomous systems learns from
• A team that built Tesla Autopilot's data infrastructure, now building something bigger