Senior Data Platform Engineer - Fleet AI Infra (Equity)

Avala; San Francisco (CA); Hybrid; USD 170,000 - 220,000; Full time

Benefits offered by this job

Health, dental, vision coverage

FSA

Unlimited PTO

Equity

Job summary

Avala is building a data platform to ingest, store, and curate multi-sensor recordings from autonomous vehicle and robotics fleets. You will design systems handling petabytes of LiDAR, camera, and radar data with sub-second query performance.

Role focuses on high-throughput pipelines, dataset curation, and API design for web UI and SDKs. Strong Python/TypeScript and distributed data processing experience required, with cloud storage expertise.

Qualifications

• 5+ years building data infrastructure or platform engineering systems
• Strong Python and/or TypeScript with production systems experience
• Experience with distributed data processing (Spark, Flink, or custom pipelines)
• Deep knowledge of PostgreSQL, Redis, and cloud storage (S3/GCS)
• Experience designing APIs for developer platforms

Responsibilities

• Design and build high-throughput data ingestion pipelines for fleet sensor data
• Implement dataset curation tools - search, filter, slice, and export at scale
• Build the Sessions system that groups recordings into logical units for annotation
• Optimize storage and retrieval for petabyte-scale multi-modal datasets
• Integrate with customer data lakes (S3, GCS) via zero-copy indexing
• Design APIs that power both the web UI and Python/TypeScript SDKs

Skills

Python

TypeScript

Distributed data processing

PostgreSQL

Redis

APIs for developer platforms

Tools

Spark

Flink

S3/GCS

Job description

Avala is building a data platform to ingest, store, and curate multi-sensor recordings from autonomous vehicle and robotics fleets. You will design systems handling petabytes of LiDAR, camera, and radar data with sub-second query performance.

Role focuses on high-throughput pipelines, dataset curation, and API design for web UI and SDKs. Strong Python/TypeScript and distributed data processing experience required, with cloud storage expertise.