Staff Data Platform Architect - Streaming & AI Pipelines

Perplexity; Palo Alto (CA); On-site; USD 220,000 - 405,000; Full time

Job summary

Perplexity is looking for a Senior/Staff Engineer for the Data Platform team in Palo Alto, California. This role involves owning the data lifecycle, from ingestion to serving, shaping architecture, and setting standards across the data ecosystem.

Ideal candidates will have over 5 years of experience in software engineering and strong skills in building data infrastructure systems. The compensation range is $220K - $405K.

Qualifications

• 5+ years (Senior) or 8+ years (Staff) of software engineering experience.
• Hands-on experience with batch and/or streaming data processing at scale.
• Strong experience building production data infrastructure systems.

Responsibilities

• Design and operate large-scale batch and streaming data pipelines.
• Build event-driven and streaming systems for real-time ingestion.
• Lead the architecture of data orchestration using tools like Airflow.

Skills

Software engineering experience

Data infrastructure systems

Data orchestration systems

Python

Additional backend language (Go, TypeScript)

ML/AI workflows

Tools

Airflow

Dagster

Kafka

Databricks

Snowflake

Job description

Perplexity is looking for a Senior/Staff Engineer for the Data Platform team in Palo Alto, California. This role involves owning the data lifecycle, from ingestion to serving, shaping architecture, and setting standards across the data ecosystem.

Ideal candidates will have over 5 years of experience in software engineering and strong skills in building data infrastructure systems. The compensation range is $220K - $405K.