Staff Data Platform Architect

Perplexity; San Francisco (CA); On-site; USD 130,000 - 170,000; Full time

Job summary

Perplexity is looking for a Senior/Staff Data Engineer to shape the architecture of its data ecosystems. The role involves designing and operating large-scale data pipelines for product features and AI workflows, ensuring data correctness and observability.

Candidates should have 5+ years of experience (Senior) or 8+ years (Staff) in software engineering, with a focus on production data infrastructure systems and data orchestration tools. Strong Python skills are a must.

Qualifications

• 5+ years (Senior) or 8+ years (Staff) of software engineering experience.
• Strong experience building production data infrastructure systems.
• Deep familiarity with data orchestration systems (Airflow, Dagster, etc.).

Responsibilities

• Design and operate large-scale batch and streaming data pipelines.
• Lead the architecture of data orchestration and management.
• Mentor engineers and enhance data infrastructure.

Skills

Software engineering experience

Production data infrastructure systems

Data processing at scale

Data orchestration systems

Python proficiency

Backend languages

Machine learning workflows

Tools

Airflow

Kafka

Databricks

Flink

Snowflake

Job description

Perplexity is looking for a Senior/Staff Data Engineer to shape the architecture of its data ecosystems. The role involves designing and operating large-scale data pipelines for product features and AI workflows, ensuring data correctness and observability.

Candidates should have 5+ years of experience (Senior) or 8+ years (Staff) in software engineering, with a focus on production data infrastructure systems and data orchestration tools. Strong Python skills are a must.