Senior Data Platform Engineer — Scale Pipelines

Persona; San Francisco (CA); On-site; USD 130,000 - 180,000; Full time

Benefits offered by this job

Medical, Dental, and Vision Insurance

401(k) contribution

Unlimited PTO

Quarterly mental health days

Professional development stipend

Job summary

Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role, you will design and operate systems that manage data at massive scale, working on datalakes and data pipelines. This position demands expertise in software engineering and distributed systems.

You will collaborate closely with engineering, data science, and infrastructure teams to ensure performance, reliability, and cost efficiency of the platform.

The role offers comprehensive benefits including medical, dental, vision, and unlimited PTO for full-time employees.

Qualifications

• 5+ years of experience in software engineering, especially in data infrastructure.
• Proficiency in Python; excited to learn Go.
• Hands-on with big data and streaming technologies.

Responsibilities

• Build and scale the datalake and ingestion pipelines.
• Own streaming and batch ingestion services.
• Develop query and analytics capabilities on the datalake.

Skills

Software Engineering

Data Infrastructure

Python

Big Data Technologies

Streaming Technologies

Distributed Systems

Communication

Tools

Spark

Kafka

Flink

Go

ClickHouse

Job description

Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role, you will design and operate systems that manage data at massive scale, working on datalakes and data pipelines. This position demands expertise in software engineering and distributed systems.

You will collaborate closely with engineering, data science, and infrastructure teams to ensure performance, reliability, and cost efficiency of the platform.

The role offers comprehensive benefits including medical, dental, vision, and unlimited PTO for full-time employees.