Senior Data Platform Engineer: Cloud-Scale Data Pipelines

Crustdata (YC F24); San Francisco (CA); On-site; USD 140,000 - 200,000; Full time

Job summary

A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience in software engineering, particularly in data engineering. You will develop robust data pipelines and support data science initiatives, using modern tools and technologies. A collaborative, fast-paced startup mentality is essential for this role.

Qualifications

• 3+ years of professional software engineering experience focused on data engineering.
• Strong programming skills in Python or modern languages like Java or Go.
• Experience with big data technologies and pipeline orchestration tools.

Responsibilities

• Design, build, and maintain data infrastructure and analytics platforms.
• Develop and scale data pipelines (ETL/ELT).
• Implement workflow orchestration for daily data jobs.

Skills

Python

Big Data technologies (Spark, Flink, Dask)

Workflow management tools (Airflow, Dagster, Prefect)

Problem-solving

Collaboration

Tools

Kafka

Docker

Kubernetes

Job description

A growing tech company in San Francisco is looking for a Software Engineer to design and build scalable data systems. The ideal candidate has at least 3 years of experience in software engineering, particularly in data engineering. You will develop robust data pipelines and support data science initiatives, using modern tools and technologies. A collaborative, fast-paced startup mentality is essential for this role.