Senior Data Platform Engineer: Build Scalable Data Foundations

Stack AV; Pittsburgh (Allegheny County); Hybrid; USD 100,000 - 130,000; Full time

Job summary

Stack AV is seeking a Senior Data Platform Engineer to design and operate data systems that enable efficient engineering workloads. The ideal candidate will have over 7 years of experience in distributed storage systems and be proficient in Python and SQL.

This role involves collaboration across teams to optimize workloads and improve platform capabilities, all while working within a culture that values diversity and innovation.

The position offers the chance to work with cutting-edge technologies in a dynamic environment.

Qualifications

• 7+ years of experience building and operating distributed storage systems or modern data platforms.
• Experience operating streaming platforms such as Kafka or Pulsar.
• Fluent in Python and SQL, with experience in data applications using Trino and Apache Spark.

Responsibilities

• Design and operate distributed storage systems for large-scale batch workloads.
• Build and maintain an open source, modern data platform.
• Optimize storage resources and improve reliability of storage systems.

Skills

Distributed storage systems

Data platforms

Python

SQL

Kafka

Trino

Apache Spark

Tools

Iceberg

Delta Lake

Hudi

Xtable

Postgres

MySQL

Job description

Stack AV is seeking a Senior Data Platform Engineer to design and operate data systems that enable efficient engineering workloads. The ideal candidate will have over 7 years of experience in distributed storage systems and be proficient in Python and SQL.

This role involves collaboration across teams to optimize workloads and improve platform capabilities, all while working within a culture that values diversity and innovation.

The position offers the chance to work with cutting-edge technologies in a dynamic environment.