Senior Data Platform Engineer: Pipelines, Cloud & Infra

Aurora; Pittsburgh (Allegheny County); Hybrid; USD 146,000 - 234,000; Full time

Benefits offered by this job

Hybrid work schedule

Annual bonus

Equity compensation

Job summary

Aurora is hiring a Software Engineer–Data Engineering to design and maintain scalable data pipelines and the data platform. You will work on the data lake/warehouse, pipelines, and tooling to ensure high-quality, secure data for insights and product innovation.

You will collaborate with data scientists, autonomy engineers, and product teams to deliver robust data solutions, using AWS, Airflow, and DBT in a fast-moving environment and hybrid work model.

Qualifications

• Master’s degree or equivalent practical experience.
• 5+ years of professional software engineering with a focus on data.
• Proficiency in Python, Go, or C++.
• Experience with big data processing frameworks (Presto/Trino, EMR, Spark, Flink, Kinesis, or similar).
• Hands-on with cloud platforms (AWS, GCP, or Azure) and data services (S3, Redshift, BigQuery, Glue).
• Strong SQL knowledge and experience with relational and NoSQL databases.
• Intermediate knowledge of data analytics infra, including DBT and visualization tools.
• Experience with Airflow for orchestration.
• Able to design scalable data solutions for open-ended questions.
• Experience working cross-functionally with multiple teams.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes for data ingestion to the warehouse.
• Develop data infrastructure components using AWS and infrastructure as code tools like Terraform.
• Collaborate with data scientists, analysts, and product teams to meet data needs.
• Optimize data processing for performance, reliability, and cost-efficiency.
• Implement monitoring, logging, and alerting for data pipelines and infra.
• Champion data governance, quality, and security practices.
• Improve data ecosystem tooling and roadmap with senior team members.

Skills

Python

Go

C++

SQL

Data pipelines

ETL/ELT

Communication

Data governance

Education

Master’s degree in Computer Science, Engineering, or related field

Tools

Terraform

Apache Airflow

DBT

Presto/Trino

Apache Spark

EMR

Kinesis

S3/Redshift

BigQuery

Job description

Aurora is hiring a Software Engineer–Data Engineering to design and maintain scalable data pipelines and the data platform. You will work on the data lake/warehouse, pipelines, and tooling to ensure high-quality, secure data for insights and product innovation.

You will collaborate with data scientists, autonomy engineers, and product teams to deliver robust data solutions, using AWS, Airflow, and DBT in a fast-moving environment and hybrid work model.