Senior Data Infrastructure Engineer – Pipelines & AWS

Aurora; Pittsburgh, Mountain View, San Francisco (Allegheny County, CA, CA); Hybrid; USD 146,000 - 260,000; Full time

Benefits offered by this job

Annual bonus

Equity compensation

Benefits

Job summary

Aurora is seeking a talented Software Engineer to join our data engineering and infrastructure team. You will design, build, and maintain the core data lake and warehouse infrastructure, enabling scalable analytics and product insight.

You will work with AWS, Spark, Presto/Trino, Airflow, and DBT to deliver robust data solutions at scale while collaborating with data scientists, analysts, and product teams. The role supports a hybrid work model and offers a competitive compensation package.

Qualifications

• Master’s degree in Computer Science, Engineering, or related field, or equivalent practical experience.
• 5+ years of professional software engineering experience with a focus on data projects.
• Proficiency in Python, Go or C++.
• Solid experience with big data processing frameworks such as Presto/Trino, EMR, Spark, Flink, Kinesis or similar.
• Hands-on experience with cloud platforms (AWS, GCP, or Azure) and their data services (S3, Redshift, BigQuery, Glue).
• Strong knowledge of SQL and relational/NoSQL databases.
• Knowledge of data analytics infrastructure, including DBT and visualization tools.
• Experience with Apache Airflow for data pipelines.

Responsibilities

• Design, build, and maintain robust, scalable data pipelines and ETL/ELT processes into our data warehouse.
• Develop and manage data infrastructure components using AWS and Terraform.
• Collaborate with data scientists, analysts, autonomy teams, and product groups to meet data needs.
• Optimize data processing for performance, reliability, and cost-efficiency.
• Implement monitoring, alerting, and logging for pipelines and infra to ensure stability.
• Champion data governance, data quality, and security best practices.
• Work with senior team members to improve data ecosystem tooling and roadmap.

Skills

Python

Go

C++

SQL

Data pipelines

Communication

Education

Master’s degree in Computer Science

Tools

Presto/Trino

EMR

Apache Spark

Flink

Kinesis Data Streams

Airflow

DBT

Redshift

BigQuery

Glue

Terraform

Job description

Aurora is seeking a talented Software Engineer to join our data engineering and infrastructure team. You will design, build, and maintain the core data lake and warehouse infrastructure, enabling scalable analytics and product insight.

You will work with AWS, Spark, Presto/Trino, Airflow, and DBT to deliver robust data solutions at scale while collaborating with data scientists, analysts, and product teams. The role supports a hybrid work model and offers a competitive compensation package.