Senior Data Engineer - Cloud Data Pipelines & Infra Hybrid

Aurora; Mountain View (CA); Hybrid; USD 162,000 - 260,000; Full time

Job summary

Aurora is seeking a talented Software Engineer to join our data engineering and infrastructure team. You will design, build, and maintain scalable data pipelines and the data lake/warehouse ecosystem that powers our AI and analytics platforms.

You will collaborate with data scientists, analysts, and product teams to deliver high-quality data solutions on AWS, using Terraform and Airflow, while upholding data quality and security standards. Hybrid work in Mountain View, CA.

Qualifications

• Master's degree or equivalent practical experience.
• 5+ years of software engineering with data projects.
• Proficiency in Python, Go or C++.
• Experience with big data frameworks like Spark, Presto/Trino, EMR, Flink, Kinesis.
• Cloud experience with AWS, GCP, or Azure and data services.
• Strong SQL skills with relational and NoSQL databases.
• Experience with DBT and Airflow.
• Excellent cross-functional communication.

Responsibilities

• Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes to ingest, transform, and load data from various sources into our data warehouse.
• Develop and manage data infrastructure components using AWS cloud services and infrastructure-as-code tools like Terraform.
• Collaborate with data scientists, analysts, autonomy engineering teams and product teams to understand their data needs and build solutions that meet their requirements.
• Optimize data processing systems for performance, reliability, and cost-efficiency.
• Implement monitoring, alerting, and logging for data pipelines and infrastructure to ensure operational stability.
• Champion best practices in data governance, data quality, and security.
• Work closely with other senior team members and management to improve the data ecosystem toolings, refine user experience, and continuously polish team roadmap.

Skills

Data pipelines

ETL/ELT

Python

SQL

Spark/Presto

AWS

Terraform

Airflow

Data governance

Communication

Tools

Airflow

DBT

Redshift

Snowflake

BigQuery

Job description

Aurora is seeking a talented Software Engineer to join our data engineering and infrastructure team. You will design, build, and maintain scalable data pipelines and the data lake/warehouse ecosystem that powers our AI and analytics platforms.

You will collaborate with data scientists, analysts, and product teams to deliver high-quality data solutions on AWS, using Terraform and Airflow, while upholding data quality and security standards. Hybrid work in Mountain View, CA.