Senior AWS Data Engineer: End-to-End Pipelines & DataOps

UniqueHire; Sydney; On-site; AUD 150,000 - 190,000; Full time

Job summary

UniqueHire is seeking a Senior AWS Data Engineer to design, build, and support scalable data pipelines and curated datasets on the AWS platform. The role involves ingesting, transforming, and serving data for reporting and analytics, with hands-on SQL/Python and strong AWS-native services experience.

You will collaborate with cross-functional teams, implement DataOps practices, and contribute to data quality, monitoring, and operational runbooks while supporting production deployments.

Qualifications

• 8–10 years’ experience as a Data Engineer.
• Advanced SQL skills.
• Hands-on experience with Teradata and Siebel CRM data sets.
• Experience delivering data pipelines in large-scale enterprise environments.
• Strong AWS data services experience (S3, Glue, Redshift, Athena, EMR) and dbt.
• Python and PySpark data transformation expertise.
• Experience with Airflow or similar workflow tools.
• Knowledge of data warehousing concepts and dimensional modelling.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines on AWS Data Platform.
• Build and manage ETL/ELT workflows using AWS services and dbt.
• Ingest, transform, and curate data for reporting, analytics, and downstream apps.
• Develop transformation logic in SQL and Python/PySpark.
• Implement data quality checks, monitoring, and alerting.
• Collaborate with analysts/data scientists to model datasets for analytics.
• Contribute to DataOps/DevOps practices, including CI/CD and runbooks.
• Produce and maintain technical documentation of data flows and job schedules.
• Support production deployments and operations.

Skills

Advanced SQL

Python

PySpark

AWS

Data warehousing

ETL/ELT

Airflow

Teradata

Siebel CRM data

Communication

Tools

dbt

Airflow

Job description

UniqueHire is seeking a Senior AWS Data Engineer to design, build, and support scalable data pipelines and curated datasets on the AWS platform. The role involves ingesting, transforming, and serving data for reporting and analytics, with hands-on SQL/Python and strong AWS-native services experience.

You will collaborate with cross-functional teams, implement DataOps practices, and contribute to data quality, monitoring, and operational runbooks while supporting production deployments.