Senior AWS Data Engineer: Scalable Pipelines & Analytics

AUSDX PTY LTD; Sydney; On-site; AUD 140,000 - 200,000; Full time

Job summary

AUSDX PTY LTD in Sydney is seeking a Senior AWS Data Engineer to design, build, and operate scalable data pipelines on AWS. The role focuses on ingesting, transforming, and serving data for reporting, analytics, and downstream applications, with hands-on SQL/Python and AWS data services.

You will collaborate with cross-functional teams, implement robust DataOps/DevOps practices, and contribute to data quality, governance, and performance tuning across batch and near real-time pipelines.

Qualifications

• 8–10 years of experience as a Data Engineer.
• Strong SQL skills and Python/PySpark experience.
• Hands-on with AWS data services (S3, Glue, Redshift, Athena, EMR).
• Experience with data warehousing concepts and data modeling.
• Experience with dbt and Airflow for orchestration.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines on AWS.
• Build and manage ETL/ELT workflows using AWS tools and dbt.
• Ingest data from diverse sources into lake/warehouse layers.
• Develop transformation logic with SQL and Python/PySpark.
• Implement data quality checks, monitoring, and alerting.
• Collaborate with analysts/scientists for analytics-ready datasets.
• Contribute to DataOps/DevOps practices and produce runbooks.
• Optimize pipeline performance and support production operations.

Skills

Advanced SQL

Python

PySpark

Spark

Data modeling

Tools

Teradata

Siebel CRM data sets

dbt

Airflow

AWS (S3, Glue, Redshift, Athena, EMR)

Job description

AUSDX PTY LTD in Sydney is seeking a Senior AWS Data Engineer to design, build, and operate scalable data pipelines on AWS. The role focuses on ingesting, transforming, and serving data for reporting, analytics, and downstream applications, with hands-on SQL/Python and AWS data services.

You will collaborate with cross-functional teams, implement robust DataOps/DevOps practices, and contribute to data quality, governance, and performance tuning across batch and near real-time pipelines.