Senior AWS Data Engineer — Ultra-Secure Cloud & DataOps

Showtime Consulting Pty Ltd; Australia; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Remote-friendly roles

Competitive salary packages

Job summary

Showtime Consulting is seeking an experienced Senior AWS Data Engineer to join a high-performing data team in Australia. You will design, build, and support scalable data pipelines on AWS, delivering reliable data solutions for reporting, analytics, and downstream applications across a large enterprise.

The role requires advanced SQL, Python, PySpark, and dbt expertise, with hands-on work on AWS S3, Glue, Redshift, Athena, and EMR.

Qualifications

• Experience in Data Engineering within enterprise-scale environments.
• Advanced SQL skills, including query optimisation, performance tuning, complex joins, CTEs, and window functions.
• Strong hands-on experience building and supporting data pipelines within large-scale data platforms.
• Extensive experience with AWS data services: S3, Glue, Redshift, Athena, EMR.
• Strong experience with dbt and modern ELT development practices.
• Advanced programming in Python; experience with PySpark/Apache Spark.
• Experience with Apache Airflow for workflow orchestration.
• Experience implementing data quality controls, monitoring, and alerting.
• Knowledge of data warehousing concepts and CDC.
• Experience with Teradata and Siebel CRM datasets.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines across batch and near real-time environments.
• Build and manage ETL/ELT workflows using AWS data services (Glue, S3, Redshift, Athena, EMR).
• Develop scalable transformation frameworks using SQL, Python, PySpark, and dbt.
• Ingest data from databases, APIs, flat files, and event-driven sources.
• Manage data lake and warehouse layers with raw, cleansed, and curated datasets.
• Implement data quality frameworks with validation, monitoring, and alerting.
• Collaborate with analysts and data scientists to deliver analytics-ready datasets.
• Optimize pipeline performance, scalability, and reliability.
• Support Airflow-based scheduling and DevOps practices.
• Produce technical docs including mappings and runbooks.

Skills

Advanced SQL

Python

PySpark

dbt

AWS data services

ETL/ELT

Airflow

Data quality controls

Data warehousing

Stakeholder engagement

Tools

Amazon S3

Amazon Glue

Amazon Redshift

Amazon Athena

Amazon EMR

dbt

Apache Airflow

Teradata

Siebel CRM

Job description

Showtime Consulting is seeking an experienced Senior AWS Data Engineer to join a high-performing data team in Australia. You will design, build, and support scalable data pipelines on AWS, delivering reliable data solutions for reporting, analytics, and downstream applications across a large enterprise.

The role requires advanced SQL, Python, PySpark, and dbt expertise, with hands-on work on AWS S3, Glue, Redshift, Athena, and EMR.