AWS Data Engineer

Zone IT Solutions Pty Ltd; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

Zone IT Solutions Pty Ltd is seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines on AWS for enterprise analytics. The role emphasizes SQL, Python, and data service expertise to deliver robust data solutions.

You will collaborate with data analysts and data scientists, implement DataOps practices, and produce documentation for data flows, mappings, and runbooks while ensuring production reliability.

Qualifications

• 8-10 years' experience as a Data Engineer.
• Advanced SQL skills with complex joins and window functions.
• Hands-on experience with Teradata and Siebel CRM data sets.
• Experience delivering data pipelines in a large-scale enterprise data platform on AWS.
• Strong Python programming for data transformation and data quality checks.

Responsibilities

• Design, build, and maintain end-to-end data pipelines on AWS Data Platform.
• Build and manage ETL/ELT workflows using AWS services (e.g., AWS Glue, S3, Redshift, Athena, EMR), dbt and Airflow.
• Implement data ingestion patterns from diverse sources into lake/warehouse layers.
• Develop transformation logic using SQL and Python/PySpark for cleansing and enrichment.
• Implement data quality checks, reconciliation controls, and monitoring/alerting for failures.
• Collaborate with data analysts/scientists to model datasets for analytics/ML.
• Contribute to DataOps/DevOps: version control, CI/CD, automated testing, release management.
• Produce and maintain technical documentation (data flows, mappings, job schedules, runbooks).
• Optimise Data Pipeline performance and support workflow orchestration.
• Support production deployments and operations.

Skills

Advanced SQL

Python

PySpark

ETL/ELT pipelines

Airflow

Data modelling

Data quality

Stakeholder comms

Tools

AWS Glue

Amazon S3

Amazon Redshift

Amazon Athena

Amazon EMR

dbt

Airflow

Teradata

Siebel CRM

Job description

We are seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and curated datasets on AWS. The ideal candidate will have strong expertise in SQL, Python, AWS data services, and modern data engineering practices, with experience delivering data solutions for enterprise analytics and reporting.

We are seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and curated datasets on AWS. The ideal candidate will have strong expertise in SQL, Python, AWS data services, and modern data engineering practices, with experience delivering data solutions for enterprise analytics and reporting.

Key Responsibilities

• Design, develop, and maintain end-to-end data pipelines (batch and near real-time) on AWS Data Platform
• Build and manage ETL/ELT workflows using AWS services (e.g., AWS Glue, S3, Redshift, Athena, EMR), dbt and orchestration tools such as Airflow
• Implement data ingestion patterns from diverse sources (databases, APIs, files, event streams) into lake/warehouse layers such as raw, cleansed, and curated data layers
• Develop transformation logic using SQL and Python/PySpark for cleansing, enrichment, and standardisation
• Implement robust data quality checks, reconciliation controls, and monitoring/alerting for failures and anomalies
• Collaborate with data analysts/data scientists to model datasets for analytics and machine learning consumption.
• Contribute to DataOps/DevOps practices: version control, CI/CD, automated testing, release management, and operational support.
• Produce and maintain technical documentation (data flows, mappings, job schedules, runbooks, and operational procedures)
• Optimise Data Pipeline performance and Support workflow orchestration and scheduling
• Support production deployments and operations

Required Skills & Experience

• 8-10 years' experience as a Data Engineer
• Advanced SQL skills
• Hands-on experience working with Teradata and Siebel CRM data sets
• Experience delivering data pipelines in a large-scale enterprise data platform environment
• Strong hands-on AWS experience with common data services such as : Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR and dbt
• Strong programming capability in Python and strong data transformation experience using PySpark (preferred) and/or Spark.
• Advanced SQL skills (query optimisation, complex joins, window functions, performance tuning)
• Experience with workflow orchestration tools such as Airflow
• Solid understanding of data warehousing concepts (dimensional modelling, partitioning, incremental loads, CDC concepts).
• Experience implementing monitoring, logging, alerting, and operational support processes.
• Strong communication skills and ability to work with stakeholders to translate requirements into data deliverables
• Telco Industry Experience is highly desirable.

We specialize in Digital, ERP, and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic, and flexible solutions will help you source the IT Expertise you need.

Also follow ou r Linked In page for new job opportunities and more.

Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We encourage applications from a diverse array of backgrounds, including individuals of various ethnicities, cultures, and linguistic backgrounds, as well as those with disabilities.