Senior AWS Data Engineer: Build Scalable Data Pipelines

Zone IT Solutions Pty Ltd; Sydney; Sur place; AUD 140 000 - 190 000; Plein temps

Résumé du poste

Zone IT Solutions Pty Ltd is seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines on AWS for enterprise analytics. The role emphasizes SQL, Python, and data service expertise to deliver robust data solutions.

You will collaborate with data analysts and data scientists, implement DataOps practices, and produce documentation for data flows, mappings, and runbooks while ensuring production reliability.

Qualifications

• 8-10 years' experience as a Data Engineer.
• Advanced SQL skills with complex joins and window functions.
• Hands-on experience with Teradata and Siebel CRM data sets.
• Experience delivering data pipelines in a large-scale enterprise data platform on AWS.
• Strong Python programming for data transformation and data quality checks.

Responsabilités

• Design, build, and maintain end-to-end data pipelines on AWS Data Platform.
• Build and manage ETL/ELT workflows using AWS services (e.g., AWS Glue, S3, Redshift, Athena, EMR), dbt and Airflow.
• Implement data ingestion patterns from diverse sources into lake/warehouse layers.
• Develop transformation logic using SQL and Python/PySpark for cleansing and enrichment.
• Implement data quality checks, reconciliation controls, and monitoring/alerting for failures.
• Collaborate with data analysts/scientists to model datasets for analytics/ML.
• Contribute to DataOps/DevOps: version control, CI/CD, automated testing, release management.
• Produce and maintain technical documentation (data flows, mappings, job schedules, runbooks).
• Optimise Data Pipeline performance and support workflow orchestration.
• Support production deployments and operations.

Connaissances

Advanced SQL

Python

PySpark

ETL/ELT pipelines

Airflow

Data modelling

Data quality

Stakeholder comms

Outils

AWS Glue

Amazon S3

Amazon Redshift

Amazon Athena

Amazon EMR

dbt

Airflow

Teradata

Siebel CRM

Description du poste

Zone IT Solutions Pty Ltd is seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines on AWS for enterprise analytics. The role emphasizes SQL, Python, and data service expertise to deliver robust data solutions.

You will collaborate with data analysts and data scientists, implement DataOps practices, and produce documentation for data flows, mappings, and runbooks while ensuring production reliability.