Data Engineer

Zone IT Solutions

Sydney

On-site

AUD 120,000 - 180,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Zone IT Solutions is seeking an experienced Data Engineer in Sydney to design and operate scalable data pipelines using AWS SageMaker Unified Studio, real-time and batch ingestion, and modern data lakehouse architectures.

You will implement low-latency streaming with AWS Kinesis or Kafka, develop reusable data processing frameworks, and optimize performance across AWS services such as Lambda, S3, DynamoDB and Redshift. Collaboration with engineering teams is essential.

Qualifications

  • Experience as a Data Engineer with cloud AWS.
  • Experience with real-time and batch data ingestion.
  • Hands-on with data lakehouse architectures.

Responsibilities

  • Develop scalable batch and real‑time data ingestion frameworks across databases, APIs, queues and file systems.
  • Implement AWS SageMaker Unified Studio workflows including Discover, Build, Govern, JupyterLab, Spaces, Query Editor and ML Pipelines.
  • Build and maintain data pipelines for data warehousing and analytics across AWS services; optimize performance.
  • Collaborate on API integrations and monitoring; ensure low latency and reliability.
  • Lead orchestration using MWAA / Airflow and implement CI/CD pipelines for data infra.

Skills

AWS SageMaker
Real-time ingestion
Batch ingestion
Python
Boto3
API integrations
AWS Lambda
AWS S3
DynamoDB
Redshift
Snowflake
Airflow / MWAA
Git / CI/CD
Terraform
CloudFormation
Data modeling
Data warehouses

Tools

Kinesis
Kafka
Apache Airflow
MWAA
Terraform
CloudFormation
Git
CI/CD
API Gateway
S3
DynamoDB
RDS
Redshift
MongoDB
Oracle
Teradata
Snowflake

Job description

We are looking for an experienced Data Engineer with strong expertise in AWS SageMaker Unified Studio, real-time and batch data ingestion, and scalable data engineering frameworks.

Key Responsibilities & Skills
  • Strong hands‑on experience with AWS SageMaker Unified Studio, including Discover, Build, Govern, JupyterLab, Spaces, Query Editor and ML Pipelines.
  • Develop reusable and scalable batch and real‑time data ingestion frameworks across databases, APIs, message queues and file systems.
  • Expertise in low‑latency real‑time data streaming using AWS Kinesis, Apache Kafka or similar technologies.
  • Strong programming skills in Python, Boto3, with experience in API integrations and performance optimisation.
  • Hands‑on experience with AWS services including Lambda, S3, DynamoDB, Glue, CloudWatch, SQS, SNS and API Gateway.
  • Strong database experience across Amazon RDS, Redshift, MongoDB, Oracle, Teradata and Snowflake.
  • Experience in data transformation, data warehousing, Data Lakes and Lakehouse architectures.
  • Hands‑on experience with AWS MWAA (Apache Airflow), DAG development and workflow orchestration.
  • Knowledge of monitoring, logging, alerting, real‑time heartbeat exports, AWS IAM and networking.
  • Experience with Git, CI/CD, Terraform/CloudFormation and Data Modelling (added advantage).

We specialize in Digital, ERP, and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic, and flexible solutions will help you source the IT Expertise you need.

Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We encourage applications from a diverse array of backgrounds, including individuals of various ethnicities, cultures, and linguistic backgrounds, as well as those with disabilities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: AWS SageMaker & Real-Time Pipelines
Data Engineer: AWS SageMaker & Real-Time Pipelines

Zone IT Solutions • Sydney

On-site
AUD 120,000 - 180,000
Lead Data Engineer
Lead Data Engineer

Zone IT Solutions • Sydney

On-site
AUD 150,000 - 190,000
Azure Data Engineer
Azure Data Engineer

Zone IT Solutions • Sydney

On-site
AUD 150,000 - 190,000
Sr. Data Engineer
Sr. Data Engineer

ALOIS UK • Perth

On-site
AUD 130,000 - 170,000
Data Architect
Data Architect

Zone IT Solutions • Sydney

On-site
AUD 140,000 - 200,000
Principal Data Engineer
Principal Data Engineer

M&T Resources • Sydney

On-site
AUD 180,000 - 240,000
Senior Data Engineer
Senior Data Engineer

Work Initiatives • North Sydney

On-site
AUD 150,000 - 210,000
Senior Data Engineer
Senior Data Engineer

Elysium Digital • Melbourne

On-site
AUD 120,000 - 180,000
Data Engineer
Data Engineer

NTT DATA, Inc. • Sydney

On-site
AUD 120,000 - 160,000
Data Engineer
Data Engineer

XPT Software • Sydney

On-site
AUD 140,000 - 190,000
Top locations