Data Engineer - AWS

XPT Software Australia

Melbourne

On-site

AUD 90,000 - 130,000

Full time

45 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

XPT Software Australia in Melbourne is seeking a data engineer to build and optimize data pipelines, delivering reliable batch and streaming processing.

You will translate Kafka, API integration, PostgreSQL and AWS requirements into scalable ETL/ELT solutions, with emphasis on data quality, logging and monitoring.

Strong SDLC understanding and troubleshooting skills are essential for production-grade deployments.

Qualifications

  • Experience building data pipelines for batch, streaming, and near-real-time processing.
  • Ability to design reusable data engineering frameworks and templates.
  • Proficiency in ETL/ELT development and SQL-based transformations.
  • Strong understanding of SDLC and troubleshooting.

Responsibilities

  • Build, enhance, and maintain data pipeline frameworks for batch, streaming, and near-real-time processing.
  • Design reusable frameworks, accelerators, and templates for ingestion, transformation, orchestration, and data quality controls.
  • Demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
  • Implement production-grade pipelines with error handling, logging, monitoring, and performance optimization.

Skills

Kafka
API implementation
PostgreSQL
AWS
AWS certified

Job description

Must Have Skills:

Kafka, API implementation, PostgreSQL, AWS

Nice to Have Skills:

AWS certified

Detailed Job Description

Good communication skills with knowledge on Kafka, API implementation, PostgreSQL, AWS

  • Strong understanding of SDLC process.
  • Should have Strong understanding and trouble shooting skills
Core Requirements
  • Must have strong experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near-real-time processing.
  • Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
  • Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.

Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - AWS
Data Engineer - AWS

XPT Software • Melbourne

On-site
AUD 110,000 - 150,000
Data Engineer - Aws
Data Engineer - Aws

Xpt Software Australia Pty Ltd • Melbourne

On-site
AUD 110,000 - 140,000
Data Engineer
Data Engineer

Zone IT Solutions • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer Lead
Data Engineer Lead

XPT Software Australia Pty Ltd • Melbourne

On-site
AUD 120,000 - 160,000
Data Engineer
Data Engineer

PRIMUS Global Services • Sydney

On-site
AUD 150,000 - 210,000
Data Engineer
Data Engineer

Ethos Beath Chapman - Australia • Sydney

On-site
AUD 120,000 - 180,000
Technology Lead
Technology Lead

Ampstek • Melbourne

On-site
AUD 110,000 - 160,000
Senior Data Engineer
Senior Data Engineer

DX1 • Melbourne

On-site
AUD 160,000 - 230,000
Backend Engineer
Backend Engineer

Zensys • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer
Data Engineer

Lendaly Pty • Sydney

On-site
AUD 90,000 - 150,000
Top locations