Data Engineering Lead – Real-Time Pipelines & AWS

XPT Software Australia Pty Ltd

Melbourne

On-site

AUD 120,000 - 160,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

XPT Software Australia Pty Ltd is seeking a skilled Data Engineer in Melbourne to design, build, and optimize data pipelines that support batch, streaming, and near-real-time processing.

You will implement production-grade ETL/ELT solutions using Kafka, API integration, PostgreSQL, and AWS, contributing to reusable frameworks and templates, with a strong focus on data quality, monitoring, and performance.

Qualifications

  • Must have strong experience in building, enhancing, and maintaining data pipeline frameworks.
  • Proficient in ETL/ELT development and distributed data processing.
  • Strong understanding of SDLC and production-grade pipelines.

Responsibilities

  • Design, build and optimize data pipelines for batch, streaming, and near-real-time processing.
  • Implement production-grade pipelines with logging, error handling and monitoring.
  • Develop reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.

Skills

Kafka
API implementation
PostgreSQL
AWS

Job description

XPT Software Australia Pty Ltd is seeking a skilled Data Engineer in Melbourne to design, build, and optimize data pipelines that support batch, streaming, and near-real-time processing.

You will implement production-grade ETL/ELT solutions using Kafka, API integration, PostgreSQL, and AWS, contributing to reusable frameworks and templates, with a strong focus on data quality, monitoring, and performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Pipeline Engineer - AWS, Kafka & ETL
Data Pipeline Engineer - AWS, Kafka & ETL

XPT Software Australia • Melbourne

On-site
AUD 90,000 - 130,000
AWS Data Engineer - Kafka, API & Real-Time Pipelines
AWS Data Engineer - Kafka, API & Real-Time Pipelines

XPT Software • Melbourne

On-site
AUD 110,000 - 150,000
AWS Data Engineer: Real-Time Data Pipelines
AWS Data Engineer: Real-Time Data Pipelines

Xpt Software Australia Pty Ltd • Melbourne

On-site
AUD 110,000 - 140,000
Data Engineer Lead
Data Engineer Lead

XPT Software Australia Pty Ltd • Melbourne

On-site
AUD 120,000 - 160,000
Data Engineering Lead - Kafka, ETL & AWS
Data Engineering Lead - Kafka, ETL & AWS

Ampstek • Melbourne

On-site
AUD 110,000 - 160,000
Data Platform Engineer: Real-Time Ingestion & Decisioning
Data Platform Engineer: Real-Time Ingestion & Decisioning

XPT Software Australia • Sydney

On-site
AUD 120,000 - 180,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
Hybrid Data Engineer – Real‑Time Pipelines & AWS, Sydney
Hybrid Data Engineer – Real‑Time Pipelines & AWS, Sydney

ASX Limited • Sydney

Hybrid
AUD 129,000 - 203,000
Data Engineer AWS - Real-Time Pipelines (Hybrid)
Data Engineer AWS - Real-Time Pipelines (Hybrid)

Asx • Sydney

Hybrid
AUD 180,000 - 240,000
Hybrid working options
Data Engineer - Aws
Data Engineer - Aws

Xpt Software Australia Pty Ltd • Melbourne

On-site
AUD 110,000 - 140,000
Top locations