Data Pipeline Engineer - AWS, Kafka & ETL

XPT Software Australia

Melbourne

On-site

AUD 90,000 - 130,000

Full time

44 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

XPT Software Australia in Melbourne is seeking a data engineer to build and optimize data pipelines, delivering reliable batch and streaming processing.

You will translate Kafka, API integration, PostgreSQL and AWS requirements into scalable ETL/ELT solutions, with emphasis on data quality, logging and monitoring.

Strong SDLC understanding and troubleshooting skills are essential for production-grade deployments.

Qualifications

  • Experience building data pipelines for batch, streaming, and near-real-time processing.
  • Ability to design reusable data engineering frameworks and templates.
  • Proficiency in ETL/ELT development and SQL-based transformations.
  • Strong understanding of SDLC and troubleshooting.

Responsibilities

  • Build, enhance, and maintain data pipeline frameworks for batch, streaming, and near-real-time processing.
  • Design reusable frameworks, accelerators, and templates for ingestion, transformation, orchestration, and data quality controls.
  • Demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
  • Implement production-grade pipelines with error handling, logging, monitoring, and performance optimization.

Skills

Kafka
API implementation
PostgreSQL
AWS
AWS certified

Job description

XPT Software Australia in Melbourne is seeking a data engineer to build and optimize data pipelines, delivering reliable batch and streaming processing.

You will translate Kafka, API integration, PostgreSQL and AWS requirements into scalable ETL/ELT solutions, with emphasis on data quality, logging and monitoring.

Strong SDLC understanding and troubleshooting skills are essential for production-grade deployments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineering Lead – Real-Time Pipelines & AWS
Data Engineering Lead – Real-Time Pipelines & AWS

XPT Software Australia Pty Ltd • Melbourne

On-site
AUD 120,000 - 160,000
AWS Data Engineer - Kafka, API & Real-Time Pipelines
AWS Data Engineer - Kafka, API & Real-Time Pipelines

XPT Software • Melbourne

On-site
AUD 110,000 - 150,000
AWS Data Engineer: Real-Time Data Pipelines
AWS Data Engineer: Real-Time Data Pipelines

Xpt Software Australia Pty Ltd • Melbourne

On-site
AUD 110,000 - 140,000
Data Engineer Lead
Data Engineer Lead

XPT Software Australia Pty Ltd • Melbourne

On-site
AUD 120,000 - 160,000
Data Engineering Lead - Kafka, ETL & AWS
Data Engineering Lead - Kafka, ETL & AWS

Ampstek • Melbourne

On-site
AUD 110,000 - 160,000
Data Engineer - GCP Pipelines & BigQuery
Data Engineer - GCP Pipelines & BigQuery

XPT Software Australia Pty Ltd • Ryde

On-site
AUD 110,000 - 150,000
Data Engineer - Aws
Data Engineer - Aws

Xpt Software Australia Pty Ltd • Melbourne

On-site
AUD 110,000 - 140,000
Data Platform Engineer: Real-Time Ingestion & Decisioning
Data Platform Engineer: Real-Time Ingestion & Decisioning

XPT Software Australia • Sydney

On-site
AUD 120,000 - 180,000
Kafka & Event-Driven Platform Engineer
Kafka & Event-Driven Platform Engineer

XPT Software Australia Pty Ltd • Melbourne

On-site
AUD 120,000 - 170,000
Data Testing Engineer
Data Testing Engineer

XPT Software Australia Pty Ltd • Melbourne

On-site
AUD 90,000 - 130,000
Top locations