AWS Data Platform Engineer — Scale Data Lakes with Iceberg

Synechron; Sydney; On-site; AUD 120,000 - 140,000; Full time

Job summary

A technology consulting company in Sydney is seeking an experienced AWS Data Platform Engineer. The successful candidate will design and implement scalable data solutions, optimize data lake performance, and work with data scientists to manage efficient data processing. Ideal candidates should have deep knowledge of AWS data services and Apache Iceberg, alongside strong coding skills in languages such as Python, Java, or Scala.

Qualifications

• Extensive experience with AWS data services and strong understanding of Apache Iceberg.
• Proven track record in building and optimizing data lakes.
• Proficiency in working with big data processing tools.

Responsibilities

• Implement and manage data lake solutions using Apache Iceberg.
• Optimize data storage and querying by integrating Iceberg tables into AWS services.
• Monitor, troubleshoot, and optimize performance of data solutions.

Skills

AWS data services

Apache Iceberg

Python

Java

Scala

Infrastructure as Code (IaC)

Data orchestration

Analytical skills

Problem-solving

Communication

Tools

Apache Airflow

AWS CloudFormation

Terraform

Job description

A technology consulting company in Sydney is seeking an experienced AWS Data Platform Engineer. The successful candidate will design and implement scalable data solutions, optimize data lake performance, and work with data scientists to manage efficient data processing. Ideal candidates should have deep knowledge of AWS data services and Apache Iceberg, alongside strong coding skills in languages such as Python, Java, or Scala.