Data Platform SRE: Scale, Automation & Insights

ittihad medical centre; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

IMC is seeking a Data Platform Engineer in Sydney to join a growing APAC Data Team. You will manage large-scale data infrastructure, ensure reliable operation, and help evolve data storage, access, and query platforms used by traders for analysis and reporting.

You will work with Kafka, HDFS, Dremio, Kubernetes and cloud services, collaborating with engineers, traders, and researchers to deliver robust data solutions and automation.

Qualifications

• 2+ years managing large-scale multi-petabyte data infrastructure.
• ,

Responsibilities

• Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
• Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
• Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
• Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.

Skills

Linux administration

Kafka

HDFS

Kubernetes

Docker

Helm

Dremio

Presto

Airflow

Prefect

AWS

GCP

Azure

Tools

CI/CD

Job description

IMC is seeking a Data Platform Engineer in Sydney to join a growing APAC Data Team. You will manage large-scale data infrastructure, ensure reliable operation, and help evolve data storage, access, and query platforms used by traders for analysis and reporting.

You will work with Kafka, HDFS, Dremio, Kubernetes and cloud services, collaborating with engineers, traders, and researchers to deliver robust data solutions and automation.