Data Platform SRE (Big Data, Kafka, Kubernetes)

Linuxconfig; Australia; On-site; AUD 120,000 - 160,000; Full time

Job summary

IMC in Sydney seeks a Data Engineer to own large-scale data collection, storage, access and query platforms. You’ll ensure safe operation and drive evolution of the data platform supporting trader analysis and insights.

Join a four-person Sydney team within APAC Data, collaborating with colleagues in Chicago, Mumbai and Amsterdam. You’ll optimize pipelines and stay ahead of industry trends to deliver reliable, scalable data solutions.

Qualifications

• 2+ years managing large-scale multi-petabyte data infrastructure.
• Experience with Linux system administration and troubleshooting.
• Hands-on with Kafka, HDFS, or Kubernetes in production.
• Working knowledge of Docker, Kubernetes, and Helm.
• Experience with data access tech such as Dremio and Presto.
• Familiarity with Airflow or Prefect for workflows.
• Exposure to AWS, GCP, or Azure cloud platforms.

Responsibilities

• Manage and monitor distributed data platforms and storage infrastructure.
• Drive automation and CI/CD to speed deployments of hardware and software.
• Collaborate with traders, developers, and engineers to resolve queries.
• Stay current with tech trends and implement innovative solutions.

Skills

Linux

Data infrastructure

System troubleshooting

CI/CD

Tools

Kafka

HDFS

Kubernetes

Docker

Helm

Dremio

Presto

Airflow

Prefect

AWS

GCP

Azure

Job description

IMC in Sydney seeks a Data Engineer to own large-scale data collection, storage, access and query platforms. You’ll ensure safe operation and drive evolution of the data platform supporting trader analysis and insights.

Join a four-person Sydney team within APAC Data, collaborating with colleagues in Chicago, Mumbai and Amsterdam. You’ll optimize pipelines and stay ahead of industry trends to deliver reliable, scalable data solutions.