Data Platform SRE: Scale, Automation & Delivery

IMC B.V.; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

IMC is seeking a Data Engineer to join the Sydney team responsible for data collection, storage, access and query platforms, ensuring safe and reliable operation and enabling analytics for traders and models.

You will be part of the APAC Data Team, collaborating with colleagues in Chicago, Mumbai and Amsterdam to evolve capabilities and automation across cloud and on-premise environments.

Qualifications

• 2+ years of experience managing large-scale multi-petabyte data infrastructure.
• Strong Linux system administration knowledge with troubleshooting ability.
• Experience with Kafka, HDFS or Kubernetes in production environments.
• Working knowledge of Docker, Kubernetes and Helm.
• Experience with data access technologies like Dremio and Presto.
• Familiarity with Airflow and Prefect for workflow orchestration.
• Exposure to AWS, GCP or Azure cloud platforms.

Responsibilities

• Manage and monitor distributed systems, storage infra, and data processing platforms (Kafka, HDFS, Dremio, in-house pipelines).
• Drive automation and CI/CD to enable rapid deployment of hardware and software solutions.
• Collaborate with systems, network engineers, traders and developers to support and troubleshoot queries.
• Stay updated on tech trends; propose, evaluate, and implement innovative solutions.

Skills

Large-scale data infra

Linux administration

Cloud platforms

Troubleshooting

Collaboration

Tools

Kafka

HDFS

Kubernetes

Docker

Helm

Dremio

Presto

Airflow

Prefect

Job description

IMC is seeking a Data Engineer to join the Sydney team responsible for data collection, storage, access and query platforms, ensuring safe and reliable operation and enabling analytics for traders and models.

You will be part of the APAC Data Team, collaborating with colleagues in Chicago, Mumbai and Amsterdam to evolve capabilities and automation across cloud and on-premise environments.