Site Reliability Engineer - Data Engineering

Linuxconfig; Australia; On-site; AUD 120,000 - 160,000; Full time

Job summary

IMC in Sydney seeks a Data Engineer to own large-scale data collection, storage, access and query platforms. You’ll ensure safe operation and drive evolution of the data platform supporting trader analysis and insights.

Join a four-person Sydney team within APAC Data, collaborating with colleagues in Chicago, Mumbai and Amsterdam. You’ll optimize pipelines and stay ahead of industry trends to deliver reliable, scalable data solutions.

Qualifications

• 2+ years managing large-scale multi-petabyte data infrastructure.
• Experience with Linux system administration and troubleshooting.
• Hands-on with Kafka, HDFS, or Kubernetes in production.
• Working knowledge of Docker, Kubernetes, and Helm.
• Experience with data access tech such as Dremio and Presto.
• Familiarity with Airflow or Prefect for workflows.
• Exposure to AWS, GCP, or Azure cloud platforms.

Responsibilities

• Manage and monitor distributed data platforms and storage infrastructure.
• Drive automation and CI/CD to speed deployments of hardware and software.
• Collaborate with traders, developers, and engineers to resolve queries.
• Stay current with tech trends and implement innovative solutions.

Skills

Linux

Data infrastructure

System troubleshooting

CI/CD

Tools

Kafka

HDFS

Kubernetes

Docker

Helm

Dremio

Presto

Airflow

Prefect

AWS

GCP

Azure

Job description

Sydney, Australia

Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.

You will join a growing team of four in Sydney which is part of the larger APAC Data Team, and will collaborate with counterparts in Chicago, Mumbai and Amsterdam.

Your Core Responsibilities:

• Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
• Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
• Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
• Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.

Your Skills and Experience:

• 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role.
• Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.
• Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
• Working knowledge of Docker, Kubernetes, and Helm.
• Experience with data access technologies such as Dremio and Presto.
• Familiarity with workflow orchestration tools like Airflow and Prefect.
• Exposure to cloud platforms such as AWS, GCP, or Azure.

About Us

IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.

IMC is an equal opportunity employer. IMC prohibits discrimination of any type and affords equal employment opportunities to applicants without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity and expression, national origin, age, disability, and/or any other categories protected by applicable local law. Completion of this section is voluntary and will not affect your opportunity for employment or the terms or conditions of your employment. If you require adjustments to your working arrangements or the recruitment process, please let us know when applying. The data collected from these questions will be stored separately from your individual application and will be kept confidential.