Data Infrastructure Engineer — High-Performance Storage & Kafka

IMC Trading; Chicago (IL); On-site; USD 175,000 - 225,000; Full time

Job summary

IMC Trading in Chicago is seeking an Engineer to join our Data Engineering Infrastructure team, building and scaling storage and data platforms powering our HFT business. This hands-on role sits close to bare-metal systems, optimizing Linux, storage, and automation.

You will tune I/O performance, automate with Ansible/Puppet, and implement observability with Prometheus. Familiarity with Kubernetes and Kafka collaboration is highly valued.

Qualifications

• 5+ years of experience in systems engineering with a focus on data storage.
• Strong Linux fundamentals and performance tuning for I/O throughput.
• Hands-on experience with Ansible and Puppet for configuration management.
• Familiarity with open-source and enterprise storage technologies (S3-compatible).
• Experience with Hadoop ecosystem including YARN.
• Proficiency in Java and Python.
• Comfort with AI-assisted development tools in an enterprise setting.
• Experience with Prometheus-based monitoring and alerting.

Responsibilities

• Design, deploy, and operate large-scale data storage infrastructure.
• Tune Linux systems for I/O throughput and performance.
• Automate configuration and deployment using Ansible, Puppet or similar tools.
• Build observability into the platform with Prometheus and related tooling.
• Collaborate with engineering teams to deliver reliable data solutions with storage and Kafka.

Skills

Linux fundamentals

Hadoop/YARN

Java

Python

S3 storage

Open-source storage

Kubernetes

Prometheus monitoring

AI-assisted tooling

Tools

Ansible

Puppet

Job description

IMC Trading in Chicago is seeking an Engineer to join our Data Engineering Infrastructure team, building and scaling storage and data platforms powering our HFT business. This hands-on role sits close to bare-metal systems, optimizing Linux, storage, and automation.

You will tune I/O performance, automate with Ansible/Puppet, and implement observability with Prometheus. Familiarity with Kubernetes and Kafka collaboration is highly valued.