Data Infrastructure Engineer: Storage, Linux & Kafka

ittihad medical centre; Chicago (IL); On-site; USD 175,000 - 225,000; Full time

Job summary

IMC Trading is hiring an Engineer to join our Data Engineering Infrastructure team, building storage and data platforms for our HFT business. This hands-on role runs near-metal systems, large-scale open-source storage, Linux tuning, and automation to keep our infrastructure fast and scalable.

You will design, deploy, and operate Hadoop and S3-compatible storage, tune I/O performance, and implement observability with Prometheus and Kubernetes familiarity.

Qualifications

• 5+ years of experience in systems engineering with a focus on data storage.
• Strong Linux fundamentals and debugging skills, including performance tuning for I/O throughput.
• Hands-on experience with Ansible and Puppet for configuration management and automation.
• Familiarity with open-source, S3 API compatible, and enterprise storage technologies.
• Working knowledge of the Hadoop ecosystem, including YARN.
• Experience in Java and Python.
• Comfort using AI-assisted development tools in an enterprise setting.
• Experience with Prometheus-based monitoring and alerting.

Responsibilities

• Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms.
• Tune Linux systems for I/O throughput and overall performance.
• Automate configuration and deployment using Ansible, Puppet or other automation platform.
• Build observability into the platform with Prometheus and related tooling.
• Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka.
• Familiarity with Kubernetes.

Skills

Linux fundamentals

Performance tuning

Java

Python

Hadoop ecosystem

Kafka

Ansible

Puppet

Kubernetes

S3 storage

Tools

Ansible

Puppet

Prometheus

Kubernetes

Hadoop ecosystem

Job description

IMC Trading is hiring an Engineer to join our Data Engineering Infrastructure team, building storage and data platforms for our HFT business. This hands-on role runs near-metal systems, large-scale open-source storage, Linux tuning, and automation to keep our infrastructure fast and scalable.

You will design, deploy, and operate Hadoop and S3-compatible storage, tune I/O performance, and implement observability with Prometheus and Kubernetes familiarity.