Data Engineer - Infrastructure

IMC Trading; Illinois; On-site; USD 175,000 - 225,000; Full time

Job summary

IMC Trading is seeking an Engineer to join the Data Engineering Infrastructure team. You will build and scale storage and data platforms powering our HFT business, operating large-scale open-source and enterprise storage, and tuning Linux systems for peak performance.

You will automate deployment with Ansible or Puppet, build observability with Prometheus, and collaborate with teams to deliver robust data solutions centered on storage and Kafka. Familiarity with Kubernetes is a plus.

Qualifications

• 5+ years of systems engineering with a focus on data storage.
• Strong Linux fundamentals and performance tuning for I/O throughput.
• Hands-on experience with configuration management and automation (Ansible and Puppet).
• Familiarity with open-source, S3 API–compliant, and enterprise storage tech.
• Working knowledge of Hadoop ecosystem including YARN.
• Experience in Java and Python.
• Comfort using AI-assisted development tools (e.g., Claude) in an enterprise setting.
• Experience with Prometheus-based monitoring and alerting.

Responsibilities

• Design, deploy, and operate large-scale data storage infrastructure (Hadoop, S3-compatible, enterprise storage).
• Tune Linux systems for I/O throughput and overall performance.
• Automate configuration and deployment using Ansible, Puppet, or other automation platforms.
• Build observability into the platform with Prometheus and related tooling.
• Collaborate with engineering teams to deliver reliable data storage solutions focusing on Storage and Kafka.
• Familiarity with Kubernetes and containerized environments.

Skills

Linux fundamentals

Performance tuning

Ansible

Puppet

Open-source storage

S3-compatible storage

Hadoop/YARN

Java

Python

Kafka

Prometheus monitoring

Kubernetes

Claude AI tools

Tools

Ansible

Puppet

Prometheus

Kubernetes

Hadoop

Job description

We are hiring an Engineer to join our Data Engineering Infrastructure team, where you will help build and scale the storage and data platforms that power our HFT business. This is a hands‑on role for someone who enjoys working close to the bare metal systems. Operating large-scale open‑source storage, enterprise storage, tuning Linux systems for performance, automating infrastructure. As our data footprint grows, you will play a key part in keeping our infrastructure fast, reliable, and ready to scale.

Core Responsibilities:

• Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms
• Tune Linux systems for I/O throughput and overall performance
• Automate configuration and deployment using Ansible, Puppet or other automation platform
• Build observability into the platform with Prometheus and related tooling
• Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka
• Familiarity with Kubernetes

Skills & Experience:

• 5+ years of experience in systems engineering with a strong focus on data storage
• Strong Linux fundamentals, debugging skills, including performance tuning for I/O throughput
• Hands‑on experience with Ansible and Puppet for configuration management and automation
• Familiarity with open-source, S3 API compliant, and enterprise storage technologies
• Working knowledge of the Hadoop ecosystem, including YARN
• Experience in Java and Python
• Comfort working with AI-assisted development tools such as Claude in an enterprise setting
• Experience with Prometheus-based monitoring and alerting

The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance. Please visit Benefits - US | IMC Trading for more comprehensive information.

Salary Range

$175,000—$225,000 USD

About Us

IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors. Using our own technology and capital, we build proprietary systems and algorithms that operate across global markets. Our researchers, traders, and engineers work as a collective, combining rapid experimentation, advanced infrastructure, and real‑time feedback to turn insight into execution and execution into advantage.