Data Infrastructure Engineer — High-Performance Storage

IMC; Chicago, Northern (IL, KY); Hybrid; USD 175,000 - 225,000; Full time

Job summary

IMC is seeking an experienced Engineer to join the Data Engineering Infrastructure team in Chicago. You will design, deploy, and operate large-scale data storage infrastructure, focusing on performance-tuned Linux systems and automation using Ansible or Puppet.

You will contribute to observability with Prometheus and collaborate across teams on storage and Kafka solutions. The role requires hands-on experience with Hadoop/YARN, Java, and Python, plus familiarity with Kubernetes.

Qualifications

• 5+ years of systems engineering with a strong focus on data storage.
• Strong Linux fundamentals with debugging and I/O throughput tuning.
• Hands-on experience with Ansible and Puppet for configuration management.
• Familiarity with open-source, S3 API compliant, and enterprise storage technologies.
• Working knowledge of the Hadoop ecosystem, including YARN.
• Experience in Java and Python.
• Comfort working with AI-assisted development tools such as Claude.
• Experience with Prometheus-based monitoring and alerting.

Responsibilities

• Design, deploy, and operate large-scale data storage infrastructure, including Hadoop, enterprise storage and S3-compatible platforms.
• Tune Linux systems for I/O throughput and overall performance.
• Automate configuration and deployment using Ansible, Puppet or other automation platform.
• Build observability into the platform with Prometheus and related tooling.
• Partner with engineering teams to deliver reliable, well-architected data solutions with a focus on Storage and Kafka.
• Familiarity with Kubernetes.

Skills

Experience in data storage

Linux performance tuning

Configuration management

Open-source storage techs

Hadoop/YARN

Java

Python

AI-assisted tools (Claude)

Prometheus monitoring

Tools

Ansible

Puppet

Kubernetes

Prometheus

Job description

IMC is seeking an experienced Engineer to join the Data Engineering Infrastructure team in Chicago. You will design, deploy, and operate large-scale data storage infrastructure, focusing on performance-tuned Linux systems and automation using Ansible or Puppet.

You will contribute to observability with Prometheus and collaborate across teams on storage and Kafka solutions. The role requires hands-on experience with Hadoop/YARN, Java, and Python, plus familiarity with Kubernetes.