Data Engineer

IMC Trading; Illinois; On-site; USD 175,000 - 225,000; Full time

Job summary

IMC Trading is seeking a Data Engineer to join our Chicago team. You will architect, develop, and deploy a full Big Data environment and build pipelines using Java, Python, Spark, and Flink. Collaborate on data modeling and capacity planning to ensure data integrity and availability.

You will serve as a subject-matter expert across data-related questions from users and developers. The role emphasizes hands-on work with modern data technologies, cloud-like data backends, and a culture of robust

Qualifications

• 5+ years experience in mature data engineering environment.

Responsibilities

• Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
• Build, deploy, and monitor data processing pipelines (Java, Python, Spark, Flink)
• Collaborate with development teams on data modeling, ingestion, and capacity planning
• Work with users to ensure data integrity and availability
• Act as a Big Data SME and consult on data-related questions from users and developers

Skills

Kafka streaming

Big Data

Spark

Flink

Java

Python

SQL

Python tooling

Kubernetes

Docker

Monitoring

Statistics

Troubleshooting

Unix scripting

Tools

Kafka

Spark

Flink

Databricks

S3

HDFS

Iceberg

Prometheus

Grafana

Docker

Kubernetes

OpsGenie

Job description

We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.

Core Responsibilities

• Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
• Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
• Collaborate with development teams on data modeling, data ingestion, and capacity planning
• Work with users to ensure data integrity and availability
• Act as a Big Data SME and consult on a variety of data-related questions from users and developers

Skills and Experience:

• 5+ years experience working in a mature data engineering environment
• 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
• 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
• Experience with Apache Spark, Apache Flink or similar tools
• Strong Java, Python, and SQL development skills
• Experience with common data-science toolkits, especially python-based
• Hands-on experience with Kubernetes and Docker
• Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
• Strong statistical analysis skills
• Demonstrated ability to troubleshoot and conduct root-cause analysis
• Unix scripting experience (bash, python, etc.)

#LI-DNP

The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance. Please visit Benefits - US | IMC Trading for more comprehensive information.

Salary Range

$175,000—$225,000 USD

About Us

IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors. Using our own technology and capital, we build proprietary systems and algorithms that operate across global markets. Our researchers, traders, and engineers work as a collective, combining rapid experimentation, advanced infrastructure, and real-time feedback to turn insight into execution and execution into advantage.