Data Engineer

IMC Trading; Chicago (IL); On-site; USD 175,000 - 225,000; Full time

Job summary

IMC Trading in Chicago seeks an experienced Data Engineer to join our growth-driven data team. You will architect and deploy large-scale data systems, build streaming and batch pipelines, and collaborate on data modeling, ingestion, and capacity planning to ensure data integrity and availability across the organization.

You will work with Java, Python, Spark, and Flink, leveraging Kubernetes and Docker for deployment while monitoring with Prometheus/Grafana.

Qualifications

• 5+ years experience in a mature data engineering environment.
• 3+ years building Kafka streaming applications and/or maintaining Kafka clusters.
• 2+ years building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg).
• Experience with Apache Spark, Apache Flink or similar tools.
• Strong Java, Python, and SQL development skills.
• Experience with common data-science toolkits, especially python-based.

Responsibilities

• Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.).
• Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink).
• Collaborate with development teams on data modeling, data ingestion, and capacity planning.
• Work with users to ensure data integrity and availability.
• Act as a Big Data SME and consult on a variety of data-related questions from users and developers.

Skills

Kafka

Hadoop

Dremio

Java

Python

SQL

Spark

Flink

Data modeling

Data ingestion

Capacity planning

Data integrity

Root-cause analysis

Kubernetes

Docker

Prometheus/Grafana

Tools

Kafka

Hadoop

S3

HDFS

Databricks

Iceberg

Spark

Flink

Kubernetes

Docker

Prometheus/Grafana

Job description

We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.

Your Core Responsibilities:

• Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
• Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
• Collaborate with development teams on data modeling, data ingestion, and capacity planning
• Work with users to ensure data integrity and availability
• Act as a Big Data SME and consult on a variety of data-related questions from users and developers

Your Skills and Experience:

• 5+ years experience working in a mature data engineering environment
• 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
• 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
• Experience with Apache Spark, Apache Flink or similar tools
• Strong Java, Python, and SQL development skills
• Experience with common data-science toolkits, especially python-based
• Hands-on experience with Kubernetes and Docker
• Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
• Strong statistical analysis skills
• Demonstrated ability to troubleshoot and conduct root-cause analysis

The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance.Please visit Benefits - US | IMC Trading for more comprehensive information.

Salary Range

$175,000 - $225,000 USD

About Us

IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors. Using our own technology and capital, we build proprietary systems and algorithms that operate across global markets. Our researchers, traders, and engineers work as a collective, combining rapid experimentation, advanced infrastructure, and real-time feedback to turn insight into execution and execution into advantage.

IMC is an equal opportunity employer. IMC prohibits discrimination of any type and affords equal employment opportunities to applicants without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity and expression, national origin, age, disability, military or veteran status, status as a victim of domestic violence, and/or any other categories protected by applicable federal, state or local law. Completion of this section is voluntary and will not affect your opportunity for employment or the terms or conditions of your employment. The data collected from these questions will be stored separately from your individual application and will be kept confidential.