Senior Data Engineer – Kafka, Spark & Big Data

IMC Trading; Chicago (IL); On-site; USD 175,000 - 225,000; Full time

Benefits offered by this job

Discretionary bonus

Paid leave

Insurance

Job summary

IMC Trading is seeking an experienced Data Engineer to join their Chicago team, driving the architecture and deployment of their Big Data environment. The ideal candidate should have over 5 years in data engineering, with strong skills in Java, Python, and data processing tools like Kafka and Spark.

This role offers a competitive base salary range of $175,000 - $225,000 USD, along with benefits including a discretionary bonus, paid leave, and insurance.

Qualifications

• 5+ years experience working in a mature data engineering environment.
• 3+ years of experience with Kafka streaming applications and/or maintaining Kafka clusters.
• 2+ years of experience with Big Data backends (S3, HDFS, etc).

Responsibilities

• Architect, develop and deploy our Big Data environment.
• Build, deploy, and monitor data processing pipelines.
• Collaborate with development teams on data modeling and ingestion.

Skills

Kafka streaming applications

Big Data backends

Java

Python

SQL

Kubernetes

Docker

Statistical analysis

Unix scripting

Tools

Apache Spark

Apache Flink

Prometheus

Grafana

Job description

IMC Trading is seeking an experienced Data Engineer to join their Chicago team, driving the architecture and deployment of their Big Data environment. The ideal candidate should have over 5 years in data engineering, with strong skills in Java, Python, and data processing tools like Kafka and Spark.

This role offers a competitive base salary range of $175,000 - $225,000 USD, along with benefits including a discretionary bonus, paid leave, and insurance.