Senior Big Data Engineer — Kafka, Spark & Cloud Pipelines

IMC B.V.; Chicago (IL); On-site; USD 175,000 - 225,000; Full time

Benefits offered by this job

Discretionary bonus

Paid leave

Insurance benefits

Job summary

IMC B.V. is seeking a dedicated Data Engineer in Chicago. The role involves architecting and developing a Big Data environment and building data processing pipelines using technologies such as Kafka, Python, and Spark.

The ideal candidate has over 5 years of experience in data engineering, strong programming skills, and experience with Kubernetes and Docker. The salary range is $175,000 to $225,000, accompanied by a discretionary bonus and benefits.

Qualifications

• 5+ years experience working in mature data engineering environments.
• 3+ years of experience building Kafka streaming applications.
• 2+ years of experience with Big Data backends.

Responsibilities

• Architect, develop and deploy Big Data environment.
• Build and monitor data processing pipelines.
• Consult on data-related questions from users.

Skills

Kafka streaming applications

Apache Spark

Java

Python

SQL

Kubernetes

Docker

Prometheus

Grafana

Unix scripting

Tools

Dremio

Hadoop

Big Data backends

Data processing pipelines

Job description

IMC B.V. is seeking a dedicated Data Engineer in Chicago. The role involves architecting and developing a Big Data environment and building data processing pipelines using technologies such as Kafka, Python, and Spark.

The ideal candidate has over 5 years of experience in data engineering, strong programming skills, and experience with Kubernetes and Docker. The salary range is $175,000 to $225,000, accompanied by a discretionary bonus and benefits.