Data Engineer – Spark, Cloud & Databricks

Epsilon

Chicago (IL)

On-site

USD 74,000 - 137,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible time off

Paid holidays

Parental leave

Commuter benefits

Tuition assistance

Professional development

Job summary

Epsilon is seeking a Data Engineer to collaborate with decision scientists, optimizing AI/ML workflows through data engineering and platform support in a distributed cloud environment. You will troubleshoot Spark/Hadoop jobs, participate in agile sprints, and contribute to best practices across applications.

Required: 3+ years in software development, proficiency in Scala/Python/Java, and experience with Spark/Hadoop.

Qualifications

3+ years of software development in scalable, distributed environments.
Proficient in Scala, Python, or Java; able to build data-driven solutions at scale.
Familiarity with Apache Spark; exposure to Hadoop/Hive.

Responsibilities

Collaborate with decision scientists to enable and optimize AI/ML workflows via data engineering and platform support.
Provide support for Spark, Hive, and Hadoop jobs, including troubleshooting and performance optimization.
Participate in agile sprint cycles, review designs, and give feedback to ensure successful delivery.
Contribute to best practices for application development and data platform improvements.
Gather requirements for platform enhancements and implement them with the team.