Core Java Spark ETL Engineer (Intermediate)

Ampcus Inc; Chicago (IL); On-site; USD 90,000 - 130,000; Full time

Job summary

Ampcus Inc. is seeking an ETL/Data Engineer to develop and maintain applications using Apache Spark and Java in a Chicago-area environment.

The role involves working with Spark components such as Datasets and Spark SQL, collaborating with business analysts and senior engineers to translate requirements into scalable software solutions. Ideal candidates have 3+ years in data engineering, strong Java and SQL skills, and familiarity with SDLC and Agile workflows.

Qualifications

• 3+ years of experience in data engineering with Java and Spark.
• Experience with Spark ecosystem: Datasets, Spark SQL, scalability.
• Strong Java coding skills and SQL proficiency in a corporate environment.
• Familiarity with the Software Development Life Cycle and Agile methodologies.

Responsibilities

• Develop and maintain applications using Apache Spark and Java.
• Work with Spark ecosystem including Datasets, Spark SQL and scalability support.
• Collaborate with business analysts and lead engineers to understand requirements and designs for implementing software solutions.
• Improve performance of Spark applications processing millions of data elements daily.
• Provide production support and troubleshooting for Spark applications.
• Contribute to software engineering communities of practice and events exploring new technologies.
• Support team culture of diversity, equity, inclusion and respect.

Skills

Java

Spring Boot

AWS Glue

Kubernetes

CI/CD

Python

Kafka

Lambdas

API

Tools

Apache Spark

SQL

Job description

Ampcus Inc. is seeking an ETL/Data Engineer to develop and maintain applications using Apache Spark and Java in a Chicago-area environment.

The role involves working with Spark components such as Datasets and Spark SQL, collaborating with business analysts and senior engineers to translate requirements into scalable software solutions. Ideal candidates have 3+ years in data engineering, strong Java and SQL skills, and familiarity with SDLC and Agile workflows.