Senior Apache Spark Developer

Experis Technology Group; Jersey City (NJ); Hybrid; USD 120,000 - 164,000; Full time

Benefits offered by this job

Medical Plan

Dental Plan

Vision Plan

Health Savings Account

401(k) Matching

Weekly Pay

Job summary

ManpowerGroup Global, Inc. is seeking a Senior Apache Spark Developer in Jersey City, NJ. The role focuses on migrating and optimizing large Spark jobs to Databricks, building streaming and batch data solutions, and enabling cloud-native data pipelines with AWS.

You will design, develop, and optimize Spark-based applications, collaborate with architects and platform engineers, and support migrations from on-prem to cloud environments. Hybrid work arrangement in Jersey City.

Qualifications

• 5+ years of hands-on Spark development required.
• Strong knowledge of Spark SQL, Structured Streaming, and DataFrames.
• Experience with Kafka integration.
• Proficient in Java and Python.
• Experience in large-scale distributed systems.

Responsibilities

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions using Kafka and Spark.
• Develop reusable frameworks and components for data engineering.
• Support migration from on-prem to Databricks and AWS.
• Collaborate with architects and platform engineers on cloud-native data solutions.

Skills

Apache Spark

Spark SQL

Structured Streaming

DataFrames/Datasets

Performance tuning

Apache Kafka

Java

Python

Distributed systems

Tools

Databricks

AWS

Job description

Please no 3rd party subcontractor inquiries

Our banking client is seeking a Senior Apache Spark Developer to join their team. As a Senior Apache Spark Developer, you will be part of the Data Engineering Department supporting enterprise data initiatives. The ideal candidate will demonstrate strong problem-solving skills, adaptability, and a collaborative mindset, which will align successfully in the organization.

Client is in need of someone who can take existing large-scale data processing jobs created in Apache Spark, migrate and optimize them in Databricks, connect them to cloud storage, and ensure data pipelines continue running efficiently after the move from on-prem infrastructure. Will migrate and optimize existing Spark jobs, ETL pipelines, and data transformations so they can run in Databricks using cloud-based storage and compute resources.

Job Title: Senior Apache Spark Developer

Location: Jersey City, New Jersey (hybrid)

Pay Range:$68.26/hr W2 (may be some flex)

(Due to client rules we are unable to work with 3rd party subcontractors; all candidates must be able to work on Experis' W2 directly)

What's the Job?

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
• Develop reusable frameworks and components supporting enterprise data engineering initiatives.
• Support migration efforts from on-premises data platforms to Databricks and AWS.
• Collaborate with architects and platform engineers to implement cloud-native data solutions.

What's Needed?

• 5+ years of hands-on development experience with Apache Spark.
• Strong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, and performance tuning.
• Experience integrating Spark with Apache Kafka.
• Strong development skills in Java and Python.
• Experience designing and supporting large-scale distributed systems.

What's in it for me?

• Opportunity to work on high-volume, mission-critical data platforms.
• Engage in cloud migration initiatives involving Databricks and AWS.
• Collaborate with a diverse and innovative team.
• Enhance your skills in modern data processing technologies.
• Contribute to impactful data solutions that drive strategic decisions.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay