Senior Spark Architect (Cloud Data, Kafka)

Apex Systems, LLC

Jersey City, Northern (NJ, KY)

Hybrid

USD 99,000 - 101,000

Full time

2 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Everforth Apex in Jersey City, NJ is seeking a Senior Apache Spark Developer to design and optimize Spark-based data processing solutions. The role focuses on streaming and batch processing with Kafka, and migrating workloads to Databricks and AWS.

You will collaborate with platform engineers to build scalable cloud-native data pipelines and ensure performance and reliability. The candidate should have 5+ years of Spark experience, strong Java and Python skills, and a track record of supporting

Qualifications

  • Bachelor’s Degree required.
  • 5+ years hands-on Spark development experience.
  • Experience designing large-scale distributed systems.
  • Experience with relational and distributed data platforms.

Responsibilities

  • Design, develop and optimize Spark-based applications for large-scale data processing.
  • Build streaming and batch solutions using Kafka and Spark.
  • Develop reusable data engineering frameworks and components.
  • Support migration from on-prem to Databricks and AWS.
  • Collaborate with architects to implement cloud-native data solutions.
  • Implement CI/CD, monitoring, and observability for distributed data apps.
  • Troubleshoot Spark, Kafka, Databricks and cloud environments.

Skills

Spark SQL
Structured Streaming
DataFrames/Datasets
Performance tuning
Spark-Kafka integration
Java
Python

Education

Bachelor's Degree

Tools

Databricks
AWS
Apache Kafka

Job description

Everforth Apex in Jersey City, NJ is seeking a Senior Apache Spark Developer to design and optimize Spark-based data processing solutions. The role focuses on streaming and batch processing with Kafka, and migrating workloads to Databricks and AWS.

You will collaborate with platform engineers to build scalable cloud-native data pipelines and ensure performance and reliability. The candidate should have 5+ years of Spark experience, strong Java and Python skills, and a track record of supporting

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Spark Developer: Databricks Cloud Migration
Senior Spark Developer: Databricks Cloud Migration

ManpowerGroup Global, Inc. • Jersey City (NJ)

On-site
USD 120,000 - 164,000
Medical Plan
Dental Plan
Vision Plan
+3
Cloud Data Platform Architect – Big Data Transformation
Cloud Data Platform Architect – Big Data Transformation

Apex Systems, LLC • Jersey City (NJ), Northern (KY)

Hybrid
USD 99,000 - 101,000
Benefits package
ESPP
401K with company match
+1
Senior Apache Spark Developer
Senior Apache Spark Developer

Apex Systems, LLC • Jersey City (NJ), Northern (KY)

Hybrid
USD 99,000 - 101,000
Senior Java Spark Architect – Scalable Data Pipelines
Senior Java Spark Architect – Scalable Data Pipelines

ApTask • New York (NY)

On-site
USD 150,000 - 210,000
Senior Java Spark Engineer Onsite: Data Pipeline Architect
Senior Java Spark Engineer Onsite: Data Pipeline Architect

Saransh Inc • Berkley (AL)

On-site
USD 150,000 - 210,000
Java Spark Engineer
Java Spark Engineer

Saransh Inc • Berkley (AL)

On-site
USD 150,000 - 210,000
Senior Spark Developer — Remote, Big Data & Cloud
Senior Spark Developer — Remote, Big Data & Cloud

Bright Vision Technologies • Austin (TX)

Remote
USD 125,000 - 185,000
Senior Java Spark Architect & Data Pipeline Tech Lead
Senior Java Spark Architect & Data Pipeline Tech Lead

Mphasis • New York (NY)

On-site
USD 63,000 - 135,000
Java Spark Engineer
Java Spark Engineer

ApTask • New York (NY)

On-site
USD 150,000 - 210,000
Senior Apache Spark Developer
Senior Apache Spark Developer

ManpowerGroup Global, Inc. • Jersey City (NJ)

Hybrid
USD 120,000 - 164,000
Medical Plan
Dental Plan
Vision Plan
+3