Senior Apache Spark Developer

Collabera; Jersey City (NJ); Hybrid; USD 83,000 - 90,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) retirement plan

Life insurance

Long-term disability insurance

Short-term disability insurance

Paid parking/public transportation

Paid time off

Paid sick and safe time

Paid vacation time

Paid parental leave

Paid holidays

Job summary

Collabera is seeking a Senior Apache Spark Developer in Jersey City, NJ for a 12-month contract, hybrid in-person interview for local candidates. You will design and optimize Spark-based data processing, streaming and batch solutions, and support migration to Databricks and AWS. Strong Java/Python skills and experience with Kafka are essential.

The role focuses on large-scale distributed systems, performance tuning, and enterprise data platforms, with a mix of on-prem and cloud components.

Qualifications

• 5+ years of hands-on Apache Spark development.
• Strong skills in Spark SQL, Structured Streaming, and DataFrames/Datasets.
• Experience with performance tuning and optimization.
• Experience integrating Spark with Kafka.
• Proficient in Java and Python.
• Experience designing large-scale distributed systems.
• Solid understanding of OO design and testing practices.
• Experience with relational and distributed data platforms.
• Bachelor's degree required.

Responsibilities

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
• Develop reusable frameworks and components supporting enterprise data engineering initiatives.
• Support migration efforts from on-premises data platforms to Databricks and AWS.
• Collaborate with architects and platform engineers to implement cloud-native data solutions.
• Optimize Spark jobs for performance, scalability, reliability, and operational efficiency.
• Participate in system design, code reviews, testing, and production support activities.
• Implement CI/CD, monitoring, and observability practices for distributed data applications.
• Troubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.

Skills

Spark SQL

Structured Streaming

DataFrames/Datasets

Performance tuning

Kafka integration

Java

Python

Distributed systems design

Object-oriented design

Testing practices

Relational/distributed data platforms

Education

Bachelor's Degree

Tools

Databricks

AWS

S3

EMR

Glue

Lambda

ECS/EKS

Job description

Job Title: Senior Apache Spark Developer

Location: Jersey city ,NJ (Only Local candidates who can come for in person interview )
Work Arrangement:Hybrid
Client Industry: Banking
Duration:12 MonthsContract

Key Focus Area :: Spark SQL, Structured Streaming , Apache Kafka, AMPS

About the Role

We are hiring an Senior Apache Spark Developer

Required Qualifications

• 5+ years of hands-on development experience with Apache Spark.
• Strong expertise in:
• Spark SQL
• Structured Streaming
• DataFrames/Datasets
• Performance tuning and optimization
• Experience integrating Spark with Apache Kafka.
• Java
• Python
• Experience designing and supporting large-scale distributed systems.
• Solid understanding of software engineering principles, object-oriented design, and testing practices.
• Experience working with relational and distributed data platforms.
• Bachelor's Degree

Key Responsibilities

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
• Develop reusable frameworks and components supporting enterprise data engineering initiatives.
• Support migration efforts from on-premises data platforms to Databricks and AWS.
• Collaborate with architects and platform engineers to implement cloud-native data solutions.
• Optimize Spark jobs for performance, scalability, reliability, and operational efficiency.
• Participate in system design, code reviews, testing, and production support activities.
• Implement CI/CD, monitoring, and observability practices for distributed data applications.
• Troubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.

Preferred Qualifications

• Databricks experience (SQL).
• AWS experience, including services such as:
  • S3
  • EMR
  • Glue
  • Lambda
  • ECS/EKS
• Experience supporting large-scale cloud migration initiatives.
• Experience with lakehouse architectures and modern data platform patterns.
• Experience handling multi-terabyte or petabyte-scale datasets.
• Financial services or regulated industry experience.

Hourly Rate:60$-65$ per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.

The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

About Us

At Collabera, we don't just offer jobs— we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.