Application Architect

Talentify; Jersey City (NJ); On-site; USD 88,000 - 99,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Health Savings Account

401K

Sick Pay

Commuter Benefits

Behavioral Health Platform

Life Insurance

Job summary

Genesis10 is seeking a Senior Apache Spark Developer to design and develop distributed data processing solutions using Spark while leveraging an enterprise Kafka ecosystem. The role focuses on scaling data processing capabilities, enabling cloud adoption, and supporting migration initiatives involving Databricks and AWS.

The candidate will design and deploy Spark-based applications, build streaming/batch solutions, and collaborate with architects and platform engineers to ensure performance,

Qualifications

• 5+ years of hands-on development experience with Apache Spark.
• Strong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, performance tuning and optimization.
• Experience integrating Spark with Apache Kafka.
• Strong development skills in Java and Python.
• Experience designing and supporting large-scale distributed systems.
• Solid understanding of software engineering principles, object-oriented design, and testing practices.
• Experience working with relational and distributed data platforms.

Responsibilities

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
• Develop reusable frameworks and components supporting enterprise data engineering initiatives.
• Support migration efforts from on-premises data platforms to Databricks and AWS.
• Collaborate with architects and platform engineers to implement cloud-native data solutions.
• Optimize Spark jobs for performance, scalability, reliability, and operational efficiency.
• Participate in system design, code reviews, testing, and production support activities.
• Implement CI/CD, monitoring, and observability practices for distributed data applications.
• Troubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.

Skills

Apache Spark

Spark SQL

Structured Streaming

DataFrames/Datasets

Kafka

Java

Python

Distributed systems

Testing practices

Education

Bachelor's Degree

Tools

Databricks

AWS

Job description

Genesis10 is currently seeking a Senior Apache Spark Developer for a contract position with a Global Financial Institution located in Jersey City, NJ. This is a 12+ month contract opportunity.

We are seeking a Senior Apache Spark Developer to help build and expand our next-generation data processing platform. This role will focus on designing and developing distributed data processing solutions using Apache Spark while leveraging an existing enterprise Kafka ecosystem. The successful candidate will play a critical role in scaling our data processing capabilities, enabling cloud adoption, and supporting strategic migration initiatives involving Databricks and AWS.

Key Responsibilities:

• Design, develop, and optimize Spark-based applications for large-scale data processing
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark
• Develop reusable frameworks and components supporting enterprise data engineering initiatives
• Support migration efforts from on-premises data platforms to Databricks and AWS
• Collaborate with architects and platform engineers to implement cloud-native data solutions
• Optimize Spark jobs for performance, scalability, reliability, and operational efficiency
• Participate in system design, code reviews, testing, and production support activities
• Implement CI/CD, monitoring, and observability practices for distributed data applications
• Troubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems

Requirements:

• 5+ years of hands-on development experience with Apache Spark
• Strong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, performance tuning and optimization
• Experience integrating Spark with Apache Kafka
• Strong development skills in Java and Python
• Experience designing and supporting large-scale distributed systems
• Solid understanding of software engineering principles, object-oriented design, and testing practices
• Experience working with relational and distributed data platforms
• Bachelor's Degree

Desired skills:

• Databricks experience (SQL)
• AWS experience, including services such as S3, EMR, Glue, Lambda, ECS/EKS
• Experience supporting large-scale cloud migration initiatives
• Experience with lakehouse architectures and modern data platform patterns
• Experience handling multi-terabyte or petabyte-scale datasets
• Financial services or regulated industry experience

Pay range: $63.68 - $71.68 per hour

Only candidates available and ready to work directly as Genesis10 employees will be considered for this position.

For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:

• Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
• The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
• Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
• Behavioral Health Platform
• Medical, Dental, Vision
• Health Savings Account
• Voluntary Hospital Indemnity (Critical Illness & Accident)
• Voluntary Term Life Insurance
• 401K
• Sick Pay (for applicable states/municipalities)
• Commuter Benefits (Dallas, NYC, SF, and Illinois)

Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.