Senior Java Spark Architect – Scalable Data Pipelines

ApTask; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

ApTask is seeking a Java Spark Engineer to architect and build scalable data pipelines using Spark (Java) in a 5-days-in-office setting in Berkley Heights, NJ. You will lead design reviews, mentor engineers, and own production reliability across batch and streaming workloads.

The role demands 7+ years of Java development and 5+ years Spark in production, deep distributed-systems expertise, and strong SQL with Parquet/ORC/Avro/Delta Lake.

Qualifications

• 7+ years of professional Java development experience.
• 5+ years with Apache Spark in production.
• Strong understanding of distributed systems and data locality.

Responsibilities

• Architect and build scalable data pipelines with Spark (Java).
• Lead batch and streaming ETL/ELT design.
• Tune performance: partitioning, memory, shuffle, cost.
• Set coding standards and review code/design.
• Drive data-architecture decisions and tooling.
• Mentor engineers and serve as escalation point.
• Collaborate with product/analytics/platform teams.
• Ensure production reliability and on-call incident response.
• Evaluate new tools to improve systems.
• Contribute to capacity planning and cost optimization.

Skills

Java

Apache Spark

Distributed systems

SQL

Kafka

Kubernetes

CI/CD

Parquet

Delta Lake

Education

Bachelor's or Master’s in CS/Engineering

Tools

YARN

Kubernetes

EMR

Docker

Job description

ApTask is seeking a Java Spark Engineer to architect and build scalable data pipelines using Spark (Java) in a 5-days-in-office setting in Berkley Heights, NJ. You will lead design reviews, mentor engineers, and own production reliability across batch and streaming workloads.

The role demands 7+ years of Java development and 5+ years Spark in production, deep distributed-systems expertise, and strong SQL with Parquet/ORC/Avro/Delta Lake.