Senior Spark Engineer | Kafka, Databricks & AWS

Matlen Silver; Jersey City (NJ); On-site; USD 90,000 - 101,000; Full time

Benefits offered by this job

Health, vision, and dental insurance (

401(k) plan

Job summary

Matlen Silver seeks a Senior Apache Spark Developer to build and scale a cutting-edge data processing platform. You will design distributed Spark solutions while leveraging an enterprise Kafka ecosystem and cloud-driven migrations.

The role involves implementing CI/CD, monitoring, and observability for large-scale data applications, with exposure to Databricks and AWS in a modern cloud environment.

Qualifications

• 5+ years of hands-on development with Apache Spark.
• Experience integrating Spark with Apache Kafka.
• Bachelor’s Degree in a related field.

Responsibilities

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
• Develop reusable frameworks and components for enterprise data engineering initiatives.

Skills

Spark

Spark SQL

Structured Streaming

DataFrames/Datasets

Performance tuning

Kafka

Java

Python

Distributed systems

Education

Bachelor's Degree

Job description

Matlen Silver seeks a Senior Apache Spark Developer to build and scale a cutting-edge data processing platform. You will design distributed Spark solutions while leveraging an enterprise Kafka ecosystem and cloud-driven migrations.

The role involves implementing CI/CD, monitoring, and observability for large-scale data applications, with exposure to Databricks and AWS in a modern cloud environment.