Senior Big Data Engineer — Kafka & Streaming

PROCAL TECHNOLOGIES; Basking Ridge (NJ); On-site; USD 140,000 - 190,000; Full time

Job summary

PROCAL TECHNOLOGIES in Basking Ridge, NJ is seeking a data engineering lead to design and run end-to-end data integration on big data platforms. You will optimize data pipelines and scale data lakes and warehouses, collaborating across teams.

The role requires Java/Python/Scala, Kafka, and strong security/governance knowledge; you will implement robust streaming solutions and stay ahead of AI/ML trends.

Qualifications

• 5+ years designing data applications in production on big data platforms using Java, Python or Scala.
• 5+ years with streaming technologies, with a strong focus on Kafka and open-source platforms.
• Proven ability to optimize data flow and design scalable pipelines, including data lakes/warehouses on containerized clusters.
• Strong understanding of distributed data architecture concepts (caching, MapReduce, stream processing).
• Solid knowledge of data security, governance, and compliance.
• Proficiency in Java, Python, Scala, and SQL.

Responsibilities

• Design and lead end-to-end data integration.
• Perform performance tuning, diagnose, and resolve complex big data and streaming issues.
• Design and implement scalable solutions across the technology stack, including data processing, database, web services, network, and security layers.

Skills

Java

Python

Scala

SQL

Big data

Data pipelines

Distributed data architecture

Data security

Tools

Kafka

Apache ecosystem

Job description

PROCAL TECHNOLOGIES in Basking Ridge, NJ is seeking a data engineering lead to design and run end-to-end data integration on big data platforms. You will optimize data pipelines and scale data lakes and warehouses, collaborating across teams.

The role requires Java/Python/Scala, Kafka, and strong security/governance knowledge; you will implement robust streaming solutions and stay ahead of AI/ML trends.