Lead Senior Java Developer — Data Pipelines (Hybrid NJ)

Pyramid, Inc; Jersey (AR); Hybrid; USD 108,000 - 132,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Paid sick leave

Job summary

Pyramid Consulting, Inc. seeks a Lead Senior Java Developer in New Jersey, hybrid, for a full-time role with long-term potential. The role focuses on designing and delivering scalable data pipelines using Java, Spring Boot, Kafka, and cloud-native technologies.

You will mentor engineers and collaborate across teams to drive best practices in data engineering. The position requires 5+ years of Java development experience, expertise in Flink and Iceberg, and strong API security and data governance

Qualifications

• : 5+ years of strong Java development experience.
• : Proficiency in Java and distributed data processing frameworks.
• : Hands-on experience with Apache Iceberg and Apache Flink for large-scale datasets and real-time processing.
• : Expertise in Kafka for data streaming and messaging.
• : Experience in developing and integrating RESTful APIs with API security and performance optimization.
• : Strong understanding of ETL/ELT processes and data transformation techniques.
• : Familiarity with Docker and Kubernetes for containerization and orchestration.
• : Knowledge of data governance and compliance requirements.
• : Familiarity with monitoring tools like Prometheus and Grafana.
• : Experience with cloud platforms (AWS, Azure, or GCP).

Responsibilities

• Design, develop, and maintain scalable data pipelines using Java, Spring Boot, Microservices, Kafka, AWS, Kubernetes, Docker, JUnit, and Maven/Gradle.
• Implement real-time and batch data processing workflows leveraging Apache Flink and Kafka.
• Manage large-scale datasets with Apache Iceberg, focusing on schema evolution, partitioning, and time-travel queries.
• Develop and integrate secure, scalable APIs for seamless data access and interaction with downstream systems.
• Build and manage real-time data streaming solutions using Kafka, implementing event-driven architectures.
• Ensure data quality, consistency, and security across all pipelines and systems, with monitoring and alerting mechanisms in place.
• Collaborate with cross-functional teams and mentor junior engineers, contributing to best practices in data engineering.

Skills

Java development

Distributed data processing

REST APIs

ETL/ELT

Data governance

Monitoring (Prometheus/Grafana)

Tools

Docker

Kubernetes

Spring Boot

Apache Flink

Apache Iceberg

Kafka

AWS

Maven/Gradle

Job description

Pyramid Consulting, Inc. seeks a Lead Senior Java Developer in New Jersey, hybrid, for a full-time role with long-term potential. The role focuses on designing and delivering scalable data pipelines using Java, Spring Boot, Kafka, and cloud-native technologies.

You will mentor engineers and collaborate across teams to drive best practices in data engineering. The position requires 5+ years of Java development experience, expertise in Flink and Iceberg, and strong API security and data governance