Senior Java Lead: Real-Time Data Pipelines & Microservices

CloudBigD

Arlington (VA)

On-site

USD 100,000 - 142,000

Full time

23 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD in Arlington, VA is seeking a Java Lead Developer to build near real-time data pipelines using Apache Spark, PySpark, and Python. You will design and maintain scalable Java code, ensuring performance, quality, and reliability of applications.

The role involves building pipelines with Flink, Kafka and Python to extract data from various DBs and load into Cassandra, and delivering robust APIs with microservices architecture. Strong debugging and agile mindset are essential.

Qualifications

  • Experience with Agile/Scrum development methodologies.
  • Proven ability to design and implement scalable Java-based services.
  • Strong debugging, problem solving and investigative skills.
  • Experience building data pipelines with Spark, Flink, Kafka.
  • Ability to write unit and integration tests with JUnit/Mockito and Log4j 2.

Responsibilities

  • Build near real-time data pipelines using Spark, PySpark and Python to extract data from NoSQL databases and load into Cassandra.
  • Develop real-time pipelines with Flink, Kafka and Python to extract data from Relational and NoSQL sources and load into Cassandra.

Skills

Java
Spark
Python
APIs
Microservices
Agile/Scrum

Tools

Git
SVN
JUnit
Mockito
Log4j 2
Apache Kafka
Apache Flink
Apache Spark
Cassandra

Job description

CloudBigD in Arlington, VA is seeking a Java Lead Developer to build near real-time data pipelines using Apache Spark, PySpark, and Python. You will design and maintain scalable Java code, ensuring performance, quality, and reliability of applications.

The role involves building pipelines with Flink, Kafka and Python to extract data from various DBs and load into Cassandra, and delivering robust APIs with microservices architecture. Strong debugging and agile mindset are essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Java Lead - Real-Time Data Pipelines & Microservices
Senior Java Lead - Real-Time Data Pipelines & Microservices

Ethereum Technologies LLC • Arlington (VA)

On-site
USD 100,000 - 142,000
Senior Java Lead Developer — Real-Time Data & Microservices
Senior Java Lead Developer — Real-Time Data & Microservices

Quantum Technologies LLC • Arlington (VA)

On-site
USD 100,000 - 142,000
Lead Java Developer for Real-Time Data Pipelines
Lead Java Developer for Real-Time Data Pipelines

Valiant Technologies LLC • Arlington (VA)

On-site
USD 100,000 - 142,000
Lead Java Engineer – Real-Time Data Pipelines & Microservices
Lead Java Engineer – Real-Time Data Pipelines & Microservices

Robotics Technologies • Arlington (VA)

On-site
USD 103,000 - 141,000
Java Lead Engineer: Real-Time Data Pipelines & Microservices
Java Lead Engineer: Real-Time Data Pipelines & Microservices

Robotic Process Automation LLC • Arlington (VA)

On-site
USD 103,000 - 139,000
Real-Time Data Engineer (Spark, Kafka, Java) — 10mo
Real-Time Data Engineer (Spark, Kafka, Java) — 10mo

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 84,000 - 120,000
Realtime Data Engineer | Spark, Kafka & Java
Realtime Data Engineer | Spark, Kafka & Java

Valiant Technologies LLC • Dallas (TX)

On-site
USD 84,000 - 120,000
Senior Java J2EE & PySpark Data Pipeline Engineer
Senior Java J2EE & PySpark Data Pipeline Engineer

SCI SOLUTIONS GLOBAL • Plano (TX)

On-site
USD 110,000 - 140,000
Senior Data Engineer: Real-Time Pipelines & Cloud Analytics
Senior Data Engineer: Real-Time Pipelines & Cloud Analytics

Cloudndata • United States

Hybrid
USD 140,000 - 180,000
Senior Big Data Engineer: Real-Time Pipelines on AWS
Senior Big Data Engineer: Real-Time Pipelines on AWS

Princeton IT Services, Inc • Mount Laurel Township (NJ)

On-site
USD 120,000 - 150,000