Senior Big Data Engineer - Streaming & Kafka, Remote

Hitachi, Ltd.; Bernards Township (NJ); On-site; USD 110,000 - 115,000; Full time

Benefits offered by this job

Exciting Projects

Collaborative Environment

Work-Life Balance

Professional Development

Excellent Benefits

Job summary

GlobalLogic is seeking an experienced data engineering professional to design and lead end-to-end data integration across diverse sources. You will tune performance and resolve complex big data and streaming issues on a scalable tech stack, including data processing, databases, and security.

Responsibilities include testing, QA support, requirements analysis, and evaluating third-party libraries. A CS/CE/Math degree is required, with 5+ years in production data apps and Kafka-focused streaming

Qualifications

• 5+ years designing and implementing data applications in production using Java, Python, or Scala on big data platforms.
• 5+ years of hands-on experience with streaming technologies, especially Kafka, on open-source stacks.
• Ability to optimize data flow and design scalable data pipelines including data lakes/warehouses.
• Knowledge of distributed data architectures, caching, MapReduce, and security/compliance.
• Bachelor's or Master’s degree in Computer Science, Computer or Electrical Engineering, Mathematics, or related field.

Responsibilities

• Design and lead end-to-end data integration from diverse sources.
• Tune performance, diagnose, and resolve complex big data/streaming issues.
• Design and implement scalable solutions across the tech stack (data processing, databases, services, network, security).
• Coordinate integration testing and support QA on large-scale projects.
• Contribute to requirements analysis, estimation, system design, coding, and testing.
• Evaluate third-party libraries to enhance product capabilities and stay current with big data/AI/ML trends.

Skills

Java

Python

Scala

SQL

Kafka

Big data

Education

CS/CE/Math degree

Tools

Linux

Apache ecosystem

Job description

GlobalLogic is seeking an experienced data engineering professional to design and lead end-to-end data integration across diverse sources. You will tune performance and resolve complex big data and streaming issues on a scalable tech stack, including data processing, databases, and security.

Responsibilities include testing, QA support, requirements analysis, and evaluating third-party libraries. A CS/CE/Math degree is required, with 5+ years in production data apps and Kafka-focused streaming