Senior Hadoop Big Data Engineer - Remote

Bright Vision Technologies; Edison (NJ); Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer for a 100% remote role in the United States. You will design, build, and operate large-scale data pipelines on Hadoop, ingesting and transforming massive data volumes to support analytics and ML workloads.

The ideal candidate has 10+ years of experience, deep Spark/Hadoop ecosystem knowledge, and strong software engineering fundamentals to deliver reliable, cost-efficient data platforms in production.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Ten or more years of professional experience designing and operating big-data pipelines on Hadoop.
• Strong hands‑on expertise with Apache Spark (Scala, Python, or Java) in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
• Hands‑on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience with relational and NoSQL data stores.
• Experience with Airflow or Oozie.
• Knowledge of distributed systems concepts, partitioning, replication, and fault tolerance.
• Strong scripting in Python or Shell.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop.
• Ingest, transform, and analyze massive data volumes to support analytics and ML workloads.
• Deliver reliable, performant, and cost-effective data platforms in production environments.

Skills

Hadoop pipelines

Spark (Scala/Python/Java)

SQL

Python

Shell scripting

Kafka

NoSQL

Airflow/Oozie

Distributed systems

Education

Bachelor’s degree in Computer Science/Engineering

Tools

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Airflow

Oozie

Python

Shell

Spark Streaming

Flink

Job description

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer for a 100% remote role in the United States. You will design, build, and operate large-scale data pipelines on Hadoop, ingesting and transforming massive data volumes to support analytics and ML workloads.

The ideal candidate has 10+ years of experience, deep Spark/Hadoop ecosystem knowledge, and strong software engineering fundamentals to deliver reliable, cost-efficient data platforms in production.