Remote Hadoop Big Data Engineer

United States Digital Space LLC; United States; Remote; USD 62,000 - 103,000; Full time

Job summary

Bright Vision Technologies seeks an experienced Hadoop Big Data Developer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive data to support enterprise analytics, ML, and reporting workloads.

The role is 100% remote within the U.S., full-time Direct W2, with a salary range of $86,000–$103,000 annually. A strong background in Spark, Hive, HDFS, and streaming tools is required.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
• Hands-on Apache Spark (Scala, Python, or Java) in production environments.
• Experience with Hive, HDFS, Sqoop, HBase and broader Hadoop ecosystem.
• Experience with streaming platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience with relational and NoSQL stores.
• Experience with Airflow or Oozie for workflow orchestration.
• Understanding of distributed systems including partitioning, replication, fault tolerance.
• Python or Shell scripting experience.
• Excellent troubleshooting, debugging, and documentation skills.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop.
• Ingest, transform, and analyze massive volumes of data for analytics and reporting.
• Deliver reliable, performant, and cost-effective data platforms in production.

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

Tools

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Python

Shell

Job description

Bright Vision Technologies seeks an experienced Hadoop Big Data Developer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive data to support enterprise analytics, ML, and reporting workloads.

The role is 100% remote within the U.S., full-time Direct W2, with a salary range of $86,000–$103,000 annually. A strong background in Spark, Hive, HDFS, and streaming tools is required.