Remote Hadoop Big Data Engineer — Spark & Analytics

Bright Vision Technologies; Canton Charter Township (MI); On-site; USD 86,000 - 103,000; Full time

Job summary

Bright Vision Technologies is seeking a Hadoop Big Data Developer for a fully remote role in the United States. The position focuses on designing, building, and operating large-scale data pipelines on Hadoop and related ecosystems to support analytics, ML, and reporting workloads.

The ideal candidate will have 6+ years of experience, strong Spark and Hadoop tooling, and a solid grasp of distributed systems, with the ability to deliver scalable, cost-efficient data platforms in production.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
• Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
• Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience working with both relational and NoSQL data stores.
• Experience with workflow orchestration tools such as Airflow or Oozie.
• Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
• Strong scripting skills in Python or Shell.
• Excellent troubleshooting, debugging, and documentation skills.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems.
• Ingest, transform, and analyze massive volumes of structured and unstructured data.
• Deliver reliable, performant, and cost-effective data platforms in production environments.

Skills

Apache Spark

Hadoop ecosystem

SQL

Python

Shell

Kafka

Airflow

Oozie

Hive

HDFS

Education

Bachelor’s degree in Computer Science or related field

Tools

Airflow

Oozie

Kafka

Spark (Scala/Python/Java)

Hadoop ecosystem tools

Hive

HDFS

Job description

Bright Vision Technologies is seeking a Hadoop Big Data Developer for a fully remote role in the United States. The position focuses on designing, building, and operating large-scale data pipelines on Hadoop and related ecosystems to support analytics, ML, and reporting workloads.

The ideal candidate will have 6+ years of experience, strong Spark and Hadoop tooling, and a solid grasp of distributed systems, with the ability to deliver scalable, cost-efficient data platforms in production.