Remote Hadoop & Big Data Engineer — Spark, Hive, Kafka

Bright Vision Technologies; Nashua (NH); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies seeks a Hadoop Big Data Developer to design, build, and operate large-scale data pipelines on Hadoop ecosystems for analytics and ML. The role is 100% remote in the U.S. with a Full-time Direct W2 arrangement.

The ideal candidate has 10+ years of experience, deep Spark and Hadoop expertise, and strong SQL with both relational and NoSQL stores. Production-grade, cost-efficient platforms and strong software engineering fundamentals are required.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• 5+ years of professional experience designing and operating big-data pipelines on Hadoop.
• Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
• Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience with relational and NoSQL stores.
• Experience with Airflow or Oozie.
• Understanding of distributed systems concepts (partitioning, replication, fault tolerance).
• Scripting in Python or Shell; excellent troubleshooting and documentation.

Responsibilities

• Design, build, and operate large-scale data pipelines on Hadoop ecosystems.
• Ingest, transform, and analyze massive structured and unstructured data for analytics and ML.
• Deliver reliable, performant, cost-effective data platforms in production.

Skills

Big data architecture

Production-grade pipelines

Troubleshooting

Documentation

Education

Bachelor’s degree in CS/Engineering or related

Tools

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Python

Shell scripting

SQL

NoSQL

AWS EMR/Azure HDInsight/Databricks

Databricks

Kubernetes

Trino

CI/CD

Job description

Bright Vision Technologies seeks a Hadoop Big Data Developer to design, build, and operate large-scale data pipelines on Hadoop ecosystems for analytics and ML. The role is 100% remote in the U.S. with a Full-time Direct W2 arrangement.

The ideal candidate has 10+ years of experience, deep Spark and Hadoop expertise, and strong SQL with both relational and NoSQL stores. Production-grade, cost-efficient platforms and strong software engineering fundamentals are required.