Remote Hadoop Big Data Engineer | Spark & Data Pipelines

Bright Vision Technologies; Framingham (MA); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking a Hadoop Big Data Developer for a 100% remote role in the United States. The candidate will design, build, and operate large-scale data pipelines on Hadoop ecosystems and support analytics workloads.

The ideal candidate has 10+ years of experience, strong Spark/Hive/HDFS skills, and proficient scripting. This is a full-time W2 position with a salary range of $100,000–$150,000 per year, offering substantial growth opportunities.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
• Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
• Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems.
• Ingest, transform, and analyze massive volumes of structured and unstructured data.
• Deliver reliable, performant, and cost-effective data platforms in production environments.

Skills

Hadoop

Apache Spark

Hive

HDFS

Kafka

Python

SQL

Oozie

Airflow

Shell

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

Tools

Databricks

Kubernetes

CI/CD

Job description

Bright Vision Technologies is seeking a Hadoop Big Data Developer for a 100% remote role in the United States. The candidate will design, build, and operate large-scale data pipelines on Hadoop ecosystems and support analytics workloads.

The ideal candidate has 10+ years of experience, strong Spark/Hive/HDFS skills, and proficient scripting. This is a full-time W2 position with a salary range of $100,000–$150,000 per year, offering substantial growth opportunities.