Remote Hadoop & Spark Big Data Engineer

Bright Vision Technologies; Schaumburg (IL); Remote; USD 86,000 - 103,000; Full time

Job summary

Bright Vision Technologies is seeking a Hadoop Big Data Developer for a 100% remote role in the U.S. The ideal candidate will design, build, and operate large-scale data pipelines on Hadoop, leveraging Spark, Hive, HDFS, and related technologies.

Strong software engineering practices and cost-aware production deployments are essential. The role requires 6+ years of experience with Hadoop ecosystems, streaming platforms like Kafka or Spark Streaming, and proficient scripting in Python or Shell.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop.
• Ingest, transform, and analyze massive volumes of structured and unstructured data.
• Deliver reliable, performant, and cost-effective data platforms in production environments.

Skills

Spark

SQL

Python

Shell

Distributed systems

Documentation

Troubleshooting

Big data pipelines

Education

Bachelor's degree

Tools

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Job description

Bright Vision Technologies is seeking a Hadoop Big Data Developer for a 100% remote role in the U.S. The ideal candidate will design, build, and operate large-scale data pipelines on Hadoop, leveraging Spark, Hive, HDFS, and related technologies.

Strong software engineering practices and cost-aware production deployments are essential. The role requires 6+ years of experience with Hadoop ecosystems, streaming platforms like Kafka or Spark Streaming, and proficient scripting in Python or Shell.