Remote Big Data Engineer – Spark & Hadoop Expert

Bright Vision Technologies; Reston (VA); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Big Data Application Developer to design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive volumes of data to power enterprise analytics, ML, and reporting workloads.

The ideal candidate will combine deep Hadoop expertise with strong software engineering fundamentals to deliver reliable, cost-effective data platforms in production environments.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
• Proven expertise with Apache Spark in production environments (Scala, Python, or Java).
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.

Responsibilities

• Design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related ecosystems.
• Ingest, transform, and analyze massive volumes of structured and unstructured data to support analytics, ML, and reporting workloads.

Skills

Spark (Apache Spark)

SQL

Python

Shell

Distributed systems

Troubleshooting

Education

Bachelor’s degree in Computer Science/Engineering

Tools

Hadoop

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Job description

Bright Vision Technologies is seeking an experienced Big Data Application Developer to design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive volumes of data to power enterprise analytics, ML, and reporting workloads.

The ideal candidate will combine deep Hadoop expertise with strong software engineering fundamentals to deliver reliable, cost-effective data platforms in production environments.