Senior Hadoop Data Engineer - Remote

JobCubby; Round Rock, Northern (TX, KY); Hybrid; USD 145,000 - 165,000; Full time

Job summary

Bright Vision Technologies, a technology consulting and software development firm, is seeking a Senior Data Engineer - Hadoop. This role focuses on designing, building, and operating large-scale data pipelines on Hadoop to support enterprise analytics and ML workloads.

The ideal candidate will have 6+ years of experience, strong Spark/Hadoop expertise, and a track record delivering reliable data platforms in production environments. This is a 100% remote, full-time position in the U.S.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 5+ years designing and operating big-data pipelines on Hadoop.
• Strong hands-on experience with Apache Spark in production.
• Experience with Hive, HDFS, Sqoop, HBase.
• Experience with streaming platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience with relational and NoSQL stores.
• Experience with Airflow or Oozie.
• Understanding of distributed systems concepts (partitioning, replication, fault tolerance).
• Scripting in Python or Shell.
• Excellent troubleshooting, debugging, and documentation skills.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop.
• Ingest, transform, and analyze massive structured and unstructured data for analytics and ML workloads.
• Deliver reliable, performant, and cost-effective data platforms in production.

Skills

SQL

Python/Shell scripting

Distributed systems concepts

Troubleshooting

Documentation

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Kubernetes

Job description

Bright Vision Technologies, a technology consulting and software development firm, is seeking a Senior Data Engineer - Hadoop. This role focuses on designing, building, and operating large-scale data pipelines on Hadoop to support enterprise analytics and ML workloads.

The ideal candidate will have 6+ years of experience, strong Spark/Hadoop expertise, and a track record delivering reliable data platforms in production environments. This is a 100% remote, full-time position in the U.S.