Senior Hadoop Data Engineer – Remote

Bright Vision Technologies; Austin (TX); Remote; USD 145,000 - 165,000; Full time

Job summary

Bright Vision Technologies is seeking a Senior Data Engineer - Hadoop to design, build, and operate large-scale data processing pipelines on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads.

The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software

Qualifications

• Bachelor’s degree in CS/engineering or a related technical field.
• 5+ years designing and operating big-data pipelines on Hadoop.
• Strong hands-on Spark (Scala, Python, or Java) in production environments.

Responsibilities

• Design, build, and operate large-scale data pipelines on Hadoop.
• Ingest, transform, and analyze massive volumes of data for analytics.
• Deliver reliable, performant, and cost-effective data platforms in production.

Skills

SQL

Python scripting

Shell scripting

Distributed systems

Education

Bachelor’s degree in Computer Science or Engineering

Tools

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Job description

Bright Vision Technologies is seeking a Senior Data Engineer - Hadoop to design, build, and operate large-scale data processing pipelines on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads.

The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software