Senior Hadoop Data Engineer — 100% Remote (Spark/Big Data)

Bright Vision Technologies; Chesterfield (MO); A distancia; USD 145.000 - 165.000; Jornada completa

Descripción de la vacante

Bright Vision Technologies seeks a Senior Data Engineer - Hadoop to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive data to support enterprise analytics, ML, and reporting workloads.

The role blends deep Hadoop expertise with strong software engineering to deliver reliable, scalable data platforms. The ideal candidate has 6+ years of experience, hands-on Spark, Hive, HDFS, and streaming tech, plus Python or

Formación

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• 5+ years designing and operating big-data pipelines on Hadoop.
• Strong hands-on Apache Spark experience in production.
• Solid Hive, HDFS, Sqoop, HBase exposure.
• Hands-on streaming with Kafka, Spark Streaming, or Flink.
• Strong SQL and experience with relational and NoSQL stores.
• Experience with Airflow or Oozie for workflow orchestration.
• Distributed systems knowledge: partitioning, replication, fault tolerance.
• Python or Shell scripting; excellent troubleshooting and docs.

Responsabilidades

• Design, build, and operate large-scale data pipelines on Hadoop ecosystems.
• Ingest, transform, and analyze massive structured and unstructured data.
• Support enterprise analytics, ML workloads, and reporting.
• Deliver reliable, performant, and cost-effective data platforms in production.

Conocimientos

SQL proficiency

Data modeling

Distributed systems

Educación

Bachelor’s degree in Computer Science or related field

Herramientas

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

Python

Shell

CI/CD

Infrastructure as Code

Descripción del empleo

Bright Vision Technologies seeks a Senior Data Engineer - Hadoop to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive data to support enterprise analytics, ML, and reporting workloads.

The role blends deep Hadoop expertise with strong software engineering to deliver reliable, scalable data platforms. The ideal candidate has 6+ years of experience, hands-on Spark, Hive, HDFS, and streaming tech, plus Python or