Senior Hadoop & Big Data Engineer (Remote)

Bright Vision Technologies; Farmington Hills (MI); On-site; USD 86,000 - 103,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive volumes of data to support enterprise analytics, machine learning, and reporting workloads.

The ideal candidate combines deep Hadoop expertise with strong software engineering fundamentals and a proven ability to deliver reliable, cost-efficient data platforms in production

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years designing and operating big-data pipelines on Hadoop.
• Strong hands-on Apache Spark in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase and broader Hadoop tools.
• Hands-on with streaming data platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills with relational and NoSQL stores.
• Experience with Airflow or Oozie for workflow orchestration.
• Solid understanding of distributed systems concepts; partitioning, replication, fault tolerance.
• Strong Python or Shell scripting; excellent troubleshooting and documentation.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems.
• Ingest, transform, and analyze massive volumes of structured and unstructured data to support analytics, ML, and reporting.
• Deliver reliable, performant, and cost-effective data platforms in production environments.

Skills

Big data design & development

SQL proficiency

Troubleshooting & debugging

Documentation skills

Python or Shell scripting

Education

Bachelor's degree in Computer Science or related

Tools

Apache Spark

Hive

HDFS

Sqoop

HBase

Kafka

Spark Streaming

Flink

Airflow

Oozie

CI/CD / IaC for data pipelines

Job description

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive volumes of data to support enterprise analytics, machine learning, and reporting workloads.

The ideal candidate combines deep Hadoop expertise with strong software engineering fundamentals and a proven ability to deliver reliable, cost-efficient data platforms in production