Senior Hadoop & Big Data Engineer (Remote)

Bright Vision Technologies; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer for a 100% remote role in the U.S. Full-time Direct W2. Salary range $100,000–$150,000 annually. 10+ years of experience required.

The ideal candidate will design, build, and operate large-scale data pipelines on Hadoop ecosystems, ingesting, transforming, and analyzing massive data sets for analytics and reporting workloads.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related technical discipline.
• Ten+ years designing and operating big-data pipelines on Hadoop.
• Strong hands-on experience with Apache Spark (Scala, Python, or Java).
• Solid experience with Hive, HDFS, Sqoop, HBase, and Hadoop ecosystem.
• Hands-on with streaming platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills with relational and NoSQL data stores.
• Experience with Airflow or Oozie.
• Understanding of distributed systems incl. partitioning, replication, fault tolerance.
• Strong Python or Shell scripting.
• Excellent troubleshooting, debugging, and documentation skills.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop.
• Ingest, transform, and analyze massive structured and unstructured data.
• Deliver reliable, performant, and cost-effective data platforms in production.

Skills

Big Data pipelines

Spark

Hive/HDFS

Kafka

SQL

Airflow/Oozie

Python/Shell

Distributed systems

Cloud platforms

CI/CD

Education

Bachelor’s degree

Tools

Hadoop ecosystem

Job description

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer for a 100% remote role in the U.S. Full-time Direct W2. Salary range $100,000–$150,000 annually. 10+ years of experience required.

The ideal candidate will design, build, and operate large-scale data pipelines on Hadoop ecosystems, ingesting, transforming, and analyzing massive data sets for analytics and reporting workloads.