Remote Senior Hadoop & Big Data Engineer

Bright Vision Technologies; South Windsor (CT); On-site; USD 100,000 - 150,000; Full time

Job summary

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer to design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems. In this role you will implement robust data ingestion, transformation, and analytics capabilities to support enterprise analytics and ML workloads.

The ideal candidate will bring deep Hadoop experience, strong software engineering fundamentals, and a track record delivering reliable, scalable data platforms in

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
• Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
• Hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
• Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
• Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
• Strong SQL skills and experience with relational and NoSQL data stores.
• Experience with workflow orchestration tools such as Airflow or Oozie.
• Strong scripting skills in Python or Shell.

Responsibilities

• Design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems.
• Ingest, transform, and analyze massive data volumes to support analytics and ML workloads.
• Deliver reliable, performant, and cost-efficient data platforms in production environments.
• Collaborate with teams to ensure scalable, production-ready data solutions.

Skills

Apache Spark

SQL

Python

Shell scripting

Spark Streaming / Flink

Airflow / Oozie

Distributed systems

Hadoop ecosystem

Education

Bachelor’s degree in Computer Science, Engineering, or related technical discipline

Tools

AWS EMR

Azure HDInsight

Databricks

Kubernetes

Infrastructure-as-code

Job description

Bright Vision Technologies is seeking an experienced Hadoop Big Data Developer to design, build, and operate large-scale data processing pipelines on Hadoop and related ecosystems. In this role you will implement robust data ingestion, transformation, and analytics capabilities to support enterprise analytics and ML workloads.

The ideal candidate will bring deep Hadoop experience, strong software engineering fundamentals, and a track record delivering reliable, scalable data platforms in