Senior Hadoop & Spark Big Data Engineer (Remote)

Bright Vision Technologies

Monroe Township (NJ)

Remote

USD 100.000 - 150.000

Vollzeit

Vor 5 Tagen

Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

We are seeking an experienced Hadoop Big Data Developer to design, build, and operate large-scale data processing pipelines on Hadoop and related big‑data ecosystems.

Qualifikationen

Bachelor’s degree in Computer Science or related field.
10+ years designing and operating big-data pipelines on Hadoop.
Strong hands-on Spark (Scala/Python/Java) in production.
Experience with Hive, HDFS, Sqoop, HBase.
Knowledge of Kafka, Spark Streaming, or Flink.
SQL skills with relational and NoSQL stores.
Experience with Airflow or Oozie.
Understanding of distributed systems concepts.
Python or Shell scripting skills.
Troubleshooting and documentation abilities.

Aufgaben

Design, build, and operate large-scale data pipelines.
Ingest, transform, and analyze massive data volumes.
Support enterprise analytics, ML, and reporting workloads.
Deliver reliable, performant, cost-effective data platforms.

Kenntnisse

Spark

SQL

Python

Shell

Hadoop

NoSQL

Kafka

Airflow

Oozie

Kubernetes

Ausbildung

Bachelor’s degree in Computer Science/Engineering

Tools

AWS EMR

Azure HDInsight

Databricks

Hive

HDFS