Sr Hadoop Big Data engineer (Remote)

Cubetech Solutions LLC; Oregon; Hybrid; USD 140,000 - 180,000; Full time

Job summary

Cubetech Solutions LLC is seeking a Sr Hadoop Big Data Engineer for a remote role. The candidate will work on the Hadoop ecosystem, including Hive, HDFS, Spark, Kafka, and related components, with a strong focus on PySpark and Python development.

Ideal candidates have extensive SQL skills, experience with Hive/Impala, and hands-on experience with AWS Lambda and EMR data pipelines. This role is fully remote and requires deep data engineering expertise.

Qualifications

• Must have 10+ years of development and hands-on coding experience.
• Experience with Hadoop ecosystem components (Hive, HDFS, Spark, Kafka, etc.)
• Strong PySpark and Python development experience
• Proficient in Hive and Impala queries
• Ability to write complex SQL queries
• Experience with AWS Lambda, EMR, clusters, partitions and data pipelines

Skills

Hadoop

PySpark

Python

SQL

Hive

Impala

Spark

Kafka

Scala

AWS Lambda

AWS EMR

Data pipelines

Kinesis

Job description

About the job Sr Hadoop Big Data engineer (Remote)

Required Skills:

• Experience in Hadoop ecosystem components: HIVE,Pyspark, HDFS, SPARK, Scala, Streaming,(kinesis, Kafka)
• Strong experience in PySpark, Phython development
• Proficient with writing Hive and Impala Queries
• Ability to write complex SQL queries
• Experience with AWS Lambda, EMR, Clusters, Partitions, Data pipelines Must have 10+ years developmentand hands on coding experience