Hadoop & AWS Data Engineer — Spark, Hive, Airflow

Next Level Business Services, Inc.; Beaverton (OR); On-site; USD 90,000 - 120,000; Full time

Job summary

A growing IT staffing firm in Beaverton is seeking a Hadoop AWS Developer. The ideal candidate will have a solid background in Hadoop and Big Data, with experience in AWS data ingestion and transformations. Key responsibilities include working with various data technologies and tools within the AWS/Hadoop ecosystem. Candidates should have hands-on experience with Sqoop, Hive, and Spark. This position offers a chance to work on innovative projects within a supportive team environment.

Qualifications

• Minimum 2 years of experience with Hadoop and Big Data.
• At least 1 year experience with AWS data ingestion and transformations.
• Extensive experience with Sqoop, Hive, Spark (Scala or Python), Avro, Parquet.

Responsibilities

• Work on data ingestion and transformations using AWS.
• Utilize tools within the AWS/Hadoop ecosystem.

Skills

Hadoop and Big Data

AWS data ingestion and transformations

Sqoop

Hive

Spark (Scala or Python)

Avro

Parquet

EMR

Redshift

S3

Python scripting

Orchestration tools like Airflow

Snowflake

Job description

A growing IT staffing firm in Beaverton is seeking a Hadoop AWS Developer. The ideal candidate will have a solid background in Hadoop and Big Data, with experience in AWS data ingestion and transformations. Key responsibilities include working with various data technologies and tools within the AWS/Hadoop ecosystem. Candidates should have hands-on experience with Sqoop, Hive, and Spark. This position offers a chance to work on innovative projects within a supportive team environment.