Big Data Architect: Spark, Hadoop & Python Expert

TestingXperts; Hillsboro (OR); On-site; USD 90,000 - 140,000; Full time

Job summary

Testing Xperts in Hillsboro, OR is seeking a hands-on Big Data Engineer to build and maintain data ingestion pipelines in Hadoop ecosystems. You will validate and enrich large datasets, then distribute data to SQL and downstream applications.

The ideal candidate has 2+ years in the Big Data stack (HDFS, MapReduce, Hive, HBase, Sqoop) and strong Python/Spark skills. Degree in a related field expected.

Qualifications

• Experience with Python and Spark in production environments.
• Hands-on experience with Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, Sqoop).
• Ability to design and implement large-scale data ingestion pipelines.

Responsibilities

• Build and maintain data ingestion pipelines into Hadoop ecosystems.
• Validate, enrich, and distribute large data sets to SQL and other applications.

Skills

Python

Spark

Map Reduce

Hive

Pig

HBase

Sqoop

Education

Graduate

Job description

Testing Xperts in Hillsboro, OR is seeking a hands-on Big Data Engineer to build and maintain data ingestion pipelines in Hadoop ecosystems. You will validate and enrich large datasets, then distribute data to SQL and downstream applications.

The ideal candidate has 2+ years in the Big Data stack (HDFS, MapReduce, Hive, HBase, Sqoop) and strong Python/Spark skills. Degree in a related field expected.