Big Data Architect

TestingXperts; Hillsboro (OR); On-site; USD 90,000 - 140,000; Full time

Job summary

Testing Xperts in Hillsboro, OR is seeking a hands-on Big Data Engineer to build and maintain data ingestion pipelines in Hadoop ecosystems. You will validate and enrich large datasets, then distribute data to SQL and downstream applications.

The ideal candidate has 2+ years in the Big Data stack (HDFS, MapReduce, Hive, HBase, Sqoop) and strong Python/Spark skills. Degree in a related field expected.

Qualifications

• Experience with Python and Spark in production environments.
• Hands-on experience with Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, Sqoop).
• Ability to design and implement large-scale data ingestion pipelines.

Responsibilities

• Build and maintain data ingestion pipelines into Hadoop ecosystems.
• Validate, enrich, and distribute large data sets to SQL and other applications.

Skills

Python

Spark

Map Reduce

Hive

Pig

HBase

Sqoop

Education

Graduate

Job description

Greetings for the day! My name is Suneetha from Testing Xperts, we are a global staffing, consulting and technology solutions company, offering industry-specific solutions to our fortune 500 clients and worldwide corporations.

Job Description

Location: Hillsboro, OR

Duration: 6+ Months

Job Description:

• Skills Python, Spark, Map Reduce, Hive, Pig, HBase, Sqoop Hands on experience in Python Spark.
• At least 2 years Hands on experience in the Big Data ecosystem HDFS, Map Reduce, Hive, HBase, etc.
• Experience working on large data sets Working experience with large scale Hadoop environments.
• Build and support design for ingesting large data sets into Hadoop ecosystems, validating enriching the data, and distributing significant amounts of that data to SQL and to other applications.

Qualifications

Graduate

Additional Information

All your information will be kept confidential according to EEO guidelines.