Big Data

SmartRecruiters, Inc.; Durham (NC); On-site; USD 110,000 - 165,000; Full time

Job summary

Sonsoft, Inc. is a USA-based company seeking a senior data engineering expert with 7+ years of IT experience. The role focuses on HDFS architecture, YARN, ZooKeeper, and MapReduce, plus hands-on Hive, Sqoop, Spark, and data warehousing concepts. Experience with Oozie workflows and Cloudera distribution is a plus.

The candidate should be proficient in Java, Python, and Perl, and able to work in a fast-growing IT services environment in the United States.

Qualifications

• At least 7+ years of overall experience.
• HDFS architecture and understanding of nodes, YARN, ZooKeeper, and MapReduce.
• Hands-on Hive including queries, UDF, and file formats ORC, AVRO, Parquet.
• Hands-on Sqoop and Spark experience.

Skills

HDFS

YARN

ZooKeeper

MapReduce

Hive

Hive UDF

Parquet

ORC

Avro

Sqoop

Spark

Oozie

Cloudera

Flume

Kafka

Java

Python

Perl

Education

Bachelor's degree or foreign equivalent

4+ years IT experience

Tools

Oozie

Hadoop

Cloudera

Job description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

• At least 7+ years of overall experience
• HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
• Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
• Hand on experience in developing Sqoop, Spark.
• Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
• Hand on experience in developing Oozie workflow definition and execution
• Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
• Knowledge of Flume, Kafka is a plus
• Hand on experience in programming languages like Java, Python, Perl.

Qualifications

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 4 years of experience within the Information Technologies.

Additional Information

**U.S. citizens and those authorized to work in the U.S. are encouraged to apply**. We are unable to sponsor at this time.

Note:-

• This is a Full-Time Permanentjob opportunity for you.
• Only US Citizen, Green Card Holder, GC-EAD,H4-EAD & L2-EAD can apply.
• No OPT-EAD, TN Visa & H1B Consultants please.
  
• Please mention yourVisa Statusin youremailorresume.