Big Data ( USC & GC )

SmartRecruiters, Inc.; Durham (NC); On-site; USD 110,000 - 170,000; Full time

Job summary

Sonsoft , Inc. is seeking a senior data/ETL engineer with 7+ years of experience in big data environments including HDFS, Hive, Spark, and Oozie. Hands-on expertise with MapReduce, Sqoop and Cloudera distribution is required.

Candidates should be proficient in Java, Python, and Perl and understand warehousing concepts like de-duplication, cleansing, lookups and data transformation. U.S. work eligibility is required; sponsorship is not provided.

Qualifications

• 7+ years of overall IT experience.
• Hands-on with HDFS architecture and concepts: YARN, ZooKeeper, MapReduce.
• Hands-on with Hive: queries, UDFs, ORC/AVRO/Parquet formats.
• Hands-on with Sqoop and Spark.
• Experience with warehousing concepts: de-duplication, cleansing, lookups, transformation, data versioning.
• Hands-on with Oozie workflow definitions.
• Knowledge of Cloudera distribution; monitoring/operational capabilities.
• Knowledge of Flume and Kafka (plus).
• Proficiency in Java, Python, and Perl.

Skills

7+ years experience

Java/Python/Perl

Education

Bachelor’s degree or foreign equivalent

Three years of progressive experience in lieu of education

Tools

HDFS

YARN

ZooKeeper

MapReduce

Hive

UDFs

ORC/AVRO/Parquet

Sqoop

Spark

Oozie

Cloudera

Flume

Kafka

Job description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

• At least 7+ years of overall experience
• HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
• Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
• Hand on experience in developing Sqoop, Spark.
• Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
• Hand on experience in developing Oozie workflow definition and execution
• Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
• Knowledge of Flume, Kafka is a plus
• Hand on experience in programming languages like Java, Python, Perl.

Qualifications

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 4 years of experience within the Information Technologies.

Additional Information

** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
Note:-
1.This is a Full-Time & Permanent jobopportunity for you.
2.Only US Citizen Green Card Holder GC-EAD,& TN can apply.
3. No H4-EAD L2-EAD OPT-EAD, H1B candidates please.
4.Please mention your Visa Status in your email or resume.

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply