Senior Big Data Developer - Hadoop, Spark & Pipelines

Jobsbridge; Glendale (CA); On-site; USD 110,000 - 150,000; Full time

Job summary

A leading IT staffing organization is seeking a Big Data Developer to manage existing data extraction jobs and build new data pipelines. The ideal candidate must have 5+ years of Java Enterprise experience and 2+ years of hands-on work with Hadoop technologies. Responsibilities include delivering Business Intelligence efforts, working with various data models, and ensuring effective data security. This position requires exceptional communication skills and the ability to work independently in a fast-paced environment.

Qualifications

• At least 5 years of hands-on experience in Java Enterprise ecosystem.
• At least 2 years of hands-on experience with Hadoop/Hive/MapReduce/Pig/Sqoop/Flume.
• Ability to segment and organize data from disparate sources.
• Experience working with Hadoop/HBase/Hive/MRV1/MRV2.
• Deep understanding of SQL, XML, JSON, and UNIX.
• Experience in designing and supporting RESTful Web Services.
• Excellent communication skills for technical issues.

Responsibilities

• Deliver Business Intelligence efforts as a Big Data Developer.
• Manage existing data extraction jobs and build new data pipelines.
• Work with heterogeneous data models, mapping and transformation.
• Collaborate effectively with team members.

Skills

Java Enterprise ecosystem

Hadoop/Hive/MapReduce/Pig/Sqoop/Flume

SQL

XML

JSON

UNIX

Apache Spark

Kafka

RESTful Web Services

Data Governance

Education

Bachelor's degree or equivalent

Tools

IBM CDC

IBM Watson Explorer

Apache Solr

Job description

A leading IT staffing organization is seeking a Big Data Developer to manage existing data extraction jobs and build new data pipelines. The ideal candidate must have 5+ years of Java Enterprise experience and 2+ years of hands-on work with Hadoop technologies. Responsibilities include delivering Business Intelligence efforts, working with various data models, and ensuring effective data security. This position requires exceptional communication skills and the ability to work independently in a fast-paced environment.