Hadoop Developer

North Star Staffing Solutions, Inc.; New York (NY); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading staffing firm is seeking a Hadoop Developer for a prominent financial services client in New York. The role involves developing scalable ELT/ETL workflows and managing large volumes of data. The ideal candidate will have strong experience with Hadoop and ETL tools. A BS in Computer Science or equivalent is required, with preference given to candidates with an MS or PhD. Excellent communication and problem-solving skills are crucial for this position.

Qualifications

• Experience developing and refining data engineering solutions for large datasets.
• Professional experience with Hadoop and related technologies.
• Data Warehouse experience with Teradata and Oracle.

Responsibilities

• Develop scalable ELT/ETL workflows for data integration.
• Advise business analysts on using structured and unstructured data.

Skills

ETL Development

Hadoop

Map/Reduce

Pig/Hive/Impala

Data Warehousing

Data Structures

Algorithms

Problem Solving

Education

BS in Computer Science or equivalent

MS or PhD in Computer Science

Job description

As part of the product development team and reporting into the head of engineering, Hadoop Developers will help develop scalable ELT/ETL workflows to transform and integrate data into structures conducive for reporting and analytics on top of Teradata warehouses for one of the largest globaly financial services companies. You will design and implement dimensional data models that scale across multiple data warehouses that will feed into Hadoop to replicate data from the Teradata databases. Using tools such as Sqoop, Impala, or Teradata ETL you will load huge volumes of data from Teradata into Hadoop cluster. You will then use Map/Reduce, Hive, Pig to process/analyze it and export aggregates back into Teradata for reporting.

Responsibilities

• We are looking for seasoned developers who thrive in a start-up environment. Qualified candidates are seasoned ETL and Tools developers who are accustomed to working across large independent databases and massive amounts of data.
• The Tools / ETL Developer will function as a data expert to advise business analysts in the usage of structured and unstructured data.

Requirements

• Experience developing, implementing, and refining data engineering solutions for huge volumes of data.
• Professional experience with Hadoop, Map/Reduce, Pig/Hive/Impala, Sqoop etc.
• Data Warehouse experience with Teradata, Oracle etc.
• Experience designing and implementing dimensional data models that scale across an enterprise business.
• Experience building scalable ELT/ETL workflows to transform and integrate data into structures conducive for reporting and analytics in Hadoop.
• Familiarity and experience in different phases of software development life cycle.
• Good understanding of algorithms, data structures, performance optimization techniques, and object-oriented programming.
• Excellent communication, interpersonal, and problem-solving skills.
• BS in Computer Science or equivalent.

Qualifications

• MS or PhD in Computer Science.
• Professional experience of ETL.

Additional Information

All your information will be kept confidential according to EEO guidelines.

If you meet the requirements of this unique opportunity, we encourage you to explore how you can make a difference by applying now. Simply contact Robin Akin by sending an attached Word version of your most recent resume to get started.