Sr Hadoop Developer

Jobsbridge; Columbia (SC); On-site; Full time

Job summary

A leading IT staffing organization in Columbia, SC, seeks a full-time professional with expertise in Hadoop and Big Data Analytics. The ideal candidate should have extensive experience in data modeling and building efficient ETL processes for analytics. Responsibilities include developing program specifications, assisting in quality assurance testing, and creating comprehensive documentation. Candidates should have a degree in a related field and a solid understanding of database development and data warehousing concepts. Experience in Agile environments is preferred.

Qualifications

• 3+ years of database development/data mining experience or equivalent technical work experience.
• Hands-on experience with Big Data Analytics platforms.
• Solid experience with RDBMS and ETL processes.

Responsibilities

• Develop scalable ETL processes for analytics data.
• Assist QA testing and develop system test data.
• Create program specifications, flowcharts, and user documentation.

Skills

Hadoop

Pig

Hive

ETL

Data Modeling

Python

Shell

SQL

Education

Bachelors/Masters degree in computer science/math/statistics

Job description

Jobs Bridge Inc is among the fastest growing IT staffing / professional services organization with its own job portal. Jobs Bridge works extremely closely with a large number of IT organizations in the most in-demand technology skill sets.

Job Description

Skill Hadoop, Pig, Hive , Map Reduce, ETL with data warehouse, BI

Location Columbia, SC

Total Experience 5 yrs.

Max Salary Not Mentioned

Employment Type Direct Jobs (Full Time)

Domain Any

Description

GC can apply

• Data Modeling: deep expertise with modeling databases for enterprise-grade solutions, ideally, analytics solutions.
• Coding: Build highly performant and scalable enterprise-grade ETL processes for populating analytics Hadoop and Oracle based data warehouses. Working in Agile teams on Linux development environments.
• Data setup: Bring together data and create views of data sets stored in the Hadoop-based big data platform using Hive, Pig, SQOOP and Oozie.
• Testing: Assist quality assurance testing teams. Where required, develop and conduct unit tests, develop system test data and perform system tests.
• Documentation: Develop program specifications and flowcharts, (dataflows, jobflows, etc.), for stand-alone products or systems. Prepare concise internal program documentation on product development and revisions. Prepare user guides and operational instruction manuals.
• Communication: Convey problems, solutions, updates and project status to peers, customers and management. Develop and maintain program, systems and user documentation.
• Planning: Prepare time estimates for assigned tasks. Attends post-implementation reviews.

Qualifications

• Bachelors/Masters degree in computer science/ math/ statistics or a related discipline preferred with 3+ years of database development/ data mining experience, OR demonstrated ability to meet job requirements through a comparable number of years of technical work experience.
• Excellent understanding of Big Data Analytics platforms; Hands-on experience with the following technologies: Hadoop, HBase, Pig, SQL
• Solid experience as an RDBMS developer, ideally on Oracle, with stored procedures, query performance tuning and ETL.
• Solid experience with scripting language such as Python, Shell
• Some experience of web development stacks, analytics, NoSQL data stores, data modeling, analytical tools and libraries
• Solid understanding of Data Warehousing concepts and technologies.
• Strong foundational knowledge and experience with distributed systems and computing systems in general
• Experience working in Agile teams.
• Experience in Healthcare will be big plus.