Sr.Hadoop Developer

Bridge Technologies and Solutions; Beaverton (OR); On-site; USD 100,000 - 130,000; Full time

Job summary

Bridge Technologies and Solutions, located in Beaverton, Oregon, is seeking a Sr. Hadoop Developer to join their team on big data initiatives in Consumer Digital. This role involves designing and implementing map reduce jobs, building libraries around Hadoop, and resolving operational issues.

The ideal candidate will have a minimum of 6 years of experience in large-scale software development and at least 1 year of hands-on experience with Hadoop. Strong programming skills in Java, Python, and SQL are essential for success in this position.

Qualifications

• Minimum 6 years’ experience in large-scale software development.
• 1+ year experience in Hadoop required.
• Strong understanding of Hadoop internals.

Responsibilities

• Design and implement map reduce jobs for distributed processing.
• Build libraries and frameworks around Hadoop.
• Research and utilize new technologies around Hadoop eco system.

Skills

Java programming

Python

Hadoop

MapReduce

Hive

Pig

SQL

Shell scripting

Maven

Data warehousing

Education

MS/BS in Computer Science or related discipline

Tools

Hadoop ecosystem

Oracle

Job description

Typically requires a Bachelors Degree and minimum of 5 years directly relevant work experience.

Client is embarking on the big data platform in Consumer Digital using Hadoop Distributed File System cluster. As a Sr. Hadoop developer you will work with a variety of talented client team mates and be a driving force for building solutions. You will be working on development projects related to commerce and web analytics.

Responsibilities

• Design and implement map reduce jobs to support distributed processing using java, cascading, python, hive and pig; Ability to design and implement end to end solution.
• Build libraries, user defined functions, and frameworks around Hadoop
• Research, evaluate and utilize new technologies/tools/frameworks around Hadoop eco system
• Develop user defined functions to provide custom hive and pig capabilities
• Define and build data acquisitions and consumption strategies
• Define & develop best practices
• Work with support teams in resolving operational & performance issues
• Work with architecture/engineering leads and other teams on capacity planning

Qualifications

• MS/BS degree in a computer science field or related discipline
• 6+ years’ experience in large-scale software development
• 1+ year experience in Hadoop
• Strong Java programming, shell scripting, Python, and SQL
• Strong development skills around Hadoop, MapReduce, Hive, Pig, Impala
• Strong understanding of Hadoop internals
• Good understanding of AVRO and Json and other compression
• Experience with build tools such as Maven
• Experience with databases like Oracle
• Experience with performance/scalability tuning, algorithms and computational complexity
• Experience (at least familiarity) with data warehousing, dimensional modeling and ETL development
• Ability to understand and ERDs and relational database schemas
• Proven ability to work cross functional teams to deliver appropriate resolution

Nice to have

• Experience with open source NOSQL technologies such as HBase and Cassandra
• Experience with messaging & complex event processing systems such as Kafka and Storm
• Machine learning framework
• Statistical analysis with Python, R or similar

Additional Information

All your information will be kept confidential according to EEO guidelines.