Senior Hadoop Architect

TecTammina; Pleasanton (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology company located in Pleasanton, California, is seeking a skilled Big Data Engineer with strong hands-on experience in Core Java, J2EE, and Hadoop. The ideal candidate will be responsible for managing analytics and overseeing talent management while bringing a strong business development focus. Candidates should have a minimum of 4 years of relevant experience, particularly in financial services or insurance sectors, and be able to effectively translate business needs into analytical solutions.

Qualifications

• Minimum 4+ years of experience in relevant industries.
• Experience with high-scale or distributed RDBMS is a plus.
• Knowledge of cloud computing infrastructure required.

Responsibilities

• Evaluate multiple architecture options critically.
• Translate business requirements into analytical requirements.
• Responsible for talent management and recruiting.

Skills

Core Java

J2EE

JDBC

Spring

Struts

Hibernate

Hadoop

SAS

SPSS

R

Mahout

BI tools

ETL tools

Open source software

Tools

Informatica

Talend

Microstrategy

Cognos

Pentaho

Job description

Must have technical competency

Strong hands‑on knowledge in Core Java, J2EE, JDBC, Spring, Struts, Hibernate, Hadoop.

Distributed File Systems

HDFS.

Hadoop Components

• Map Reduce
• Parallel Processing
• Stream Processing
• Flume
• Splunk

Analytical Tools

SAS, SPSS, R, Mahout.

BI Tools

Hands‑on experience with BI tools and reporting software e.g. Microstrategy, Cognos, Pentaho.

Hadoop Stack

Hands‑on experience with the Hadoop stack e.g. MapReduce, Sqoop, Pig, Hive, Hbase, Flume.

Open Source Platforms

Hands‑on experience with related/complementary open source software platforms and languages e.g. Java, Linux, Apache, Perl/Python/PHP, Chef.

ETL Tools

Hands‑on experience with ETL tools e.g. Informatica, Talend, Pentaho.

Additional Analytical Skills

Hands‑on experience with any 1 of analytical tools, languages, or libraries e.g. SAS, SPSS, R, Mahout.

Productionalizing Hadoop Applications

Hands‑on experience with productionalizing Hadoop applications e.g. administration, configuration management, monitoring, debugging, and performance tuning.

Other Skills

• Ability to critically evaluate multiple architecture options.
• Strong technical documentation skills.
• Should know how to translate business requirements into analytical requirements.

Required Skill Set

Strong business development focus with an opportunistic attitude.

Responsible for talent management and recruiting to grow, at the same time, infusing the right "analytics-driven" culture.

Knowledge in any one of the following

• Previous experience with high-scale or distributed RDBMS e.g. Teradata, Netezza, Greenplum, Aster Data, Vertica.
• Knowledge of cloud computing infrastructure e.g. Amazon Web Services EC2, Elastic MapReduce and considerations for scalable, distributed systems.
• Knowledge of NoSQL platforms e.g. key-value stores, graph databases, RDF triple stores.

Experience in applying Big Data technology to any of the following use cases will be a definite plus

• Unstructured Search
• Call Centre Analytics
• Social Media Analytics

Desired Hands‑on Experience

Minimum 4+ years and ideally 8+ years’ experience in industries, preferably insurance, banking, financial services, healthcare, or retail.

Qualifications

Additional Information