BigData Consultant

Jobsbridge; Santa Ana (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading IT staffing firm in California is seeking a skilled Big Data professional with over 7 years of experience in Enterprise Data Warehouse and Business Intelligence environments. Responsibilities include overseeing BigData/data warehouse maintenance and ensuring the timely resolution of data processing issues. The ideal candidate will have expertise in Hadoop and Talend, with a strong background in data integration and real-time ingestion. This role is crucial for maintaining the health and performance of critical data applications.

Qualifications

• 7+ years of technical experience in Enterprise Data Warehouse and Business Intelligence environments.
• 3+ years developing and supporting data integration in Hadoop with more than 10 clusters.
• Advanced experience with real-time data ingestion using Talend.

Responsibilities

• Responsible for BigData/data warehouse maintenance and monitoring.
• Lead identification and troubleshooting of processing issues.
• Ensure adherence to established problem and incident management processes.

Skills

Data analysis

Hadoop

Talend

Python

Spark

Kafka

Tools

Hortonworks

Cloudera

Teradata

HBase

Job description

Jobsbridge, Inc. is a fast growing Silicon Valley based I.T staffing and professional services company specializing in Web, Cloud & Mobility staffing solutions.

Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all.

Job Description

Responsible for BigData (1.3) / data warehouse Maintenance, Clean up, monitoring with heavy loads. Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the data warehouse or delivery of critical reporting within established SLAs. Identifies and recommends improvements in production applicationsolutions or operational processes in support of data warehouse applications and business intelligence reporting (ie, data quality, performance, static and dynamic reports, etc.) Focuses on the overall stability and availability of the BigDataapplications and the associated interfaces, data transport protocols Researches, manages and coordinates resolution of complex issues through root cause analysis as appropriate. Ensure adherence to established problem / incident management, change management and other internal IT processes Ensures 3rd party vendors engaged in projects deliver on their responsibilities and conform to Gap’s established standards Ensures comprehensive knowledge transition from development teams on new or modified applications moving to ongoing production support Seeks improvement opportunities in design, solution implementation approaches in partnership with Architects and Operations tteam for ensuring the performance and health of the BigData and other EDW Applications Participates in production migrations and upgrades, develops processes for sustaining the BigData, EDW & BI environment and ensures implementation of the same Ensures timely and accurate escalation of issues to management Technical Skills 7 + years of technical experience in Enterprise Data Warehouse and Business Intelligence environments 3+ years developing and supporting data integration in Hadoop (1.3) with more than 10 clusters is must. 2-3 years developing or supporting applications using Talend, Pig, Hive, Python, Spark, Hbase and Pig. Advanced experience with real-time data ingestion (Kafka,MQ etc)and ingestion using Talend into Hortonworks or Cloudera environment is aplus. Possess a strong technology, data, and bigdata/data warehouse application design background Experience with various databases, Teradata, HBase is preferred. Extensive experience with production batch scheduling and monitoring (CAWA, Oozie etc)

Qualifications