Big Data Consultant

Lambdanets Services; Columbus (OH); On-site; USD 110,000 - 165,000; Full time

Job summary

Lambdanets Services in Columbus, OH is seeking a Senior Big Data Developer to design and implement scalable data pipelines and data warehouse structures for robust reporting.

The role requires 5+ years in big data, experience with Hadoop stack (HDFS, Hive, Pig), ETL, and distributed systems; you will collaborate across business units to improve data operability.

Qualifications

• Bachelor's degree or equivalent experience in computer systems.
• 5+ years of relevant work experience in Big data.
• Experience with Data Warehouse design and ETL.
• Experience with Hadoop Stack (HDFS, Pig, Hive) and multi-petabyte data environments.

Responsibilities

• Contribute at a senior level to data warehouse design and data preparation.
• Perform data transformations to populate a warehouse table structure optimized for reporting.
• Establish efficient design and programming patterns for engineers and non-technical stakeholders.
• Design, integrate and document components for data extraction and analysis on big data platform.
• Promote best practices in Big Data stack and train team members and business units.
• Collaborate with multiple groups daily to maintain big data stack operability.

Skills

Big data

Data warehousing

ETL processes

Distributed systems

Education

Bachelor's degree in computer science or related field

Tools

Hadoop

HDFS

Hive

Pig

Job description

Big Data Developer

Location: Columbus OH

Responsibilities

• Contribute at a senior-level to the data warehouse design and data preparation by implementing a solid, robust, extensible design that supports key business flows.
• Perform all of the necessary data transformations to populate data into a warehouse table structure that is optimized for reporting
• Establish efficient design and programming patterns for engineers as well as for non-technical individuals.
• Design, integrate and document technical components for seamless data extraction and analysis on big data platform.
• Ensure best practices to be adopted in Big Data stack and train team members and BUs.
• Work in a team environment, interact with multiple groups on a daily basis to maintain big data stack operability.

Requirements

• Baclelors degree in computer related field or equivalent experience in computer systems.
• 5+ years of relevant work experience in Big data
• Experience with Data Warehouse design, ETL.
• Experience in the Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, etc.)
• Experience working extensively in multi-petabyte data environment
• Experience in engineering large-scale distributed systems in a production environment