Lead Big Data Engineer – Hadoop & Cloud Onsite

Randstad; West New York (NJ); On-site; USD 130,000 - 170,000; Full time

Job summary

A technology staffing agency is seeking a Lead Engineer to administer and enhance a big data environment, specifically focusing on Hadoop and No-SQL technologies. The ideal candidate will have over ten years of experience in IT and at least three years in big data management, with proficiency in shell scripting and cloud architecture. You will collaborate with various teams and be responsible for implementing automation procedures, ensuring optimal performance, and advancing cloud solutions for database needs.

Qualifications

• 10+ years of IT/DBMS/Data Store experience.
• 3+ years in big data and data management.
• Experience with system administration and automation tasks.

Responsibilities

• Administer Hadoop infrastructure including installation and configuration.
• Resolve HDFS and Hadoop job issues.
• Design backup and disaster recovery solutions.

Skills

Big data management

Hadoop ecosystem administration

Data virtualization

Linux proficiency

Shell scripting

Cloud architecture knowledge

Education

Bachelor's degree in Computer Science or Information Systems

Tools

Hadoop

Apache Kafka

VMware

Docker

Job description

A technology staffing agency is seeking a Lead Engineer to administer and enhance a big data environment, specifically focusing on Hadoop and No-SQL technologies. The ideal candidate will have over ten years of experience in IT and at least three years in big data management, with proficiency in shell scripting and cloud architecture. You will collaborate with various teams and be responsible for implementing automation procedures, ensuring optimal performance, and advancing cloud solutions for database needs.