Hadoop Engineer

Collabera Inc.; Plano, Northern (TX, KY); Hybrid; USD 90,000 - 96,000; Part time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) retirement plan

Life insurance

Long-term disability insurance

Short-term disability insurance

Paid parking/public transportation

Paid time off and holidays

Job summary

Collabera is hiring a Hadoop Engineer (SME) to manage enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML tooling. You will partner with development, infrastructure, and vendor teams to ensure robust platform administration, cluster management, and production support.

The role emphasizes automation, monitoring, and capacity planning, with a focus on delivering reliable data services in a scalable environment.

Qualifications

• Six plus years of relevant work experience.
• Strong Cloudera Hadoop administration experience.
• Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN).
• Linux/Unix administration and Python/Shell scripting.
• Experience with Kerberos/AD authentication.
• Monitoring, job scheduling, and automation (Ansible/Jenkins).
• Experience supporting enterprise Big Data production environments.

Responsibilities

• Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN).
• Manage upgrades, deployments, monitoring, performance tuning, and capacity planning.
• Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues.
• Support OpenShift, Docker, and Data Science platforms (Jupyter).
• Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.

Skills

Cloudera Hadoop

Spark

Kafka

YARN

Linux/Unix

Python

Shell scripting

Jenkins

Ansible

Tools

OpenShift

Docker

Python

Jenkins

Ansible

Kerberos

Job description

About the Role

We are Seeking a Hadoop Engineer (SME) to support enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML technologies. This role is responsible for platform administration, cluster management, automation, monitoring, and production support while partnering with development, infrastructure, and vendor teams.

Day-to-Day

• Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN).
• Manage upgrades, deployments, monitoring, performance tuning, and capacity planning.
• Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues.
• Support OpenShift, Docker, and Data Science platforms (Jupyter).
• Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.

Must-Haves

• Six plus years of relevant work experience. Strong Cloudera Hadoop administration experience.
• Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN).
• Linux/Unix administration and Python/Shell scripting.
• Experience with Kerberos/AD authentication.
• Monitoring, job scheduling, and automation (Ansible/Jenkins).
• Experience supporting enterprise Big Data production environments.

Plusses

• Databricks, Snowflake, Talend, ELK, or AI/ML platforms.
• Java and SQL/Oracle experience.
• Cloudera or Cloud certifications.

Hourly Rate:65$-70$ per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.

The Company offers the following benefits for this position, subject to applicable eligibility requirements:

• medical insurance
• dental insurance
• vision insurance
• 401(k) retirement plan
• life insurance
• long-term disability insurance
• short-term disability insurance
• paid parking/public transportation
• (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

About Us

At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.