Hadoop Engineer

Collabera; Plano (TX); Hybrid; USD 8,954,000 - 9,643,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) retirement plan

Life insurance

Long-term disability insurance

Paid parking/public transportation

Paid time off and holidays

Job summary

Collabera is seeking a Hadoop Engineer to support enterprise Big Data platforms in a hybrid Plano, TX environment. The role focuses on Cloudera Hadoop, Spark, Kafka, and related tech with OpenShift, Docker, and AI/ML tooling support.

The engineer will administer Hadoop clusters, perform upgrades, monitor performance, and automate tasks via Ansible, Jenkins, Python, and shell scripts, ensuring smooth production operations for a banking client.

Qualifications

• Six plus years of relevant work experience.
• Strong Cloudera Hadoop administration experience.
• Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN).
• Linux/Unix administration and Python/Shell scripting.

Responsibilities

• Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN).
• Manage upgrades, deployments, monitoring, performance tuning, and capacity planning.
• Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues.
• Support OpenShift, Docker, and Data Science platforms (Jupyter).
• Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.

Skills

Hadoop administration

Linux/Unix

Python scripting

Shell scripting

Kerberos/AD authentication

Automation (Ansible/Jenkins)

Monitoring and scheduling

Tools

OpenShift

Docker

Kubernetes

Jenkins

Ansible

Job description

About the Role

We are Seeking a Hadoop Engineer (SME) to support enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML technologies. This role is responsible for platform administration, cluster management, automation, monitoring, and production support while partnering with development, infrastructure, and vendor teams.

Job Title: Hadoop Engineer

Location: Plano TX; Charlotte, NC
Work Arrangement: Hybrid
Client Industry: Banking
Duration: 12 Months Contract

Day-to-Day

• Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN).
• Manage upgrades, deployments, monitoring, performance tuning, and capacity planning.
• Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues.
• Support OpenShift, Docker, and Data Science platforms (Jupyter).
• Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.

Must-Haves

• Six plus years of relevant work experience. Strong Cloudera Hadoop administration experience.
• Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN).
• Linux/Unix administration and Python/Shell scripting.
• Experience with Kerberos/AD authentication.
• Monitoring, job scheduling, and automation (Ansible/Jenkins).
• Experience supporting enterprise Big Data production environments.

Plusses

• Databricks, Snowflake, Talend, ELK, or AI/ML platforms.
• OpenShift, Docker, or Kubernetes experience.
• Java and SQL/Oracle experience.
• Cloudera or Cloud certifications.

Hourly Rate: 65$-70$ per hour
This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications.

Benefits:

The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

About Us

At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.