Senior Hadoop Platform Engineer (Cloudera, Spark, Kafka)

Collabera Inc.; Plano, Northern (TX, KY); Hybrid; USD 90,000 - 96,000; Part time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) retirement plan

Life insurance

Long-term disability insurance

Short-term disability insurance

Paid parking/public transportation

Paid time off and holidays

Job summary

Collabera is hiring a Hadoop Engineer (SME) to manage enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML tooling. You will partner with development, infrastructure, and vendor teams to ensure robust platform administration, cluster management, and production support.

The role emphasizes automation, monitoring, and capacity planning, with a focus on delivering reliable data services in a scalable environment.

Qualifications

• Six plus years of relevant work experience.
• Strong Cloudera Hadoop administration experience.
• Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN).
• Linux/Unix administration and Python/Shell scripting.
• Experience with Kerberos/AD authentication.
• Monitoring, job scheduling, and automation (Ansible/Jenkins).
• Experience supporting enterprise Big Data production environments.

Responsibilities

• Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN).
• Manage upgrades, deployments, monitoring, performance tuning, and capacity planning.
• Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues.
• Support OpenShift, Docker, and Data Science platforms (Jupyter).
• Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.

Skills

Cloudera Hadoop

Spark

Kafka

YARN

Linux/Unix

Python

Shell scripting

Jenkins

Ansible

Tools

OpenShift

Docker

Python

Jenkins

Ansible

Kerberos

Job description

Collabera is hiring a Hadoop Engineer (SME) to manage enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML tooling. You will partner with development, infrastructure, and vendor teams to ensure robust platform administration, cluster management, and production support.

The role emphasizes automation, monitoring, and capacity planning, with a focus on delivering reliable data services in a scalable environment.