Lead, Big Data Administrator

Epsilon; Irving (TX); Remote; USD 139,000 - 182,000; Full time

Benefits offered by this job

Flexible time off

Paid holidays

Parental leave

Health coverage

401(k)

Tuition assistance

and more

Job summary

Epsilon in the United States is seeking a Lead Big Data Administrator to deploy and manage large-scale distributed systems, including Hadoop ecosystem and Kafka clusters. You will handle installation, configuration, maintenance, high-availability, disaster recovery, and data security, with automation via Bash, Python, and Ansible.

This role requires 8+ years of experience, deep knowledge of Kerberos, LDAP, SSL/TLS, Ranger, Atlas, and monitoring tools.

Qualifications

• 8+ years experience in Hadoop/Kafka ecosystems.
• Security tooling: Kerberos, LDAP, SSL/TLS, Ranger, Atlas.
• Monitoring with Prometheus and Grafana; strong scripting in Bash/Python/Ansible.

Responsibilities

• Deploy and manage large-scale distributed systems (HDFS, Yarn, Hive, Spark) and Kafka clusters.
• Installation, configuration, maintenance, high-availability and disaster recovery planning.
• Performance tuning, data pipeline orchestration, data security, troubleshooting, and automation.

Skills

Distributed systems

Data security

Scripting & automation

Tools

Hadoop

Kafka

Kerberos

LDAP

SSL/TLS

Ranger

Atlas

Prometheus

Grafana

Bash

Python

Ansible

Job description

Lead Big Data Administrator responsible for deploying and managing large-scale distributed systems, including Hadoop ecosystem (HDFS, Yarn, Hive, Spark) and Kafka clusters. Duties include installation, configuration, maintenance, high-availability and disaster recovery strategies, performance tuning, data pipeline orchestration, data security, troubleshooting, and automation using Bash, Python, and Ansible. Requires 8+ years experience, proficiency with Hadoop and Kafka components, security tools (Kerberos, LDAP, SSL/TLS, Ranger, Atlas), monitoring tools (Prometheus, Grafana), and scripting skills. Remote work available within the US. Salary range $138,715 - $182,000 annually. Benefits include flexible time off, paid holidays, parental leave, health coverage, 401(k), tuition assistance, and more.

• installation
• configuration
• maintenance
• high-availability and disaster recovery strategies
• performance tuning
• data pipeline orchestration
• data security
• troubleshooting
• automation using Bash, Python, and Ansible

• flexible time off
• paid holidays
• parental leave
• health coverage
• 401(k)
• tuition assistance
• and more