Senior Big Data Platform Lead - Remote (US)

Epsilon; Irving (TX); Remote; USD 139,000 - 182,000; Full time

Benefits offered by this job

Flexible time off

Paid holidays

Parental leave

Health coverage

401(k)

Tuition assistance

and more

Job summary

Epsilon in the United States is seeking a Lead Big Data Administrator to deploy and manage large-scale distributed systems, including Hadoop ecosystem and Kafka clusters. You will handle installation, configuration, maintenance, high-availability, disaster recovery, and data security, with automation via Bash, Python, and Ansible.

This role requires 8+ years of experience, deep knowledge of Kerberos, LDAP, SSL/TLS, Ranger, Atlas, and monitoring tools.

Qualifications

• 8+ years experience in Hadoop/Kafka ecosystems.
• Security tooling: Kerberos, LDAP, SSL/TLS, Ranger, Atlas.
• Monitoring with Prometheus and Grafana; strong scripting in Bash/Python/Ansible.

Responsibilities

• Deploy and manage large-scale distributed systems (HDFS, Yarn, Hive, Spark) and Kafka clusters.
• Installation, configuration, maintenance, high-availability and disaster recovery planning.
• Performance tuning, data pipeline orchestration, data security, troubleshooting, and automation.

Skills

Distributed systems

Data security

Scripting & automation

Tools

Hadoop

Kafka

Kerberos

LDAP

SSL/TLS

Ranger

Atlas

Prometheus

Grafana

Bash

Python

Ansible

Job description

Epsilon in the United States is seeking a Lead Big Data Administrator to deploy and manage large-scale distributed systems, including Hadoop ecosystem and Kafka clusters. You will handle installation, configuration, maintenance, high-availability, disaster recovery, and data security, with automation via Bash, Python, and Ansible.

This role requires 8+ years of experience, deep knowledge of Kerberos, LDAP, SSL/TLS, Ranger, Atlas, and monitoring tools.