Remote Hadoop Platform Engineer - Scale & Performance

Dahl Consulting; United States; Remote; USD 113,000 - 165,000; Full time

Job summary

Dahl Consulting is seeking a Hadoop Platform Engineer for a remote, 6-month contract with a Fortune 100 retail technology organization. You will design, build, and optimize a large-scale Hadoop ecosystem, focusing on reliability, performance, and observability.

The role requires deep Hadoop, HDFS, Hive, Spark, Java, Linux, and automation skills, plus experience with Ansible and Chef. You will collaborate with data engineering and platform teams to keep the data platform secure and scalable.

Qualifications

• Bachelor's degree or equivalent practical experience.
• Experience supporting and administering enterprise Hadoop platforms.
• Hands-on Apache Hadoop stack experience.
• Experience with HDFS, Hive, Spark, YARN, and MapReduce.
• Proficiency in Java and Linux administration.
• Experience with Ansible and Chef for automation.
• Ability to diagnose and optimize Hadoop cluster performance.
• Knowledge of monitoring, observability, and alerting frameworks.
• Experience with infrastructure automation and runbooks.
• Strong communication and collaboration skills.

Responsibilities

• Design, build, and maintain a scalable Hadoop platform.
• Administer core Hadoop components and optimize performance.
• Troubleshoot cluster issues and perform root cause analysis.
• Develop and standardize monitoring and alerting frameworks.
• Automate operational tasks with scripting and automation tools.
• Collaborate with data engineering and infrastructure teams.
• Ensure security, governance, and compliance across the platform.

Skills

Apache Hadoop

HDFS

Hive

Spark

Java

Linux administration

Ansible

Chef

Monitoring & observability

Scripting (Python/Bash)

Education

Bachelor's degree in Computer Science or related field

Tools

Grafana

Python

Trino

Bash/Scala scripting

Job description

Dahl Consulting is seeking a Hadoop Platform Engineer for a remote, 6-month contract with a Fortune 100 retail technology organization. You will design, build, and optimize a large-scale Hadoop ecosystem, focusing on reliability, performance, and observability.

The role requires deep Hadoop, HDFS, Hive, Spark, Java, Linux, and automation skills, plus experience with Ansible and Chef. You will collaborate with data engineering and platform teams to keep the data platform secure and scalable.