Hadoop Platform Engineer

Dahl Consulting; Minneapolis (MN); Hybrid; USD 113,000 - 165,000; Full time

Benefits offered by this job

Benefits package

Job summary

Dahl Consulting is seeking a Hadoop Platform Engineer for a remote, 6-month contract. The role requires deep Hadoop expertise, strong Linux administration, and automation acumen to support enterprise analytics workloads.

You will design, optimize, and support a large-scale Hadoop ecosystem, collaborating with data engineering and infrastructure teams to ensure reliability, performance, and observability across the platform.

Qualifications

• Bachelor's degree or equivalent practical experience.
• Experience supporting and administering enterprise Hadoop platforms.
• Strong hands-on experience with Hadoop, HDFS, Hive, Spark, Java and Linux administration.

Responsibilities

• Design, build, and maintain a reliable, scalable Hadoop platform.
• Administer and optimize HDFS, Hive, Spark, YARN, and MapReduce.
• Develop monitoring, observability, and health frameworks.
• Automate operational processes and infrastructure tasks.
• Support data security, governance, and compliance across the Hadoop ecosystem.

Skills

Hadoop stack

Linux administration

Root cause analysis

Scripting

Collaboration

Communication

Education

Bachelor's degree in CS/IT/Engineering or equivalent

Tools

Ansible

Chef

Grafana

Python

Bash

Scala

Trino

Job description

Title: Hadoop Platform Engineer

Location: Remote

Job Type: Contract (6 months)

Compensation: $82.00 - $120.00 per hour (W2)

Industry: Retail

About the Role

Our staffing firm is partnering with a leading Fortune 100 retail and consumer technology organization to identify an experienced Hadoop Platform Engineer. This company operates at enterprise scale, supporting large volumes of data that drive critical business, analytics, and customer-focused initiatives. We are seeking a highly skilled engineer to design, optimize, and support a large-scale Hadoop ecosystem. The ideal candidate will combine deep technical expertise across the Apache Hadoop stack with strong Linux and automation experience to ensure platform reliability, performance, scalability, and observability. This role offers the opportunity to work on a mission-critical data platform supporting enterprise analytics and data processing workloads while collaborating closely with data engineering, infrastructure, and platform teams.

Responsibilities

• Design, build, and maintain a reliable, scalable, and high-performing Hadoop platform.
• Administer and optimize core Hadoop ecosystem components, including HDFS, Hive, Spark, YARN, and MapReduce.
• Troubleshoot and resolve cluster-level performance issues through deep analysis of Hadoop and Java-based systems.
• Develop and standardize monitoring, observability, and platform health frameworks.
• Implement proactive monitoring, automated health checks, and alerting capabilities to identify and resolve issues before they affect end users.
• Analyze and optimize Linux-based infrastructure to improve performance, resource utilization, and platform stability.
• Collaborate with data engineering, platform, and infrastructure teams to improve workload efficiency and cluster performance.
• Establish best practices for platform management, capacity planning, performance tuning, and upgrade strategies.
• Automate operational processes and reduce manual effort through scripting and infrastructure automation.
• Support data security, governance, and compliance requirements across the Hadoop ecosystem.
• Drive root cause analysis efforts for production incidents and implement preventative solutions.
• Create and maintain operational documentation, configuration standards, and support runbooks.
• Manage large-scale environments using configuration management and automation tools.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.
• Professional experience supporting and administering enterprise Hadoop platforms.
• Strong hands-on experience with:
• Apache Hadoop
• Hadoop Distributed File System (HDFS)
• Apache Hive
• Apache Spark
• Java
• Linux administration
• Ansible
• Chef
• Experience diagnosing and optimizing Hadoop cluster performance.
• Knowledge of monitoring, observability, and alerting frameworks.
• Experience managing large-scale distributed systems and data platforms.
• Strong troubleshooting and root cause analysis skills.
• Experience with infrastructure automation and operational process improvement.
• Ability to collaborate effectively across engineering and infrastructure teams.
• Strong written and verbal communication skills.

Preferred Qualifications

• Experience with Grafana for monitoring and visualization.
• Experience developing automation or tooling using Python.
• Experience with Trino and distributed query engines.
• Experience with Bash or Scala scripting.
• Experience supporting enterprise-scale analytics and data engineering environments.
• Knowledge of data governance, security, and compliance practices within big data ecosystems.
• Experience with capacity planning and platform modernization initiatives.

Benefits

Benefits Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/.

Equal Opportunity Statement

Equal Opportunity Statement As an equal opportunity employer, Dahl Consulting welcomes candidates of all backgrounds and experiences to apply.