Senior Hadoop Platform Architect

Spectrum; Greenwood Village (CO); Presencial; USD 111.000 - 196.000; Jornada completa

Descripción de la vacante

Spectrum is seeking a Principal Engineer to lead the Hadoop-based data platform architecture and operations. You will guide design, scalability, security, and reliability while mentoring engineering teams across data ingestion, processing, governance, and access patterns.

You’ll partner with data engineering, analytics, security, and infrastructure groups to optimize the platform, evolve standard practices, and ensure robust operational excellence in a fast-paced environment.

Formación

• Master’s or bachelor’s degree in Engineering or related field or related work experience
• 5+ years engineering work experience
• 5+ years project management work experience
• Ability to read, write, speak and understand English
• Basic knowledge of IEEE, ANSI, Fiber, Bridging, Switching, Routing, Ethernet and Transport technologies
• Experience with Hadoop and other database technologies (PostgreSQL/MySQL, Splunk)
• Experience with container technologies such as Docker, Kubernetes
• Experience with Django/Flask/FastAPI is not stated; focus on Hadoop ecosystem and cloud data platforms
• Cloud data platforms and hybrid architectures experience preferred
• Ability to mentor engineering teams and create platform runbooks

Responsabilidades

• Owns architecture, design, and lifecycle management of enterprise Hadoop clusters
• Leads administration of Hadoop components (HDFS, YARN, Hive, HBase, Spark, Kafka, Oozie, ZooKeeper, Impala)
• Defines platform standards for availability, performance, DR, backup, monitoring, and security
• Drives infrastructure optimization across storage, compute, workload management, and job scheduling
• Establishes best practices for cluster provisioning, configuration, patches, upgrades, and decommissioning
• Mentor engineers and administrators; provide technical leadership
• Create and maintain platform documentation, runbooks, and architecture standards
• Create and maintain data views and automated data processing

Conocimientos

Hadoop administration

Architecture leadership

Hadoop ecosystem tools

Python/Typescript

DevOps practices

Docker/Kubernetes

Network engineering concepts

Educación

Master’s or Bachelor’s degree in Engineering

Herramientas

HDFS

YARN

Hive

HBase

Spark

Kafka

Oozie

ZooKeeper

Impala

Descripción del empleo

Spectrum is seeking a Principal Engineer to lead the Hadoop-based data platform architecture and operations. You will guide design, scalability, security, and reliability while mentoring engineering teams across data ingestion, processing, governance, and access patterns.

You’ll partner with data engineering, analytics, security, and infrastructure groups to optimize the platform, evolve standard practices, and ensure robust operational excellence in a fast-paced environment.