Senior Hadoop Platform Architect

Jobtome; Greenwood Village (CO); Presencial; USD 111.000 - 196.000; Jornada completa

Descripción de la vacante

Spectrum is seeking a Principal Engineer to lead the architecture, engineering, and operation of our Hadoop-based data platform. You will guide design, security, DR, and performance while mentoring teams and partnering with data engineering, security, and infrastructure stakeholders.

The role requires deep Hadoop expertise, strong leadership, and hands-on capabilities in a fast-paced enterprise environment. Located in the US, Colorado area, with on-site work expected.

Formación

• Master's or bachelor's degree in Engineering or related field or related work experience.
• 5+ years engineering work experience.
• 5+ years project management work experience.
• Ability to read, write, speak and understand English.
• Basic knowledge of IEEE, ANSI, Fiber, Bridging, Switching, Routing, Ethernet and Transport technologies and protocols.
• Basic knowledge in network design, network architecture, protocols and network topology.
• Basic knowledge in TCP/IP and the OSI Model.
• Basic knowledge in using ticketing and software tools to support current operations.
• Basic knowledge of network devices and basic network appliances.
• Basic knowledge of network designing software, such as Visio.
• Ability to perform duties in a very fast-paced environment and ability to learn new technology quickly.
• Ability to use personal computer and software applications.

Responsabilidades

• Owns the architecture, design, and lifecycle management of enterprise Hadoop clusters and supporting data platform services.
• Leads administration of Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Spark, Kafka, Oozie, ZooKeeper, Impala, and related tooling.
• Defines platform standards for availability, performance, capacity planning, disaster recovery, backup, monitoring, and security.
• Drives infrastructure optimization across storage, compute, workload management, and job scheduling.
• Establishes best practices for cluster provisioning, configuration management, patching, upgrades, and decommissioning.
• Partner with data engineering, analytics, security, and infrastructure teams to support data ingestion, processing, governance, and access patterns.
• Troubleshoot complex platform, performance, and production stability issues across distributed systems.
• Lead root cause analysis and implement preventive measures to improve resiliency and service quality.
• Evaluate and guide migration or coexistence strategies involving cloud data platforms and hybrid architectures.
• Mentor engineers and administrators, providing technical leadership across platform operations and engineering initiatives.
• Create and maintain platform documentation, operational runbooks, and architecture standards.
• Create and maintain data views, data exports and automated data processing.

Conocimientos

Engineering experience

Project management

English proficiency

Networking standards

Network design

TCP/IP

Visio

Hadoop

PostgreSQL

MySQL

Splunk

Docker

Kubernetes

Python

TypeScript

Django

Flask

FastAPI

Shell scripting

RESTful APIs

RFC/IEEE standards

CCIE

DevOps

Educación

Master's or Bachelor's degree in Engineering or related field

Herramientas

Hadoop

Docker

Kubernetes

Visio

Descripción del empleo

Spectrum is seeking a Principal Engineer to lead the architecture, engineering, and operation of our Hadoop-based data platform. You will guide design, security, DR, and performance while mentoring teams and partnering with data engineering, security, and infrastructure stakeholders.

The role requires deep Hadoop expertise, strong leadership, and hands-on capabilities in a fast-paced enterprise environment. Located in the US, Colorado area, with on-site work expected.