Lead Hadoop Platform Architect, Enterprise Data

Jobtome; Englewood (CO); On-site; USD 111,000 - 196,000; Full time

Job summary

Spectrum's Network Engineering team is seeking a Principal Engineer to lead the architecture and evolution of our Hadoop-based big data platform across the enterprise. You will drive scalability, reliability, security, and operational excellence while mentoring engineering teams.

Responsibilities include owning Hadoop clusters, defining platform standards, and guiding migrations to cloud and hybrid architectures in collaboration with data engineering, analytics, security, and infrastructure

Qualifications

• Master’s or bachelor’s degree in Engineering or related field or related work experience
• 5+ years engineering work experience
• 5+ years project management work experience
• Ability to read, write, speak and understand English

Responsibilities

• Owns the architecture, design, and lifecycle management of enterprise Hadoop clusters and supporting data platform services.
• Leads administration of Hadoop ecosystem components such as HDFS, YARN, Hive, HBase, Spark, Kafka, Oozie, ZooKeeper, Impala, and related tooling.
• Defines platform standards for availability, performance, capacity planning, disaster recovery, backup, monitoring, and security.
• Drives infrastructure optimization across storage, compute, workload management, and job scheduling.

Skills

Hadoop administration

Architecture leadership

Education

Master’s or Bachelor’s degree in Engineering or related field

Tools

HDFS

YARN

Hive

Spark

Kafka

Oozie

ZooKeeper

Impala

Job description

Spectrum's Network Engineering team is seeking a Principal Engineer to lead the architecture and evolution of our Hadoop-based big data platform across the enterprise. You will drive scalability, reliability, security, and operational excellence while mentoring engineering teams.

Responsibilities include owning Hadoop clusters, defining platform standards, and guiding migrations to cloud and hybrid architectures in collaboration with data engineering, analytics, security, and infrastructure