Hadoop Architect

Fixity Technologies; Plano (TX); On-site; USD 90,000 - 150,000; Full time

Job summary

Fixity Technologies in Plano, TX is seeking an experienced Hadoop Platform Engineer to monitor and resolve HDFS and Ozone issues, optimize cluster performance, and manage storage capacity for multi-petabyte deployments.

You will coordinate with application teams during incidents, maintain runbooks, and contribute to platform maintenance and data governance. Proficiency in SQL, scripting (Python/Shell), and CDP or similar distributions is essential.

Qualifications

• Experience with Hadoop ecosystem including HDFS, Hive, Spark and Ozone.
• Strong SQL and data analysis skills.
• Shell scripting and Python automation for operational tasks.

Responsibilities

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Skills

Hadoop ecosystem

HDFS

Hive

Spark

Ozone

Hive Metastore management

Hadoop data lifecycle management

Data ingestion/ETL/data validation

Shell scripting

Python automation

CDP/ Hadoop distributions

SQL

Tools

Cloudera Manager

Grafana

Splunk

Prometheus

Job description

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Required Technical Skills

• Strong experience with the Hadoop ecosystem:
• o HDFS
• o Hive
• o Spark
• o Ozone
• • Hive Metastore management and table/partition maintenance.
• • Hadoop data lifecycle management.
• • Data ingestion, ETL processes, and data validation.
• • Shell scripting and Python automation.
• • Cloudera Data Platform (CDP) or similar Hadoop distributions.
• • Strong SQL and data analysis skills.

Desired / Preferred Skills

• Experience supporting large-scale Hadoop environments with multi-petabyte storage.
• Knowledge of distributed storage architecture and data replication.
• Capacity management, storage forecasting, and quota governance.
• Platform onboarding, integration, and decommissioning.
• Familiarity with cloud platforms (Azure, AWS, or GCP).
• Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.
• Strong analytical and problem-solving skills with root cause analysis.