Hadoop Architect

Tata Consultancy Services; Plano (TX); On-site; USD 95,000 - 115,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

Maternal & Parental Leaves

401K Plan

Certification & Training Reimbursement

Job summary

Tata Consultancy Services is seeking an experienced Hadoop Architect to monitor, optimize, and scale large Hadoop clusters in a Texas-based environment. You will drive incident response, capacity planning, and platform maintenance while collaborating with application teams to ensure seamless data operations.

The role requires deep expertise in HDFS, Ozone, Hive, Spark, and CDP, with strong SQL/Python skills and a track record of enterprise production support.

Qualifications

• Bachelor's degree in Computer Science or equivalent.
• Minimum 10 years of experience in Hadoop administration and platform support.
• Strong expertise in HDFS, Ozone, Hive, Spark, and CDP.
• Proficient in SQL, Python, data validation and ETL processes.
• Familiarity with cloud platforms and monitoring tools.

Responsibilities

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Skills

Hadoop Architect

HDFS

Ozone

Hive

Spark

Hive Metastore

CDP

SQL

Python

ETL

Shell scripting

Education

Bachelor of Computer Science

Tools

Cloudera Data Platform (CDP)

Cloudera Manager

Grafana

Prometheus

Splunk

Job description

Job Description

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Must Have Technical/Functional Skills

Primary Skill: Hadoop Architect

Experience: Minimum10 years

Key Responsibilities

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Required Technical Skills

• Strong experience with the Hadoop ecosystem:
• HDFS
• Hive
• Spark
• Ozone
• Hive Metastore management and table/partition maintenance.
• Hadoop data lifecycle management.
• Data ingestion, ETL processes, and data validation.
• Shell scripting and Python automation.
• Cloudera Data Platform (CDP) or similar Hadoop distributions.
• Strong SQL and data analysis skills.

Desired / Preferred Skills

• Experience supporting large-scale Hadoop environments with multi-petabyte storage.
• Knowledge of distributed storage architecture and data replication.
• Capacity management, storage forecasting, and quota governance.
• Platform onboarding, integration, and decommissioning.
• Familiarity with cloud platforms (Azure, AWS, or GCP).
• Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.
• Strong analytical and problem-solving skills with root cause analysis.

Assessment Based On what you’ve shared with me previously, this role aligns well with your background in:

• Hadoop administration and platform support
• HDFS and Ozone
• Hadoop migration and enablement
• SQL
• Python
• Grafana and Prometheus
• Enterprise production support

If this is for an interview, I can also prepare:

• The top 50 interview questions with answers for this exact job description.
• Scenario-based production support questions.
• A resume tailored specifically to this role.

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
• Salary Range: $95,000 - $115,000 a year

Qualifications

BACHELOR OF COMPUTER SCIENCE