Senior Hadoop & DevOps Engineer (10+ yrs)

Tata Consultancy Services; Plano (TX); On-site; USD 95,000 - 115,000; Full time

Benefits offered by this job

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Health

Family Support: Maternal & Parental Le

Job summary

Tata Consultancy Services in Plano, Texas is seeking a senior Hadoop specialist with a minimum 10 years of experience to join our data platform team. Primary responsibility is Hadoop support with a secondary focus on Linux and DevOps.

The role covers L1-L3 support, performance tuning, capacity planning, incident management, and collaboration with application teams. Proficiency in Hadoop ecosystem and AD/Kerberos authentication required; salary range $95,000-$115,000.

Qualifications

• Experience on L1, L2 & L3 level support in Hadoop Platform.
• Experience in Yarn, Spark and Impala job debugging and troubleshooting.
• Experience in addressing issues around NameNode, HDFS Space, File/Folder Permission & backups.
• Understanding and experience in query performance tuning and resource utilization tuning.
• Technical knowledge on relational databases, data warehousing and SQL skills.
• Hadoop, Kafka, Spark, Impala, Hive, HBase, Ozone etc.
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator’s role.
• Intimate knowledge of fully integrated AD/Kerberos authentication.
• Experience setting up optimum cluster configurations.
• Debugging knowledge of YARN.
• Hands-on with analyzing various Hadoop log files, compression, encoding, & file formats.
• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.
• Experience in Monitoring & Alerting, and Job Scheduling Systems.
• Being comfortable with frequent, incremental code testing and deployment.
• Strong grasp of automation / DevOps tools - Ansible, Jenkins, SVN, Bitbucket.

Responsibilities

• L1, L2 & L3 level support in Hadoop Platform.
• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Skills

Hadoop

Linux

DevOps

Yarn

Spark

Impala

Hive

HBase

Ozone

SQL

Java

Python

Shell scripting

Ansible

Jenkins

SVN

Bitbucket

Postgres

Education

Bachelor of Computer Science

Tools

Hadoop Stack

Autosys

Tableau

Job description

Tata Consultancy Services in Plano, Texas is seeking a senior Hadoop specialist with a minimum 10 years of experience to join our data platform team. Primary responsibility is Hadoop support with a secondary focus on Linux and DevOps.

The role covers L1-L3 support, performance tuning, capacity planning, incident management, and collaboration with application teams. Proficiency in Hadoop ecosystem and AD/Kerberos authentication required; salary range $95,000-$115,000.