Big Data Administrator

Tata Consultancy Services; São Paulo; Presencial; BRL 180 000 - 260 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Seguro saúde

Plano dentário

Seguro de vida

Vale-transporte

Vale refeição

Gympass

Portal de Aprendizado TCS

Experiência internacional

Resumo da oferta

A Tata Consultancy Services procura um Big Data Administrator para atuar em São Paulo, Brasil. O profissional será responsável pela administração de clusters EMR, operação de plataformas de dados grandes e implementação de práticas de DevOps, com foco em segurança, monitoramento e otimização de custos.

O candidato ideal possui forte experiência em AWS, Hadoop, Spark/Hive, e automação com Terraform/CloudFormation, além de conhecimentos em Docker/Kubernetes.

Qualificações

• Conhecimento avançado em AWS EMR e ecossistema Hadoop.
• Administração Linux sólida e scripts (Bash, Python).
• familiarity com serviços AWS (S3, EC2, IAM, CloudWatch).
• Experiência com Terraform, CloudFormation e outras ferramentas DevOps.
• Certificações AWS (Solutions Architect, Big Data, Data Engineer).
• Experiência com EMR Serverless, Docker ou Kubernetes.

Responsabilidades

• Provisionar, configurar e gerenciar clusters EMR.
• Monitorar desempenho, dimensionamento automático e tuning.
• Gerenciar componentes Hadoop (HDFS, YARN, Hive, Spark).
• Instalar, configurar e atualizar ferramentas de Big Data.
• Monitorar a saúde do cluster e solucionar falhas.
• Gerenciar pipelines de ingestão de dados (Kafka, Kinesis, AWS Glue).
• Implementar EMR com IAM, Kerberos, KMS e VPC.
• Automatizar provisionamento EMR com CloudFormation, CDK ou Terraform.
• Construir CI/CD com ferramentas AWS ou Jenkins; otimização de custos.
• Usar CloudWatch/CloudTrail para diagnóstico e ajuste de Spark/Hive.

Conhecimentos

AWS EMR

Hadoop ecosystem

Linux scripting

IAM & security

Kafka/Kinesis

CI/CD tooling

Spark/Hive tuning

CloudWatch diagnostics

Ferramentas

Terraform

CloudFormation

Docker

Kubernetes

CDK

Jenkins

Descrição da oferta de emprego

Big Data Administrator Tata Consultancy Services são paulo, federative republic of brazil, Brazil

Descrição da vaga

Come to one of the biggest IT Services companies in the world!! Here you can transform your career!

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for Big Data Administrator who wants to learn and transform his career.

Skills Required

• Expertise with AWS EMR and Hadoop ecosystem.
• Strong Linux administration and scripting (Bash, Python).
• Familiarity with AWS services like S3, EC2, IAM, CloudWatch.
• Experience with Terraform, CloudFormation, and other DevOps tools.
• AWS certifications (Solutions Architect, Big Data, Data Engineer).
• Experience with EMR Serverless, Docker, or Kubernetes

EMR Cluster Administration

• Provision, configure, and manage Amazon EMR clusters.
• Optimize sizing, auto-scaling, and performance.
• Manage Hadoop components including HDFS, YARN, Hive, and Spark.

Big Data Platform Operations

• Install, configure, and upgrade big data tools.
• Monitor cluster health and troubleshoot failures.
• Manage data ingestion pipelines including Kafka, Kinesis, and AWS Glue.

Security, Compliance & IAM

• Implement EMR security with IAM, Kerberos, KMS, and VPC configurations.
• Ensure compliance with organizational standards.

Automation & DevOps

• Automate EMR provisioning using CloudFormation, CDK, or Terraform.
• Build CI/CD pipelines using AWS tools or Jenkins.
• Implement cost optimization strategies.

Monitoring & Troubleshooting

• Use CloudWatch, CloudTrail, and EMR Console for diagnostics.
• Tune Spark and Hive jobs for performance.

Collaboration & Support

• Work closely with data engineers and cloud teams.
• Provide production support and on-call assistance.
• AWS Big data platform Admin (EMR, Hbase, Glue, pyspark, scala)
• Terraform knowledge
• Not a developer, need platform admin

What can you expect from us?

Professional development and constant evolution of your skills, always in line with your interests.

Opportunities to work outside Brazil

A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

• Health insurance
• Dental Plan
• Life insurance
• Transportation vouchers
• Meal/Food Voucher
• Childcare assistance
• Gympass
• TCS Cares - free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal – Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• TCS Gems - Recognition for performance
• Xcelerate - Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!