Lead Data Architect

Tata Consultancy Services; Brasil; Presencial; BRL 180 000 - 240 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Life insurance

Gympass

International experience opportunity

Bring Your Buddy – referral bonus

Resumo da oferta

Tata Consultancy Services invites engineers to join a pivotal Data & Analytics team in Brazil. You will design and evolve an AWS Serverless DataLake to handle massive data volumes, collaborating with data scientists and cross-functional partners to deliver scalable data solutions.

The role emphasizes mentoring teammates, ensuring best practices, and staying ahead with new AWS services to drive innovation and data quality across workflows.

Qualificações

• Hands-on experience leading the modeling, development and deployment of Data & Analytics solutions.
• Cloud Services (AWS) data applications building and data pipelines creation/curation;Database programming advanced level (AWS Redshift, SQLDW, Postgres, SQL expert)

Responsabilidades

• Design and Improve an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows.
• Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues.

Conhecimentos

AWS

Kubernetes

Terraform

Delta Lake

Iceberg

Spark

Stored Procedures

UDFs

SQL

Data Modeling

CI/CD

Jenkins

Linux

Data Warehousing

Descrição da oferta de emprego

Come to one of the biggest IT Services companies in the world!! Here you can transform your career!

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for (job name) who wants to learn and transform his career.

Responsibilities

Design and Improve an AWS Serverless DataLake architecture to efficiently handle large volumes of data and support various data processing workflows.Collaborate with cross-functional teams to understand business requirements, prioritize tasks, and deliver high-quality solutions within defined timelines; Mentor and provide technical guidance to junior data engineers, fostering their growth and ensuring adherence to best practices. Continuously evaluate new AWS services and technologies to enhance the DataLake architecture, improve data processing efficiency, and drive innovation. Monitor and troubleshoot the DataLake infrastructure, identifying and resolving performance bottlenecks, data processing errors, and other issues. Optimize data storage and retrieval mechanisms, leveraging AWS services such as S3, Athena, Redshift, or DynamoDB, to provide high-performance access to the data.Collaborate with data scientists and analysts to understand their data requirements and design appropriate data models and schemas in the DataLake. Demonstrated experience with container orchestration technologies. Implement data ingestion pipelines, transformation and data enrichment processes using AWS Lambda, Glue, or similar serverless technologies to ensure data quality and consistency.

Required Skills

• Hands-on experience leading the modeling,
• development and deployment of Data & Analytics solutions
• Agile Methodologies;
• At least experience in 3-4 projects with Multidimensional data modeling
• Cloud Services (AWS) data applications building and data pipelines creation/curation;Database programming advanced level (AWS Redshift, SQLDW, Postgres, SQL expert)
• Strong understanding of Linux and distributed systems is a plus
• Experience with Kubernetes is required
• Experience with Infrastructure as Code tools (e.g., Terraform);
• Understanding of CI/CD pipelines (Jenkins) and GitOps practices
• Knowledge of application metric monitoring tools and logs (Grafana, Kibana, Cloud Logging/Log based metrics, etc.)
• Knowledge of open-source table formats (Delta Lake and Iceberg)
• Previous experience on serverless architecture (Spark, glue, Lambda functions)
• Previous experience with Stored Procedures and UDF’s and Talend tool
• Multidimensional modeling (Star Schema and Snowflake) and Data Warehouse concepts.
• High level of autonomy & good communication
• Opening to understand what has been required by the PO;Adaptability
• Good attitude and insatiable hunger for knowledge is an extreme mandatory item

What can you expect from us?

• Professional development and constant evolution of your skills, always in line with your interests.
• Opportunities to work outside Brazil
• A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

• Health insurance
• Life insurance
• Gympass
• TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal – Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
• TCS Gems – Recognition for performance
• Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity.

This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity.

All our opportunities are based on these principles.

We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality.

Come to be a TCSer!