Aws Data Engineer

Tata Consultancy Services; Flores da Cunha; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A global IT services leader in Brazil seeks a Data Engineer AWS Expert to innovate and transform career paths. This role involves designing and maintaining APIs, data processing with PySpark, and ensuring data quality. Candidates should have proven AWS experience and a proactive approach to problem-solving. The company offers opportunities for professional growth, benefits including health insurance, and a diverse work culture that embraces equality and inclusion.

Serviços

Health insurance

Dental Plan

Life insurance

Transportation vouchers

Meal / Food Voucher

Childcare assistance

Gympass

Psychological assistance

Certification reimbursement

TCS Learning Portal

Qualificações

• Proven experience with AWS services such as API Gateway, Lambda, and Glue.
• Strong knowledge of PySpark for data processing.
• Experience with data integration through REST APIs.

Responsabilidades

• Design, develop, and maintain APIs using AWS services.
• Implement data ingestion integrations with AWS Lambda.
• Ensure data quality and performance optimization.

Conhecimentos

AWS

PySpark

REST APIs

Terraform

Git

Data Quality tools

API security

Soft Skills

Ferramentas

AWS Glue

AWS EMR

Great Expectations

Soda

Descrição da oferta de emprego

Come to one of the biggest IT Services companies in the world!! Here you can transform your career!

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for Data Engineer AWS Expert who wants to learn and transform his career.

In this role you will : (responsibilities)

Proven experience with AWS (API Gateway, Lambda / Fargate, S3, Glue, CloudWatch). Strong knowledge of PySpark (partitioning, joins, optimization). Experience with Glue Data Catalog and querying via Athena. Experience with integration and manipulation of data in REST APIs. Knowledge of infrastructure as code (Terraform or CloudFormation). Good practices in version control (Git) and CI / CD.

Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg).

Use of Data Quality tools (Great Expectations, Soda).

Knowledge of Step Functions, EventBridge, or Kinesis.

Best practices for API security (Cognito, WAF, IAM Policies).

Soft Skills :

Good communication and teamwork.

Proactivity in problem-solving.

Ability to handle agile environments and rapid changes.

Design, develop, and maintain APIs using AWS API Gateway.

Implement integrations with Lambda or Fargate for data ingestion.

Develop processing pipelines in PySpark (AWS Glue or EMR).

Manage data in S3 and Glue Data Catalog.

Ensure data quality and integrity (data quality checks).

Optimize pipeline costs and performance.

Create and maintain technical documentation and development standards.

What can you expect from us?

• Professional development and constant evolution of your skills, always in line with your interests.
• Opportunities to work outside Brazil
• A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

TCS Benefits – Brazil:

• Health insurance
• Dental Plan
• Life insurance
• Transportation vouchers
• Meal / Food Voucher
• Childcare assistance

Other benefits:

• Gympass
• TCS Cares – free 0800 that provides psychological assistance (24 hrs / day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal – Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
• TCS Gems – Recognition for performance
• Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!

#Buildingonbelief