AWS Data Engineer

Tata Consultancy Services; Cuiabá; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading IT Services company based in Brazil is seeking an experienced Data Engineer AWS Expert to design and maintain APIs, manage data with AWS services, and ensure data quality. The successful candidate will work in a collaborative and innovative environment, with opportunities for professional development and international experience. Key responsibilities include developing processing pipelines and ensuring API security. Benefits include health insurance, mentorship programs, and skill development opportunities.

Serviços

Health insurance

Life insurance

Gympass

TCS Cares – psychological assistance

Reimbursement of Certifications

Free TCS Learning Portal

International experience opportunity

Discount Partnership with Universities and Language Schools

Bring Your Buddy bonus

TCS Gems recognition

Qualificações

• Proven experience with AWS and related services.
• Strong knowledge in data processing with PySpark.
• Experience in managing data and ensuring quality checks.

Responsabilidades

• Design, develop, and maintain APIs using AWS API Gateway.
• Implement integrations with Lambda or Fargate for data ingestion.
• Develop processing pipelines in PySpark and manage data in S3.

Conhecimentos

AWS (API Gateway, Lambda / Fargate, S3, Glue, CloudWatch)

PySpark

Data Quality tools (Great Expectations, Soda)

Infrastructure as code (Terraform or CloudFormation)

Version control (Git)

API security (Cognito, WAF, IAM Policies)

Experience with columnar formats (Parquet, Delta, Hudi, Iceberg)

Step Functions, EventBridge, or Kinesis

Descrição da oferta de emprego

Come to one of the biggest IT Services companies in the world!! Here you can transform your career! Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for Data Engineer AWS Expert who wants to learn and transform his career.

In this role you will : (responsibilities)

Proven experience with AWS (API Gateway, Lambda / Fargate, S3, Glue, CloudWatch). Strong knowledge of PySpark (partitioning, joins, optimization). Experience with Glue Data Catalog and querying via Athena. Experience with integration and manipulation of data in REST APIs. Knowledge of infrastructure as code (Terraform or CloudFormation). Good practices in version control (Git) and CI / CD.

Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg).

Use of Data Quality tools (Great Expectations, Soda).

Knowledge of Step Functions, EventBridge, or Kinesis.

Best practices for API security (Cognito, WAF, IAM Policies).

Soft Skills :

Good communication and teamwork.

Proactivity in problem-solving.

Ability to handle agile environments and rapid changes.

Design, develop, and maintain APIs using AWS API Gateway.

Implement integrations with Lambda or Fargate for data ingestion.

Develop processing pipelines in PySpark (AWS Glue or EMR).

Manage data in S3 and Glue Data Catalog.

Ensure data quality and integrity (data quality checks).

Optimize pipeline costs and performance.

Create and maintain technical documentation and development standards.

What can you expect from us?

• Professional development and constant evolution of your skills, always in line with your interests.
• Opportunities to work outside Brazil
• A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

Health insurance

Life insurance

Gympass

TCS Cares – free 0800 that provides psychological assistance (24 hrs / day), legal, social and financial assistance to associates

Partnership with SESC

Reimbursement of Certifications

Free TCS Learning Portal – Online courses and live training

International experience opportunity

Discount Partnership with Universities and Language Schools

Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire

TCS Gems – Recognition for performance

Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!

ID : 10331558