Aws Data Engineer

Tata Consultancy Services; Pinhais; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading IT services company in Brazil is looking for a Data Engineer AWS Expert. This role involves designing APIs, developing data pipelines in PySpark, and managing data quality. Ideal candidates will have proven experience with AWS technologies, strong soft skills and a proactive approach to problem-solving. The company offers extensive benefits, including health insurance, meal vouchers, and opportunities for international experience. Join us to transform your career in a collaborative environment.

Serviços

Health insurance

Dental Plan

Life insurance

Transportation vouchers

Meal / Food Voucher

Childcare assistance

Gympass

Free TCS Learning Portal

TCS Cares – Psychological assistance 24/7

Qualificações

• Proven experience with AWS tools such as API Gateway, Lambda, and S3.
• Strong knowledge of PySpark, including partitioning, joins, and optimization.
• Experience with REST APIs and data integration.
• Knowledge of infrastructure as code using Terraform or CloudFormation.

Responsabilidades

• Design, develop, and maintain APIs using AWS API Gateway.
• Implement integrations with Lambda or Fargate for data ingestion.
• Develop processing pipelines in PySpark.
• Manage data in S3 and Glue Data Catalog.
• Ensure data quality and integrity through data quality checks.

Conhecimentos

AWS (API Gateway, Lambda / Fargate, S3, Glue, CloudWatch)

PySpark

Data Quality tools (Great Expectations, Soda)

Version control (Git)

Infrastructure as code (Terraform or CloudFormation)

Soft Skills: Good communication and teamwork

Problem-solving proactivity

Ferramentas

Glue Data Catalog

Athena

Data Quality tools (Great Expectations, Soda)

Descrição da oferta de emprego

Come to one of the biggest IT Services companies in the world!! Here you can transform your career!

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for Data Engineer AWS Expert who wants to learn and transform his career.

In this role you will : (responsibilities)

Proven experience with AWS (API Gateway, Lambda / Fargate, S3, Glue, CloudWatch). Strong knowledge of PySpark (partitioning, joins, optimization). Experience with Glue Data Catalog and querying via Athena. Experience with integration and manipulation of data in REST APIs. Knowledge of infrastructure as code (Terraform or CloudFormation). Good practices in version control (Git) and CI / CD.

Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg).

Use of Data Quality tools (Great Expectations, Soda).

Knowledge of Step Functions, EventBridge, or Kinesis.

Best practices for API security (Cognito, WAF, IAM Policies).

Soft Skills :

Good communication and teamwork.

Proactivity in problem-solving.

Ability to handle agile environments and rapid changes.

Design, develop, and maintain APIs using AWS API Gateway.

Implement integrations with Lambda or Fargate for data ingestion.

Develop processing pipelines in PySpark (AWS Glue or EMR).

Manage data in S3 and Glue Data Catalog.

Ensure data quality and integrity (data quality checks).

Optimize pipeline costs and performance.

Create and maintain technical documentation and development standards.

What can you expect from us?

• Professional development and constant evolution of your skills, always in line with your interests.
• Opportunities to work outside Brazil
• A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

TCS Benefits – Brazil:

• Health insurance
• Dental Plan
• Life insurance
• Transportation vouchers
• Meal / Food Voucher
• Childcare assistance

Other benefits:

• Gympass
• TCS Cares – free 0800 that provides psychological assistance (24 hrs / day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal – Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
• TCS Gems – Recognition for performance
• Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!

#Buildingonbelief