Azure Data Engineer

Tata Consultancy Services; Viana; Presencial; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A global consulting firm in Viana is seeking a qualified Data Engineer to design and maintain scalable ETL/ELT pipelines using Azure Data Services. The ideal candidate will have expertise in Azure Data Factory and Spark, a passion for problem-solving, and strong communication skills. This role promises professional development opportunities, health insurance, and an inclusive work culture that values diversity and equity. Join us in advancing business solutions while respecting individuality.

Serviços

Health Insurance

Dental Plan

Life Insurance

Transportation vouchers

Meal / Food Voucher

Childcare assistance

Gympass

Free psychological assistance 24/7

Reimbursement of Certifications

Online courses and live training

International experience opportunities

Qualificações

• Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg).
• Knowledge of Step Functions, EventBridge, or Kinesis.
• Ability to handle agile environments and rapid changes.

Responsabilidades

• Design, develop, and maintain scalable ETL / ELT pipelines.
• Optimize data workflows / pipelines for performance and cost efficiency.
• Document design patterns, best practices, and operational procedures.

Conhecimentos

Azure Data Services

Data Quality tools

Apache Spark (PySpark)

API security best practices

Proactive problem-solving

Communication

Teamwork

Ferramentas

Azure Data Factory

Azure Databricks

Azure Synapse

Descrição da oferta de emprego

Responsibilities

• Azure Data Bricks; Azure Data Factory; Azure Data Services
• Experience with columnar and table formats (Parquet, Delta, Hudi, Iceberg)
• Use of Data Quality tools (Great Expectations, Soda)
• Knowledge of Step Functions, EventBridge, or Kinesis
• Best practices for API security (Cognito, WAF, IAM Policies)
• Design, develop, and maintain scalable ETL / ELT pipelines using Azure Data Services (Azure Data Factory, Azure Databricks, Azure Synapse, etc.)
• Build high-performance data processing solutions with Apache Spark (PySpark) on Azure Databricks
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver clean, reliable datasets
• Optimize data workflows / pipelines for performance and cost efficiency in a cloud environment
• Implement best practices around data security, governance, and compliance
• Develop CI / CD pipelines for data engineering workflows
• Monitor, troubleshoot, and enhance existing data solutions for reliability and performance
• Document design patterns, best practices, and operational procedures

Soft Skills

• Good communication and teamwork
• Proactivity in problem‑solving
• Ability to handle agile environments and rapid changes

What can you expect from us?

• Professional development and constant evolution of your skills, always in line with your interests
• Opportunities to work outside Brazil
• A collaborative, diverse and innovative environment that encourages teamwork
• Health insurance
• Dental Plan
• Life insurance
• Transportation vouchersMeal / Food Voucher
• Childcare assistance
• Gympass
• TCS Cares – free 0800 that provides psychological assistance (24 hrs / day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal – Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• Bring Your Buddy – By referring people you become eligible to receive a bonus for each hire
• TCS Gems – Recognition for performance
• Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!