Azure Data Engineer

Tata Consultancy Services; Londrina; Presencial; BRL 180 000 - 260 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Life insurance

International experience opportunity

Certifications reimbursement

Learning portal access

Resumo da oferta

Tata Consultancy Services is seeking an Azure Data Engineer in Londrina to transform data into scalable pipelines. You will work with Azure Databricks, Synapse and Data Factory to build robust ELT processes, ensuring data accuracy and timely delivery.

Ideal candidates will have hands-on experience with Delta Live Tables, Delta Lake, PySpark and CI/CD practices, collaborating in a dynamic, global IT environment with opportunities for international assignments.

Qualificações

• Strong hands-on experience with Azure-based data platforms.
• Proven ELT pipeline development using Databricks and ADF.
• Experience with Delta Live Tables and Delta Lake concepts.
• Proficiency in PySpark and SQL for data transformations.
• Knowledge of CI/CD and version control workflows.

Responsabilidades

• Develop and maintain ELT pipelines using Azure Databricks and Data Factory.
• Design and optimize Delta Live Tables and data lake architectures.
• Implement metadata-driven data pipelines and dynamic logic.
• Ensure data quality, timeliness, and lineage across workloads.
• Collaborate on CI/CD processes with Azure DevOps and Git.

Conhecimentos

Azure Data Lake

Delta Live Tables

Databricks Auto Loader

PySpark

SQL

ETL development

Azure Synapse

CI/CD

Git

Metadata management

Delta lakehouse

Azure Data Factory

Azure Databricks

Ferramentas

Azure Data Factory

Azure Databricks

Azure Synapse

Azure DevOps

Azure Data Lake Storage

Descrição da oferta de emprego

Come to one of the biggest IT Services companies in the world!! Here you can transform your career!

Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for Azure Data Engineer who wants to learn and transform his career.

Key Responsibilities

• Experience with data transformation using Spark and SQL technologies.
• Solid understanding of design patterns, and best practices of the cloud stack.
• Experience with code management and version control using Git or similar tools.
• Strong problem-solving and debugging skills in ETL workflows and data pipelines.
• Strong understanding of Azure Data bricks and Azure Synapse internals - features and capabilities.
• Knowledge of Azure DevOps and continuous integration and deployment (CI/CD) process.

Mandatory Skills

• Good Knowledge of Data Brick Lakehouse and Azure Data Lake concept
• Knowledge of Data Bricks delta concept- Delta live tables (DLT)
• Strong hands-on experience in ELT- pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
• Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic
• In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
• Developing pipeline/notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task.
• Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
• Writing efficient and high-performing ETL code using PySpark, and SQL technologies.
• Building and testing data pipelines using Azure Data bricks and Azure Synapse.
• Ensuring the accuracy, completeness, and timeliness of data being processed and integrate

What can you expect from us?

Professional development and constant evolution of your skills, always in line with your interests.

Opportunities to work outside Brazil

A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

• Health insurance
• Life insurance
• Totalpass
• TCS Cares - free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal - Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• Bring Your Buddy - By referring people you become eligible to receive a bonus for each hire
• TCS Gems - Recognition for performance
• Xcelerate - Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!