Azure Data Engineer

Tata Consultancy Services; Londrina; Presencial; BRL 120 000 - 180 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Life insurance

Gympass

TCS Cares – 24/7 support

Resumo da oferta

Tata Consultancy Services in Londrina, Brazil, is seeking an Azure Data Engineer to join a growing data platform team. You will design and implement ELT pipelines, leverage Delta Live Tables, Databricks Autoloader, and Azure Synapse to enable reliable data processing.

You will apply Spark and SQL, ensure data quality, participate in CI/CD with Azure DevOps, and collaborate with analytics to deliver scalable data solutions.

Qualificações

• Experience with ELT pipeline development on Azure data services.
• Proficiency in data transformation using Spark and SQL.

Responsabilidades

• Develop and maintain ELT pipelines using Azure Data Factory and Databricks.
• Develop Delta Live Tables (DLT) and notebooks for data processing.
• Transform data with Spark and SQL technologies.
• Ensure data quality, profiling, validation and cleansing.
• Collaborate on cloud data stack design patterns and best practices.
• Implement CI/CD processes with Azure DevOps.

Conhecimentos

Azure Data Lake

Azure Data Factory

Databricks Delta Live Tables

Databricks Autoloader

Notebook scripting

Azure Synapse

ETL pipelines

Spark

SQL

CI/CD

Git

Data quality

Power BI

Ferramentas

Azure Data bricks

Azure DevOps

Descrição da oferta de emprego

Come to one of the biggest IT Services companies in the world!! Here you can transform your career!

Why to join TCS?

Here at TCS we believe that people make the difference, that's why we live a culture of unlimited learning full of opportunities for improvement and mutual development. The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.

We are looking for Azure Data Engineer who wants to learn and transform his career.

Skills Required

• Good Knowledge of Data Brick Lakehouse and Azure Data Lake concept
• Knowledge of Data Bricks delta concept– Delta live tables (DLT)
• Strong hands‑on experience in ELT– pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task
• Strong knowledge of metadata‑driven data pipeline, metadata management, dynamic logic
• In‑depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool.
• Experience with data transformation using Spark and SQL technologies.
• Solid understanding of design patterns, and best practices of the cloud stack.
• 3+ years of experience with code management and version control using Git or similar tools.
• Strong problem‑solving and debugging skills in ETL workflows and data pipelines.
• Strong understanding of Azure Data bricks and Azure Synapse internals – features and capabilities.
• Knowledge of Azure DevOps and continuous integration and deployment (CI/CD) process.
• Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing.
• Good to have Knowledge of Powerbi reporting and Dax formulas
• Developing pipeline/notebook for Delta live tables ( DLT) Databricks Auto Loader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task.
• Developing, deploying, and maintaining workflows and data pipelines using Azure Data bricks and Azure Synapse.
• Writing efficient and high‑performing ETL code using PySpark, and SQL technologies.
• Building and testing data pipelines using Azure Data bricks and Azure Synapse.
• Ensuring the accuracy, completeness, and timeliness of data being processed and integrate
• Performance benchmarking of data ingestion and Data flo pipeline/notebook and ensuring consistency
• Knowledge of Azure Capacity management

What can you expect from us?

Professional development and constant evolution of your skills, always in line with your interests.

Opportunities to work outside Brazil

A collaborative, diverse and innovative environment that encourages teamwork.

What do we offer?

• Health insurance
• Life insurance
• Gympass
• TCS Cares – free 0800 that provides psychological assistance (24 hrs/day), legal, social and financial assistance to associates
• Partnership with SESC
• Reimbursement of Certifications
• Free TCS Learning Portal – Online courses and live training
• International experience opportunity
• Discount Partnership with Universities and Language Schools
• TCS Gems – Recognition for performance
• Xcelerate – Free Mentoring Career Platform

At TATA Consultancy Services we promote an inclusive culture, we always work for equity. This applies to Gender, People with Disabilities, LGBTQIA+, Religion, Race, Ethnicity. All our opportunities are based on these principles. We think of different actions of inclusion and social responsibility, in order to build a TCS that respects individuality. Come to be a TCSer!