Azure Data Engineer

Tata Consultancy Services Limited; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services Limited (TCS) is hiring a skilled Azure Data Engineer for multiple locations in India, including Bengaluru. The role focuses on designing and implementing scalable data pipelines using PySpark, Azure Synapse, and Databricks, with strong SQL and Python skills.

Candidates should have 6–8 years of data engineering experience, exposure to Azure Data Factory, ADLS, and a cloud-based data warehouse, and familiarity with Agile practices.

Qualifications

• 6–8 years of relevant experience in data engineering.
• Proficiency in PySpark, Azure Synapse Analytics or Azure Databricks.
• Strong SQL and Python expertise.
• Experience with Azure Data Factory and ADLS.
• Experience building robust data pipelines on Azure.

Skills

PySpark

Azure Synapse

Azure Databricks

SQL

Python

Azure Data Factory

Azure Data Lake Storage

Serverless

Data Pipelines

Agile

ETL

Big data

Tools

Jira

Confluence

Job description

TCS Hiring for Azure Data Engineer (multiple locations)

Experience Range: - 06 To 08 Years

JOB DESCRIPTION

Must-Have Skills:

• Relevant experience in PySpark and Azure Synapse Analytics/Azure Databricks.
• Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.
• Good experience in SQL or native SQL query languages.
• Strong experience in implementing Synapse Analytics/Databricks notebooks using Python/PySpark.
• Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, and Azure Functions.
• Advanced working knowledge in building robust data pipelines using ADF.
• Experience in building processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Exposure to basic issues in working within a Cloud (Azure) environment.
• Advanced working SQL knowledge and experience working with relational/non-relational databases and queries.
• Exposure to Jira and Confluence required.
• Experience working in an Agile project management environment.
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
• Build data pipeline infrastructure for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud-based relational or non-relational databases, and/or scripting languages such as Perl/Python.
• Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.

Good-to-Have Skills:

• Experience in SSIS/ETL transformation processes.
• Exposure to any cloud-based Data Warehouse.
• Experience in Azure DevOps and CI/CD deployments.