Azure Data Engineer - S

Tata Consultancy Services Limited; Mumbai, Pune District, Delhi, Gurugram District; Presencial; INR 2.000.000 - 3.400.000; Jornada completa

Descripción de la vacante

Tata Consultancy Services Limited is seeking an experienced Data Engineer to design, build, and optimize Azure-based data pipelines and infrastructure. The role involves handling structured and unstructured data, developing ETL/ELT workflows, and managing data lakes and warehouses.

You will collaborate with data-focused teams to deliver scalable data solutions while enforcing data governance and security practices across distributed environments.

Formación

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 6+ years of experience in Data Engineering or related roles.
• Strong hands-on experience with Azure data services (ADF, Databricks, Synapse, ADLS, SQL DB, Storage).
• Proficiency in SQL and Python for data processing and transformation.

Responsabilidades

• Design, develop, and maintain scalable data pipelines and integration solutions on Azure.
• Build and optimize data ingestion, transformation, and processing frameworks for structured and unstructured data.
• Develop ETL/ELT workflows using Azure-native services and modern data engineering practices.
• Design and manage enterprise data lakes and data warehouse solutions.
• Collaborate with Data Architects, Data Scientists, Business Analysts, and App Dev teams.

Conocimientos

SQL

Python

Data modeling

Distributed computing

Educación

Bachelor's degree in CS/IT/Engineering

Herramientas

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Data Lake Storage

Azure SQL Database

Azure Storage Accounts

Descripción del empleo

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and integration solutions on Azure.
• Build and optimize data ingestion, transformation, and processing frameworks for structured and unstructured data.
• Develop ETL/ELT workflows using Azure-native services and modern data engineering practices.
• Design and manage enterprise data lakes and data warehouse solutions.
• Collaborate with Data Architects, Data Scientists, Business Analysts, and Application Development teams to deliver data solutions.
• Implement data quality, governance, security, and compliance controls.
• Optimize query performance, data storage, and processing efficiency.
• Monitor and troubleshoot data pipeline performance and production issues.
• Automate data workflows and deployments using DevOps and CI/CD practices.
• Support real-time and batch data processing requirements.
• Create and maintain technical documentation, data models, and operational procedures.
• Participate in Agile development processes, sprint planning, and code reviews.

Required Skills & Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 6+ years of experience in Data Engineering or related roles.
• Strong hands-on experience with:
• Azure Data Factory (ADF)
• Azure Databricks
• Azure Synapse Analytics
• Azure Data Lake Storage (ADLS)
• Azure SQL Database
• Azure Storage Accounts
• Proficiency in SQL and Python for data processing and transformation.
• Experience building batch and streaming data pipelines.
• Strong understanding of data modeling, data warehousing, and dimensional modeling concepts.
• Experience working with large-scale datasets and distributed computing platforms.
• Knowledge of Spark, PySpark, and Databricks optimization techniques.
• Experience with REST APIs and third-party data integrations.
• Familiarity with Git, Azure DevOps, and CI/CD implementations.
• Understanding of data governance, security, and access management practices.