Data Engineer

Tata Consultancy Services; Mumbai; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Tata Consultancy Services in Mumbai seeks an Azure Data Platform Engineer to design, automate, and optimize enterprise-scale data platforms using Terraform, Ansible, Python, and PySpark. The role focuses on high availability, performance, and operational excellence.

You will maintain CI/CD pipelines in Azure DevOps, support Azure Databricks, Synapse Analytics, and Snowflake, and collaborate with Data Engineering for scalability and security best practices.

Qualifications

• 4-7 years of experience in Cloud/DevOps/Platform/Data Engineering.
• Hands-on with IaC and automation tooling.
• Experience with large-scale enterprise data platforms.
• Strong troubleshooting and incident management.

Responsibilities

• Design, implement, and maintain IaC solutions using Terraform and Ansible.
• Develop CI/CD pipelines with Azure DevOps.
• Automate deployment using Python and PySpark.
• Support analytics platforms including Azure Databricks and Synapse.
• Monitor and troubleshoot data pipelines and platforms.
• Collaborate with Data Engineering teams to optimize performance.
• Perform root cause analysis and implement preventive measures.
• Assist with database administration and query optimization.
• Maintain security, compliance, and operational runbooks.

Skills

Cloud engineering

DevOps

Platform engineering

Data engineering concepts

SQL

Troubleshooting

Azure cloud services

Python / PySpark

Security / compliance

Tools

Terraform

Ansible

Python

PySpark

Azure Databricks

Azure Synapse Analytics

Snowflake

Databricks

Azure

SQL databases

Job description

We are seeking a highly skilled Azure Data Platform Engineer with expertise in cloud infrastructure automation, DevOps practices, and modern analytics platforms. The ideal candidate will be responsible for supporting, automating, and optimizing enterprise-scale data platforms while ensuring high availability, performance, and operational excellence.

Key Responsibilities

• Design, implement, and maintain Infrastructure as Code (IaC) solutions using Terraform and Ansible.
• Develop and manage CI/CD pipelines using Azure DevOps.
• Automate operational and deployment processes using Python and PySpark.
• Support and administer cloud-based analytics platforms including Azure Databricks, Azure Synapse Analytics, and Snowflake.
• Monitor, troubleshoot, and resolve platform, application, and data pipeline issues.
• Collaborate with Data Engineering teams to optimize platform performance, reliability, and scalability.
• Perform root cause analysis and implement preventive measures for recurring incidents.
• Support database administration activities, including performance tuning, query optimization, and maintenance.
• Ensure adherence to security, compliance, and operational best practices.
• Create and maintain technical documentation, runbooks, and operational procedures.

Required Skills

• 4-7 years of experience in Cloud Engineering, DevOps, Platform Engineering, or Data Platform Support.
• Hands-on experience with:
• Infrastructure as Code (IaC)
• Terraform
• Ansible
• Python / PySpark
• Good understanding of Azure cloud services and resource management.
• Experience supporting production environments with strong troubleshooting skills.
• Knowledge of SQL and database concepts.
• Understanding of Data Engineering concepts and data processing frameworks.

Preferred Skills

• Hands-on experience with:
• Snowflake
• Databricks certification/accreditation is highly preferred.
• Experience supporting enterprise data engineering environments.
• Strong SQL development and troubleshooting skills.
• Database Administration (DBA) experience.
• Knowledge of data warehousing and modern analytics architectures.

Experience

• 4+ years of experience in Cloud, DevOps, Platform Engineering, or Data Engineering support roles.
• Experience supporting production environments and handling incident management.
• Exposure to large-scale enterprise data platforms is preferred.

Preferred Qualifications

• Databricks Certification.
• Experience with Agile and DevOps methodologies.