Azure Cloud Data Engineer

Tata Consultancy Services; Charlotte (NC); On-site; USD 110,000 - 120,000; Full time

Job summary

Tata Consultancy Services in Charlotte, NC is seeking an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions on Azure. You will collaborate with DevOps and security teams to ensure secure, cost-efficient cloud infrastructure and robust data platforms.

The role requires 3+ years in Azure cloud development, hands-on with ADF, Databricks, Synapse, ARM/Terraform, and scripting in PowerShell or Python.

Qualifications

• 3+ years of Azure cloud development experience.
• Experience with Azure data services (ADF, Databricks, Synapse).
• Experience with Infrastructure as Code and scripting.
• Proficiency in scripting languages like PowerShell or Python.
• Understanding of DevOps practices and CI/CD pipelines.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure services (ADF, Databricks, SQL Database, Synapse).
• Design, implement, and manage cloud-based applications on Azure.
• Develop Infrastructure as Code to automate provisioning and management of resources.
• Write and maintain scripts for automation and deployment.
• Monitor and optimize cloud resources for performance and cost efficiency.
• Collaborate with DevOps and security teams to ensure best practices in cloud architecture.
• Troubleshoot and resolve issues related to Azure services and infrastructure.

Skills

Azure services

Cloud architecture

Azure Data Factory

Azure Synapse

Databricks

Python

PowerShell

Terraform

ARM templates

SQL

Tools

Terraform

ARM templates

Job description

Job Description

We are seeking an experienced and motivated Azure Data Engineer to join our vibrant team. The successful candidate will play a crucial role in designing, implementing, and maintaining data pipelines, databases, and data analytics solutions on the Azure cloud platform. The role requires strong technical expertise in Azure services and a deep understanding of data engineering principles. The ideal candidate requires extensive experience in designing, deploying, and managing cloud-based solutions on Microsoft Azure. Work closely with our DevOps and security teams to create scalable, secure, and efficient cloud infrastructure that meets our business needs.

Requirements

• 3+ years of experience in Azure cloud development and management.
• Proficiency in Azure services such as Azure Virtual Machines, Azure Storage, and Azure Networking.
• Experience with Infrastructure as Code tools like Azure Resource Manager (ARM) templates or Terraform.
• Strong scripting skills in PowerShell, Python, or similar languages.
• Understanding of DevOps practices and CI/CD pipelines.

Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines using Azure services such as Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics.
• Design, implement, and manage cloud-based applications using Azure services.
• Develop Infrastructure as Code to automate the provisioning and management of cloud resources.
• Write and maintain scripts for automation and deployment.
• Monitor and optimize cloud resources for performance and cost efficiency.
• Collaborate with DevOps and security teams to ensure best practices in cloud architecture.
• Troubleshoot and resolve issues related to Azure services and infrastructure.

Must-Have Skills

• Strong knowledge of Azure services and cloud architecture.
• Azure, Databricks, Azure Data Factory(ADF), Azure Synapse, Cloud Computing, Spark, PySpark, Python, Scala, Java, Hive, SQL.
• Strong understanding of Azure data services, including Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake Storage.
• Experience with Infrastructure as Code (e.g., ARM templates, Terraform).
• Proficiency in scripting languages like PowerShell or Python.
• Understanding of security best practices in the cloud.
• Excellent problem-solving skills and attention to detail.
• Azure certifications (e.g., AZ-104, AZ-303) are a plus

Soft Skills

• Problem-Solving
• Communication Skills
• Analytical Thinking
• Attention to Detail
• Adaptability
• Hard Skills:
• Azure Services (e.g., Virtual Machines, Storage, Networking)
• Cloud Architecture
• DevOps Practices
• Scripting (e.g., PowerShell, Python)
• Infrastructure Management (e.g., ARM templates, Terraform)

Salary Range: $110,000-$120,000 a year