Azure Databricks Architect

Tata Consultancy Services; Bengaluru; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking an experienced Azure Databricks Architect to design secure, scalable data platforms on Microsoft Azure, combining hands-on engineering with architectural leadership.

You will build ETL/ELT pipelines with Azure Databricks and Data Factory, optimize data lakes and warehouses using Synapse Analytics and ADLS, and mentor teams while aligning solutions with business requirements.

Qualifications

• 12–16 years of relevant experience.
• Proficient with Azure Data Factory, Synapse and Data Lake Storage.
• Deep understanding of data warehousing concepts and design.

Responsibilities

• Build scalable ETL/ELT pipelines using Azure Databricks and Data Factory.
• Design and optimize data lake and warehouse solutions with Synapse and ADLS.
• Develop high-performance data processing with PySpark and Python.
• Drive data quality, security, governance, performance, and optimization.
• Translate business requirements into technical solutions.
• Mentor development teams and provide architectural guidance.
• Troubleshoot production issues and promote cloud data architecture best practices.

Skills

Azure Databricks

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

PySpark

Python

SQL

Data warehousing

Cloud architecture

Stakeholder management

Job description

Are you passionate about architecting secure, scalable, enterprise-grade data platforms on Microsoft Azure?

Tata Consultancy Services is looking for experienced Azure Databricks Architects who can combine hands-on engineering expertise with architectural leadership to deliver high-impact data and analytics solutions.

What You’ll Do

• Build scalable ETL and ELT pipelines using Azure Databricks and Azure Data Factory
• Design and optimize data lake and warehouse solutions using Azure Synapse Analytics and ADLS
• Develop high-performance data-processing solutions using PySpark and Python
• Drive data quality, security, governance, performance, and optimization
• Translate business requirements into effective technical solutions
• Mentor development teams and provide architectural guidance
• Troubleshoot production issues and promote cloud data architecture best practices

Mandatory Requirements

• 12 to 16 years of relevant experience
• Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage
• Data warehousing concepts and enterprise data-platform design
• PySpark, Python, and SQL performance tuning
• Azure cloud architecture patterns and best practices

Preferred Requirements

• Strong analytical, communication, and stakeholder-management skills