Azure Data Technical Specialist

HCL Technologies Limited; Chennai District; On-site; INR 3,200,000 - 6,800,000; Full time

Job summary

HCLTech is seeking a Senior Databricks Architect (E3.1) to own end-to-end data engineering solutions on Azure. You will design and deliver enterprise-grade data pipelines, lead technical discussions, and drive best practices with cross-functional teams.

The role emphasizes hands-on Databricks, SQL, Python, and Spark, with focus on performance, security, and scalable architectures to meet business needs and governance requirements.

Qualifications

• Azure Databricks implementation and optimization experience.
• ETL/ELT frameworks and data modeling knowledge.
• Strong SQL and relational DB concepts and queries.
• Experience in large‑scale data processing and performance tuning.
• Hands-on Python and Spark (PySpark) development.
• Experience in design discussions and architecture reviews.

Responsibilities

• Lead design and implementation of enterprise data solutions on Azure Databricks.
• Architect and optimize end‑to‑end data pipelines using ADF, Databricks, Synapse.
• Drive data ingestion, transformation, and integration across sources.
• Provide technical leadership to junior engineers and teams.
• Translate business needs into scalable data solutions.
• Ensure performance, cost efficiency, and reliability of data platforms.
• Implement CI/CD pipelines and governance using Azure DevOps.
• Ensure data quality, security, and compliance standards.
• Contribute to solution architecture and technical decision making.

Skills

Azure Databricks

ETL/ELT concepts

SQL & relational DBs

Performance tuning

Python & Spark (PySpark)

Solution design & architecture

Education

Bachelor’s degree in Computer Science / IT / related field

Job description

HCLTech is a global technology company delivering industry-leading digital, engineering, and cloud solutions. With a strong focus on innovation and customer success, HCLTech enables enterprises to transform through scalable, data-driven platforms.

Role Overview

As a Senior Databricks Architect (E3.1), you will take end-to-end ownership of designing and delivering advanced data engineering solutions on Azure. You will play a key role in architecting scalable data pipelines, leading technical discussions, and driving best practices across projects while working closely with business stakeholders and cross-functional teams.

Key Responsibilities

Key Responsibilities

• Lead the design and implementation of enterprise-grade data solutions using Azure Databricks
• Architect and optimize end-to-end data pipelines leveraging ADF, Databricks, and Synapse
• Drive data ingestion, transformation, and integration strategies across multiple data sources
• Provide technical leadership and guidance to junior engineers and project teams
• Engage with stakeholders to understand business needs and translate them into scalable solutions
• Optimize performance, cost, and reliability of Azure data platforms
• Implement CI/CD pipelines and governance using Azure DevOps
• Ensure adherence to data quality, security, and compliance standards
• Contribute to solution architecture, design reviews, and technical decision-making

Skill Requirements

Mandatory Skills

• Azure Databricks (advanced implementation & optimization)
• Deep understanding of ETL/ELT frameworks and data modeling concepts
• Advanced proficiency in SQL and relational databases
• Strong experience in performance tuning and large-scale data processing
• Hands-on experience with Python and Spark (PySpark preferred)
• Experience in solution design and architecture discussions

Preferred Skills

• Experience working in client-facing or consulting roles
• Exposure to data governance, security, and compliance frameworks
• Knowledge of real-time/streaming data processing (Kafka/Event Hub)
• Familiarity with Agile / Scrum methodologies
• Certification in Azure Data Engineering or Databricks is a plus

Educational Qualification

• Bachelor’s degree in Computer Science / IT / related field

Other Requirements

Skill Evaluation Matrix (E3.2 Expectations)

1.Relevant certifications in Azure Data Factory (ADF), Azure Databricks, SQL, Python are a plus.

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026totaled $14.8billion.