Senior Data Consultant

HCLTech; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

HCLTech seeks a Senior Data Lead to design, build, and optimize scalable data platforms enabling enterprise analytics and BI. You will drive cloud-based data solutions, automation, and governance across complex datasets, applying best practices in data engineering and software development.

The role emphasizes platform ownership, collaboration with cross-functional teams, and delivering reliable, secure data services in a modern Azure-centric environment.

Qualifications

• Strong proficiency in Python for data engineering and automation.
• Extensive experience with Azure Databricks and modern data processing frameworks.
• Deep expertise in Azure Cloud Services and cloud-native data architectures.
• Solid understanding of Azure Data Factory (ADF) and data warehousing platforms like Snowflake.
• Proven experience with Azure DevOps, Git, and CI/CD pipeline implementation.
• Competency in designing scalable data pipelines and models and data governance.

Responsibilities

• Build, design, and maintain scalable data pipelines and models for analytics and BI.
• Implement robust data ingestion and transformation for structured and unstructured data.
• Develop and manage fully automated CI/CD pipelines for data solutions.
• Lead Infrastructure-as-Code practices for reliable data delivery.
• Apply software engineering best practices to solve large-scale data engineering challenges.
• Own and optimize data platforms for scale, security, and reliability; monitor pipelines and platforms.
• Enforce data governance, compliance, and security across the data lifecycle.
• Document data engineering standards and collaborate with Data Scientists, Analysts, Product Owners and Architects.

Skills

Python for data engineering

Azure Databricks

Azure cloud services

Azure Data Factory

Snowflake

Azure DevOps

Git

CI/CD pipelines

Data governance

Data modeling

ETL/ELT

Automation

Education

Bachelor's or Master's degree in Computer Science/Engineering/IT

Azure/Databricks certifications

Tools

Azure Databricks

Snowflake

Azure Data Factory

Git

CI/CD pipelines

Azure DevOps

Job description

Location

Introduction to the Organization

HCLTech is a global leader in technology and IT services, renowned for its innovative solutions and commitment to driving digital transformation across industries. With operations in over 50 countries, HCLTech empowers enterprises through cutting-edge technology, deep industry expertise, and a culture rooted in collaboration, integrity, and excellence. Its award-winning services span IT infrastructure, engineering, digital consulting, and next-generation technologies, positioning HCLTech as a trusted partner for Fortune 500 companies worldwide.

Overview of the Role

The Senior Data Lead will play a pivotal role in designing, building, and optimizing scalable data solutions that fuel enterprise analytics and strategic decision-making. This position focuses on leveraging modern cloud platforms, automation, and data governance to ensure high-quality, reliable, and innovative data systems. The successful candidate will drive the evolution of HCLTech's data platforms, directly influencing the company’s ability to deliver advanced analytics and business intelligence capabilities.

Detailed Responsibilities:

• Build & Model Data Solutions: Design, develop, and maintain scalable data pipelines and models supporting analytics, reporting, and BI initiatives.
• Data Ingestion & Transformation: Implement robust solutions for structured and unstructured data, ensuring quality, consistency, and reliability.
• Automation & Deployment: Develop and manage fully automated CI/CD pipelines, enabling efficient testing, deployment, and monitoring of data solutions.
• Infrastructure-as-Code: Lead deployment automation practices to ensure efficient and reliable data delivery.
• Innovation & Continuous Improvement: Apply software engineering best practices to overcome complex data engineering challenges and introduce innovative solutions for large-scale data processing.
• Platform Ownership: Optimize data platforms for scalability, performance, security, and reliability; monitor and troubleshoot pipelines, workflows, and platform components.
• Data Governance & Compliance: Enforce data governance, compliance, and security standards throughout the data lifecycle.
• Collaboration & Documentation: Establish data engineering standards, maintain clear technical documentation, and collaborate with cross-functional teams including Data Scientists, Analysts, Product Owners, and Architects.

Skill Requirement:

Technical Skills

• Strong proficiency in Python for data engineering and automation.
• Extensive hands-on experience with Azure Databricks and modern data processing frameworks.
• Deep expertise in Azure Cloud Services and cloud-native data architectures.
• Solid understanding of Azure Data Factory (ADF), Snowflake, and related data warehousing platforms.
• Proven experience with Azure DevOps, Git, and CI/CD pipeline implementation.
• Competency in designing and maintaining scalable data pipelines and models.
• Knowledge of ETL/ELT processes, data lifecycle management, and data governance best practices.

Professional Skills

• Exceptional analytical and problem-solving abilities.
• Software engineering mindset with focus on clean, maintainable, reusable code.
• Strong troubleshooting and debugging skills.
• Excellent communication and documentation capabilities.
• Collaborative approach in agile, cross-functional environments.

Educational Background & Certifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or related field.
• Relevant certifications in Azure, Databricks, or data engineering are highly desirable.

Other Requirements (Optional)

• Experience with enterprise-scale data platforms and processing large datasets.
• Familiarity with Infrastructure-as-Code (IaC) and cloud automation practices.
• Knowledge of monitoring, observability, and performance optimization techniques.
• Experience in Agile/Scrum delivery models.