Azure Data Technical Specialist

HCL Technologies Limited; Sydney; On-site; AUD 120,000 - 150,000; Full time

Job summary

HCL Technologies Limited is seeking a Technical Specialist to oversee Azure Data Factory (ADF), Azure Databricks, SQL and Python data processing. You will design, develop, and maintain data pipelines and ETL workflows on the Azure cloud platform to optimize data transformation and storage.

Responsibilities include building scalable pipelines, writing optimized SQL queries, and developing automation scripts.

Qualifications

• Proficiency in Azure Data Factory for data integration and orchestration.
• Experience with Azure Databricks for data engineering and analytics.
• Strong SQL skills for data querying.
• Proficient in Python for data processing and automation.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Ability to adapt to changing priorities and manage multiple tasks.

Responsibilities

• Design, develop, and implement data pipelines using Azure Data Factory to move data between various sources and data warehouses.
• Utilize Azure Databricks for data transformations and analytics to derive valuable insights from data.
• Write and optimize SQL queries to extract, manipulate, and analyze data from multiple sources.
• Develop and maintain Python scripts for data processing and automation tasks.
• Collaborate with cross-functional teams to understand data requirements and ensure data solutions meet business needs.
• Monitor data pipeline performance and troubleshoot issues to ensure data accuracy and reliability.
• Stay updated on industry trends and best practices related to Azure Data Factory, Azure Databricks, SQL, and Python.

Skills

Azure Data Factory

Azure Databricks

SQL

Python

Analytical thinking

Communication

Team collaboration

Prioritization

Job description

The Technical Specialist will be responsible for overseeing the Azure Data Factory (ADF), Azure Databricks, SQL, Python processes. They will play a key role in designing, developing, and maintaining data pipelines and ETL processes, leveraging the Azure cloud platform and related technologies to ensure optimized data transformation and storage.

Key Responsibilities

• 1. Design, develop, and implement data pipelines using azure data factory (adf) to move data between various sources and data warehouses.
• 2. Utilize azure databricks for data transformations and analytics to derive valuable insights from data.
• 3. Write and optimize sql queries to extract, manipulate, and analyze data from multiple sources.
• 4. Develop and maintain python scripts for data processing and automation tasks.
• 5. Collaborate with cross functional teams to understand data requirements and ensure data solutions meet business needs.
• 6. Monitor data pipeline performance and troubleshoot issues to ensure data accuracy and reliability.
• 7. Stay updated on industry trends and best practices related to azure data factory, azure databricks, sql, and python.

Skill Requirements

• 1. Proficiency in azure data factory (adf) for data integration and orchestration.
• 2. Experience working with azure databricks for data engineering and analytics.
• 3. Strong sql skills for data querying and manipulation.
• 4. Proficient in python programming for data processing and automation.
• 5. Strong analytical and problem-solving skills with a high attention to detail.
• 6. Excellent communication and collaboration abilities to work effectively in a team environment.
• 7. Ability to adapt to changing priorities and handle multiple tasks simultaneously.

Other Requirements

• 1.Azure Data Factory, Azure Databricks, SQL, or Python certifications are a plus.

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026totaled $14.8billion.