Senior Azure Databricks Data Engineer

HCLTech; Poland; On-site; PLN 240,000 - 400,000; Full time

Job summary

HCLTech is seeking a Senior Azure Databricks Data Engineer to design, build, and optimize large-scale data platforms on Microsoft Azure. You will develop scalable data pipelines, drive enterprise BI initiatives, and empower global clients with robust analytics capabilities.

Responsibilities include implementing end-to-end data solutions, performance tuning, and collaborating with architects, analysts, and stakeholders.

Qualifications

• 8–12 years of experience in Data Engineering and ETL Development.
• 7+ years hands-on experience with Azure Databricks.
• Strong Python and PySpark proficiency.
• 7+ years advanced SQL, including optimization.
• Experience designing complex ETL processes and data workflows.
• Experience with large-scale enterprise data ecosystems.

Responsibilities

• Design, develop, and maintain robust data pipelines with Azure Databricks and PySpark.
• Build scalable ETL/ELT solutions across diverse data domains.
• Translate business requirements into robust data engineering solutions.
• Develop and optimize data transformation frameworks for high performance.
• Tune performance of Databricks workloads and SQL queries.
• Architect data ingestion, transformation, and integration across cloud and hybrid environments.
• Collaborate with solution architects, analysts, and stakeholders to deliver end-to-end data platforms.
• Enforce data quality, governance, security, and operational excellence.
• Support CI/CD, DevOps, and cloud deployment activities.
• Mentor junior engineers and drive technical excellence.

Skills

Azure Databricks

Python

PySpark

SQL

ETL

Data engineering

Data transformations

Mentoring

Education

Bachelor's degree in CS/Engineering/IT

Tools

Azure DevOps

CI/CD

Delta Lake

Synapse Analytics

Azure Data Factory

Job description

HCLTech is a global technology company, home to more than 227,000 people across 60 countries, delivering industry-leading capabilities centered around AI, digital, engineering, cloud and software, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology & Services, Semiconductor, Telecom and Media, Retail and CPG, Mobility and Public Services. Consolidated revenues as of 12 months ending March 2026 totaled $14.7B.

To learn how we can supercharge progress for you, visit hcltech.com.

Overview of the Role

As a Senior Azure Databricks Data Engineer at HCLTech, you will play a pivotal role in designing, developing, and optimizing large-scale data platforms and modern data pipelines on Microsoft Azure. This position is critical for advancing our enterprise data analytics, reporting, and business intelligence initiatives. You will contribute to the creation of scalable, high-performance data solutions that empower strategic decision-making and drive business growth across global clients.

Detailed Responsibilities:

• Design, develop, and maintain robust data pipelines utilizing Azure Databricks and PySpark to handle complex enterprise data requirements.
• Build scalable ETL/ELT solutions tailored for large-scale, heterogeneous data ecosystems across multiple business domains.
• Analyze business requirements and translate them into effective and sustainable data engineering solutions.
• Develop and optimize data transformation frameworks and workflows, ensuring high performance and reliability.
• Conduct performance tuning, troubleshooting, and optimization of Databricks workloads and SQL queries to maximize efficiency.
• Architect and implement data ingestion, transformation, and integration processes across cloud and hybrid environments.
• Collaborate closely with solution architects, business analysts, and key stakeholders to deliver end-to-end data platform solutions.
• Implement and enforce best practices around data quality, governance, security, and operational excellence.
• Support CI/CD, DevOps, and cloud deployment activities to ensure streamlined and automated data delivery.
• Mentor junior engineers and contribute to technical leadership within the team.

Skill Requirements

• 8-12 years of experience in Data Engineering and ETL Development.
• At least 7 years of hands-on experience with Azure Databricks.
• Strong proficiency in Python and PySpark frameworks/libraries.
• Minimum 7 years of advanced SQL experience, including query optimization and performance tuning.
• Minimum 7 years in designing and implementing complex ETL processes and data workflows.
• Deep understanding of data transformation frameworks and industry-standard patterns.
• Proven expertise in enterprise data ecosystems, including data storage, processing, visualization, and integration architectures.
• Experience managing and processing large-scale structured and unstructured datasets.
• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline.

Other Requirements:

• Expertise in Azure Data Factory (ADF) is a plus.
• Ability to read and analyze database execution plans.
• Experience with Azure DevOps and CI/CD cloud implementations.
• Familiarity with Configuration Management, Data Lake, Delta Lake, Synapse Analytics, and modern cloud data architectures.
• Azure certifications are highly preferred.
• Strong analytical, problem-solving, and communication skills.
• Experience in global delivery and customer-facing environments.
• Demonstrated ability to mentor junior engineers and drive technical excellence.
• Ownership mindset with a focus on quality and continuous improvement.

HCLTech is dedicated to nurturing talent and supporting career advancement.

As a Senior Azure Databricks Data Engineer, you will have access to:

• Global learning and development programs focused on next-generation technologies and leadership skills.
• Opportunities for promotion to Lead Data Engineer, Data Architect, or Solution Architect roles.
• Participation in industry conferences, certification programs, and specialized technical training.
• Involvement in high-impact projects with Fortune 500 clients and exposure to cutting-edge solutions.
• A culture that values innovation, encourages continuous improvement, and rewards high performance. Join HCLTech and advance your career in a dynamic, collaborative, and growth-oriented environment.