Databricks Technical Lead

Systems Plus; Pune District; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Systems Plus is seeking a Databricks Technical Lead in Pune to drive architecture, design and delivery of scalable data pipelines on the Databricks platform. You will act as a technical leader, mentor team members, and collaborate with client stakeholders to ensure production readiness.

The role requires strong hands-on experience with Azure Databricks, Spark, PySpark and SQL, and a deep understanding of data integration, modernization and Azure data services.

Qualifications

• Hands-on experience with Databricks stack and data engineering
• Strong understanding of modern data warehousing concepts
• Experience in designing scalable data pipelines and data processing workloads

Responsibilities

• Provide technical leadership and architectural guidance for Databricks and Data Platform
• Lead technical discussions and mentor engineers on complex issues
• Coordinate with client stakeholders and deliver production-ready solutions

Skills

Azure Databricks

Apache Spark

PySpark

SQL

Delta Lake

Medallion Architecture

ETL/ELT pipelines

Tools

Azure Data Factory

Azure Data Lake Storage

SQL Server

Job description

Databricks Technical Lead

Location: Pune Employment Type: full-time Designation: Databricks Technical Lead

• Strong hands-on experience in Azure Databricks, Apache Spark, PySpark and SQL.
• Strong understanding of Delta Lake, Medallion Architecture, ETL/ELT pipelines and modern data engineering practices.
• Experience in designing, developing and supporting scalable data pipelines and data processing workloads on Databricks.
• Strong experience in performance tuning, optimization and troubleshooting of Spark jobs, clusters and data pipelines.
• Experience in handling production support, complex incidents, root cause analysis and problem management in Databricks/Data Platform environments.
• Ability to provide technical leadership and architectural guidance for the Databricks and overall Data Platform landscape.
• Strong knowledge of Azure Data Factory, Azure Data Lake Storage and related Azure Data Services.
• Experience in integrating Databricks with enterprise data warehouses, databases and upstream/downstream applications.
• Good understanding of data warehousing, dimensional modeling and enterprise data integration concepts.
• Experience in code review, release management, deployment and production readiness activities.
• Ability to support minor enhancements, continuous improvements and ongoing platform modernization initiatives.
• Experience in leading technical discussions, mentoring engineers and guiding teams on complex technical issues.
• Ability to work directly with client stakeholders and technical teams on priorities, issues and technical decisions.
• Strong communication and stakeholder management skills, with the ability to work independently in a client-facing environment.
• Willingness to provide support during US business hours, including availability for critical production issues as required.
• Experience in retail or a similar data-intensive enterprise environment.
• Experience with legacy EDW/SQL Server environments is an added advantage.