Databricks Team Lead

NTT DATA BUSINESS SOLUTIONS; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

NTT DATA BUSINESS SOLUTIONS invites a Databricks Team Lead to guide hands-on migration of Snowflake workloads, including discovery, Lakebridge analysis, and conversion support. You will implement Databricks SQL and PySpark pipelines, move Python jobs, and validate SIT/QA/PROD readiness.

Lead a team through automated and manual remediation, document conversion patterns, and ensure deployment integrity while collaborating with stakeholders in Bengaluru and wider teams.

Qualifications

• Experience migrating Snowflake workloads and implementing Databricks SQL/PySpark
• Proficiency with SQL, Delta Lake, and Airflow in data engineering
• Familiarity with CI/CD practices and Git-based development workflows

Responsibilities

• Lead hands-on migration activities for Snowflake workloads and Databricks implementations.
• Oversee discovery, conversion analysis, and remediation for lakehouse assets.
• Coordinate Python job migrations and Airflow DAG updates for Databricks.
• Ensure SIT/QA/PROD readiness and deployment verification for migrations.

Skills

Snowflake

Databricks SQL

PySpark

Python

Delta Lake

Airflow

SQL

Git-based development

CI/CD concepts

Job description

Job Summary

Databricks Team Lead will lead hands-on technical migration activities for assigned Snowflake workloads, including discovery, Lakebridge analysis and conversion support, Snowflake SQL remediation, Databricks SQL and PySpark implementation, pipeline conversion, data movement support, reconciliation, and defect resolution across SIT, QA, PROD readiness, and hypercare.

Operate Lakebridge and support automated code conversion for eligible Snowflake workloads, SQL assets, jobs, and transformation logic.

Perform discovery of source assets, workload dependencies, job characteristics, and conversion readiness for assigned systems or domains.

Analyze conversion outputs, identify defects or unsupported patterns, and implement manual remediation where required.

Support migration of Python jobs for LZ data sourcing and assist with Airflow DAG repointing to Databricks jobs.

Implement Databricks-aligned data engineering components using approved project structure, coding standards, and deployment practices.

Support SIT, QA, and PROD readiness through technical validation, defect fixes, reconciliation support, and deployment verification.

Document conversion patterns, remediation decisions, technical exceptions, and handoff notes for operational support teams.

Responsibilities Required Skills and Experience

• Snowflake
• Databricks SQL
• PySpark
• Python
• Delta Lake
• Airflow
• SQL
• Git-based development
• CI/CD concepts