Teradata Migration Consultant

Celebal Technologies; Hyderabad, Gurugram District, Bengaluru; On-site; INR 1,400,000 - 2,300,000; Full time

Job summary

Celebal Technologies in Hyderabad, India seeks a senior data migration specialist to lead Teradata-to-Databricks transitions. You will evaluate Teradata structures, design Databricks-based pipelines, and implement Delta Lake with Unity Catalog for secure governance.

The role emphasizes PySpark expertise, Lakehouse architecture know-how and hands-on modernization of legacy ETL workflows, ensuring scalable, cost-effective Databricks workloads and successful production cutovers.

Qualifications

• Strong hands-on experience in Teradata-to-Databricks migration.
• Deep knowledge of Databricks, Delta Lake and Unity Catalog.
• Proficiency in PySpark / Spark SQL and data warehousing concepts.
• Experience in ETL/ELT modernization and data validation.

Responsibilities

• Lead and execute Teradata-to-Databricks migration projects.
• Analyze Teradata databases, SQL logic, and ETL workflows.
• Design migration solutions on Databricks Lakehouse.
• Develop scalable data pipelines using PySpark and Databricks.
• Build and optimize data processing with Delta Lake.
• Implement data governance and access control using Unity Catalog.
• Modernize legacy ETL; migrate to Databricks-based pipelines.
• Quality checks, migration validation and performance testing.
• Optimize Databricks workloads for performance and cost.
• Support cutover, deployment and post-migration stabilization.
• Collaborate with architects and stakeholders; mentor juniors.

Skills

Teradata-to-Databricks migration

Databricks

PySpark / Spark SQL

Delta Lake

Unity Catalog

ETL/ELT modernization

SQL & data warehousing

Data migration & validation

Lakehouse architecture

Tools

CI/CD

Git

Job description

Key Responsibilities

• Lead and execute Teradata-to-Databricks migration projects.
• Analyze existing Teradata databases, tables, views, SQL logic, stored procedures and ETL workflows.
• Design and implement migration solutions on Databricks Lakehouse.
• Develop scalable data pipelines using PySpark and Databricks.
• Build and optimize data processing using Delta Lake.
• Implement data governance, security and access control using Unity Catalog.
• Modernize legacy ETL processes and migrate them to Databricks-based pipelines.
• Perform source-to-target mapping, data transformation and reconciliation.
• Conduct migration validation, data quality checks and performance testing.
• Optimize Databricks workloads for performance, scalability and cost.
• Support migration cutover, production deployment and post-migration stabilization.
• Collaborate with architects, business stakeholders and engineering teams to resolve migration challenges.
• Provide technical guidance to junior team members and contribute to migration best practices.

Mandatory Skills

• Strong hands-on experience in Teradata-to-Databricks migration.
• Strong Databricks experience.
• Strong PySpark / Spark SQL skills.
• Strong knowledge of Delta Lake.
• Hands-on experience with Unity Catalog.
• Experience in ETL/ELT modernization.
• Strong SQL and data warehousing concepts.
• Experience with data migration, reconciliation and validation.
• Good understanding of Lakehouse architecture.

Preferred Experience

• Experience with Teradata SQL, stored procedures and legacy ETL workloads.
• Experience with Bronze/Silver/Gold or Medallion architecture.
• Experience with Databricks Workflows / Jobs / DLT.Experience with CI/CD and Git-based deployment.
• Experience with Azure/AWS/GCP cloud data platforms.
• Experience in performance tuning and optimization of Spark/Databricks workloads.

Ideal Candidate

Candidates who have personally executed Teradata-to-Databricks migration projects will be strongly preferred over candidates who only have generic Databricks development experience.