Data Migration Specialist – SQL DWH to Cloudera CDP

DIXP; Delhi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Dixpai is seeking a Data Migration Specialist to migrate Data Warehouse workloads from SQL-based platforms to Cloudera CDP. You will translate SQL, transform schemas, and optimize workloads for Hive/Impala on Cloudera clusters. The role requires 5–8 years in DWH, SQL development, and migration projects.

You will validate data quality, coordinate with data engineers and Cloudera admins, and ensure smooth go-live phases with robust documentation.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field.
• 5–8 years of experience in Data Warehousing, SQL development, and migration projects.

Responsibilities

• Plan and execute migration of data warehouse tables, schemas, and datasets from SQL-based platforms to Cloudera CDP.
• Analyze existing DWH structures, dependencies, and workloads before migration.
• Design strategies for data migration, schema conversion, and workload optimization.
• Convert and optimize SQL queries from traditional databases to Hive or Impala compatible queries.
• Ensure functional equivalence and performance optimization of migrated queries.
• Migrate ETL workflows and batch workloads to Spark or Hive-based pipelines.
• Perform data reconciliation and validation between source and target systems.
• Conduct performance testing and tuning for migrated workloads.
• Document migration strategies, transformation logic, and query conversion rules.

Skills

SQL & DWH

CDP/Hive/Impala

Data migration

Performance tuning

Data validation

Spark

Airflow

Education

Bachelor's degree in Computer Science or related

Tools

CDP

Hive

Impala

Spark

Airflow

Job description

Data Migration Specialist – SQL DWH to Cloudera CDP

Experience: 5 - 8 yrs

Job Type: Full-Time / Contract

Education:

• UG: B.Tech/B.E. in Computer Science, Data Engineering, Information Systems, or a related field

Job Description

Project Role Description: We are seeking an experienced Data Migration Specialist to support migration of Data Warehouse workloads from SQL-based platforms to Cloudera Data Platform (CDP). The candidate will be responsible for migrating database tables, schemas, SQL queries, and ETL workloads to the Cloudera ecosystem (Hive, Impala, Spark) while ensuring performance, accuracy, and scalability. The role requires strong expertise in SQL-based data warehouses, big data technologies, and data migration strategies, along with hands-on experience in query translation, workload migration, and performance tuning.

Key Responsibilities:

Data Warehouse Migration

• Plan and execute migration of data warehouse tables, schemas, and datasets from SQL-based platforms to Cloudera CDP.
• Analyze existing DWH structures, dependencies, and workloads before migration.
• Design strategies for data migration, schema conversion, and workload optimization.

SQL & Query Migration

• Convert and optimize SQL queries from traditional databases to Hive or Impala compatible queries.
• Ensure functional equivalence and performance optimization of migrated queries.
• Validate query outputs to ensure data accuracy and consistency.
• Migrate ETL workflows and batch workloads to Spark or Hive-based pipelines.
• Implement best practices for distributed processing and query performance.
• Optimize workloads to run efficiently on Cloudera clusters.

Data Validation & Testing

• Perform data reconciliation and validation between source and target systems.
• Conduct performance testing and tuning for migrated workloads.
• Ensure data quality and integrity post migration.
• Work closely with data engineers, architects, and Cloudera administrators.
• Support teams during migration planning, testing, and go-live phases.
• Provide troubleshooting support for migration-related issues.

Documentation

• Document migration strategies, transformation logic, and query conversion rules.
• Maintain documentation for data lineage, mapping, and validation processes.

Qualifications:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field.
• 5–8 years of experience in Data Warehousing, SQL development, and migration projects.

Required Skills:

• Strong expertise in SQL and relational data warehouse platforms.
• Hands-on experience with Cloudera Data Platform (CDP), Hive, and Impala.
• Experience migrating tables, schemas, queries, and workloads to big data environments.
• Knowledge of Spark for data processing and transformation.
• Experience with data validation, reconciliation, and performance tuning.
• Understanding of distributed data processing architectures.

Preferred Skills:

• Experience migrating from platforms such as Teradata, Oracle, SQL Server, or other enterprise DWH systems to Hadoop/Cloudera.
• Familiarity with data pipeline orchestration tools such as Airflow.
• Knowledge of data warehouse design and lakehouse architectures.
• Experience with automation or scripting (Python, Shell) for migration activities.