Data Migration Specialist – SQL DWH to Cloudera CDP

Dixp; Delhi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Dixp is seeking a Data Migration Specialist to move Data Warehouse workloads from SQL-based platforms to Cloudera Data Platform (CDP). You will migrate tables, schemas, queries, and ETL workloads, ensuring performance, accuracy, and scalability across Hive, Impala, and Spark.

The role requires hands-on experience with SQL-based warehouses, data migration strategies, and validation. Collaboration with data engineers and Cloudera admins is essential for successful go-lives.

Qualifications

• 5–8 years of experience in Data Warehousing, SQL development, and migration projects.
• Experience migrating data warehouse workloads to big data environments.
• Ability to translate queries and optimize performance during migration.

Responsibilities

• Plan and execute migration of data warehouse tables, schemas, and datasets to Cloudera CDP.
• Convert and optimize SQL queries for Hive/Impala.
• Validate data integrity and performance of migrated workloads.
• Document migration strategies and transformation rules.

Skills

SQL

Data Warehousing

Migration

Performance tuning

Education

Bachelor's degree in CS/DE/IS

Tools

Cloudera CDP

Hive

Impala

Spark

Airflow

Teradata

Oracle

SQL Server

Job description

Data Migration Specialist – SQL DWH to Cloudera CDP

Experience: 5 - 8 yrs

Job Type: Full-Time / Contract

Education:

• UG: B.Tech/B.E. in Computer Science, Data Engineering, Information Systems, or a related field

Job Description

Project Role Description: We are seeking an experienced Data Migration Specialist to support migration of Data Warehouse workloads from SQL-based platforms to Cloudera Data Platform (CDP). The candidate will be responsible for migrating database tables, schemas, SQL queries, and ETL workloads to the Cloudera ecosystem (Hive, Impala, Spark) while ensuring performance, accuracy, and scalability. The role requires strong expertise in SQL-based data warehouses, big data technologies, and data migration strategies, along with hands-on experience in query translation, workload migration, and performance tuning.

Key Responsibilities:

Data Warehouse Migration

• Plan and execute migration of data warehouse tables, schemas, and datasets from SQL-based platforms to Cloudera CDP.
• Analyze existing DWH structures, dependencies, and workloads before migration.
• Design strategies for data migration, schema conversion, and workload optimization.

SQL & Query Migration

• Convert and optimize SQL queries from traditional databases to Hive or Impala compatible queries.
• Ensure functional equivalence and performance optimization of migrated queries.
• Validate query outputs to ensure data accuracy and consistency.
• Migrate ETL workflows and batch workloads to Spark or Hive-based pipelines.
• Implement best practices for distributed processing and query performance.
• Optimize workloads to run efficiently on Cloudera clusters.

Data Validation & Testing

• Perform data reconciliation and validation between source and target systems.
• Conduct performance testing and tuning for migrated workloads.l>
• Ensure data quality and integrity post migration.
• Work closely with data engineers, architects, and Cloudera administrators.
• Support teams during migration planning, testing, and go-live phases.
• Provide troubleshooting support for migration-related issues.

Documentation

• Document migration strategies, transformation logic, and query conversion rules.
• Maintain documentation for data lineage, mapping, and validation processes.

Qualifications:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field.
• 5–8 years of experience in Data Warehousing, SQL development, and migration projects.

Required Skills:

• Strong expertise in SQL and relational data warehouse platforms.
• Hands-on experience with Cloudera Data Platform (CDP), Hive, and Impala.
• Experience migrating tables, schemas, queries, and workloads to big data environments.
• Knowledge of Spark for data processing and transformation.
• Experience with data validation, reconciliation, and performance tuning.
• Understanding of distributed data processing architectures.

Preferred Skills:

• Experience migrating from platforms such as Teradata, Oracle, SQL Server, or other enterprise DWH systems to Hadoop/Cloudera.
• Familiarity with data pipeline orchestration tools such as Airflow.
• Knowledge of data warehouse design and lakehouse architectures.
• Experience with automation or scripting (Python, Shell) for migration activities.