Senior Data Lead: Redshift to Databricks Migration

HCLTech; Chicago (IL); Vor Ort; USD 110.000 - 170.000; Vollzeit

Zusammenfassung

HCL Technologies Limited seeks experienced Data Engineers to lead the migration of large-scale analytical workloads from Amazon Redshift to Databricks Lakehouse Platform. The role focuses on data warehouse modernization, ETL/ELT migration, performance optimization, and cloud-native architectures.

You will design and implement scalable data solutions using Databricks, Delta Lake, and Spark, while converting SQL-based ETL/ELT processes into notebooks and pipelines, and ensuring data quality and

Qualifikationen

• Experience with large-scale data warehousing and data lake architectures.
• Hands-on experience with Redshift and Databricks.
• Expertise in PySpark, Spark SQL, and Python.
• Strong SQL development and query optimization skills.
• Experience with data modeling and ETL/ELT migrations.

Aufgaben

• Lead migration of data pipelines, models, and reporting workloads from Redshift to Databricks.
• Assess existing Redshift environments, schemas, workloads, and dependencies.
• Design and implement scalable data solutions using Databricks, Delta Lake, and Spark.

Kenntnisse

Data warehousing

ETL/ELT migration

SQL optimization

Big data processing

Cloud-native architectures

Spark/PySpark

Tools

Amazon Redshift

Databricks

PySpark

Spark SQL

Python

Delta Lake

Jobbeschreibung

HCL Technologies Limited seeks experienced Data Engineers to lead the migration of large-scale analytical workloads from Amazon Redshift to Databricks Lakehouse Platform. The role focuses on data warehouse modernization, ETL/ELT migration, performance optimization, and cloud-native architectures.

You will design and implement scalable data solutions using Databricks, Delta Lake, and Spark, while converting SQL-based ETL/ELT processes into notebooks and pipelines, and ensuring data quality and