Track Lead - Extract Transform Load (ETL), Data Lakes

HCLTech

India

On-site

INR 900,000 - 1,400,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

HCL Technologies Limited invites a Senior Data Engineer to lead the migration of an Oracle-based data warehouse to Databricks on the Allianz Data Platform. You will design the target model, build ETL/ELT pipelines, and ensure data quality for advanced analytics and AI use cases.

You will translate Oracle logic to Databricks Spark SQL and PySpark, collaborating with the Enterprise Architect and platform team to align with standards. Strong stakeholder management is essential.

Qualifications

  • Graduate or Postgraduate in Engineering or a Post graduate in non-engineering disciplines.
  • 5-9 years of ITIL/process/deployment experience.
  • Basic knowledge on database and data warehousing concepts.
  • Hands-on Databricks (Spark SQL, PySpark, Delta Lake).
  • Experience with Oracle DWH migrations and PostgreSQL integration.

Responsibilities

  • Analyse current Oracle data warehouse and design target model in Databricks.
  • Build and optimise ETL/ELT pipelines to migrate tables and datamarts from Oracle to Databricks.
  • Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark with performance in mind.
  • Ensure data quality, performance, and reliability of the Databricks data warehouse.
  • Collaborate with architects, platform team, and stakeholders; document migration patterns and models.

Skills

Databricks
Spark SQL
PySpark
Delta Lake
ETL/ELT
Data warehousing
Oracle SQL
PL/SQL
PostgreSQL
SAS

Education

Graduate or Postgraduate in Engineering or Postgraduate in non-engineering disciplines

Tools

SAS
Oracle DWH

Job description

Career Opportunities: Track Lead - Extract Transform Load (ETL), Data Lakes (186931)

Requisition ID186931-Posted10/29/2026

We are looking for a Senior Data Engineer with strong Databricks, SQL and data warehousing experience to lead the migration of an existing Oracle-based data warehouse to Databricks on the Allianz Data Platform (ADP). Experience with modern data engineering practices and AI-enabling data platforms is highly desirable.

Key Responsibilities

Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETL–generated structures) and design the target model in Databricks.

  • Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks.
  • Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation.
  • Ensure data quality, performance, and reliability of the new Databricks-based data warehouse, enabling downstream analytics and AI/ML use cases.
  • Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices.
  • Document migration patterns, data models, and operational procedures to support long-term maintainability and reusability.
Skill Requirements

Graduate or Postgraduate in Engineering or a Post graduate in non-engineering disciplines.

  • Experience of 5-9 years of experience in ITIL process/application support/Deployment activities.
  • Basic knowledge on database
  • Strong hands-on experience with Databricks (Spark SQL, PySpark, Delta Lake, jobs, clusters).
  • Proven background in data warehousing (dimensional modelling, ETL/ELT, performance tuning).
  • Solid experience with Oracle DWH (SQL, PL/SQL) and migrations from Oracle or similar legacy DWH platforms.
  • Experience integrating PostgreSQL as a data source into a central DWH/Lakehouse.
  • Ability to reverse-engineer existing ETL logic (e.g. SAS jobs) and translate it into Databricks pipelines, even if not directly working on SAS BI reports.
  • Strong communication and stakeholder management skills in an international, multi-vendor setup.
  • Good understanding of how high-quality, well-modelled data underpins advanced analytics and AI/ML capabilities.
Other Requirements

Strong Analytical, Logical and Communication Skills (written, oral, one to one etc).

  • Professional, Innovative, Drive for continuous improvement.
  • Positive attitude, proactively provides solutions
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Walk-in | Data Engineer
Walk-in | Data Engineer

CODERS BRAIN • Pune District

Hybrid
INR 2,500,000 - 4,000,000
Data Architect with Databricks
Data Architect with Databricks

Unique Erp Technologies • Hyderabad

On-site
INR 1,800,000 - 4,000,000
Senior Consultant (Databricks)
Senior Consultant (Databricks)

Unison Group • India

On-site
INR 4,000,000 - 7,000,000
Senior Data Engineer (Databricks Lead)
Senior Data Engineer (Databricks Lead)

Prodapt Solutions • Bengaluru

On-site
INR 4,000,000 - 8,000,000
Sr. Data / Data Solutions Architect - Databricks
Sr. Data / Data Solutions Architect - Databricks

EPAM Systems Inc • Hyderabad, Chennai District, Bengaluru

On-site
INR 3,500,000 - 7,000,000
Senior Data Engineer (Databricks Lead)
Senior Data Engineer (Databricks Lead)

Prodapt Solutions Private Limited • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Senior Data Engineer
Senior Data Engineer

CoffeeBeans • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Databricks Data Specialist - R01569707
Databricks Data Specialist - R01569707

Brillio • Bengaluru

On-site
INR 1,200,000 - 2,400,000
Senior Data Architect
Senior Data Architect

Tredence Inc. • Bengaluru

On-site
INR 2,400,000 - 4,800,000
Technical Lead (Databricks)
Technical Lead (Databricks)

UNAVAILABLE • Pune District

On-site
INR 3,500,000 - 5,200,000