Data Engineering (Modernization/Migration) Lead

Kumaran Systems

Chennai

Hybrid

INR 900,000 - 1,500,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kumaran Systems is seeking a Senior Lead/Architect - Data Engineering to shape our data platform. You will guide architectural decisions, design scalable data pipelines, and drive modernization across data lakehouse and warehouse layers.

The role requires 8–14 years of experience, with hybrid work (3 days in office) at Guindy Olympia Tech, Chennai. Candidates should have strong Databricks, Azure Data Factory, and data governance expertise.

Qualifications

  • 8–14 years of data engineering experience required.
  • Senior lead/architect level role on data engineering.
  • Hybrid work model with 3 days in-office in Guindy Olympia Tech, Chennai.
  • Knowledge of Databricks Lakehouse and Delta Lake is essential.
  • Strong Azure Data Factory and data-pipeline orchestration skills.

Responsibilities

  • Design and implement modern data pipelines and lakehouse architectures.
  • Lead governance, security, metadata management, and data lineage initiatives.
  • Collaborate with product teams to translate business needs into scalable data solutions.
  • Migrate and modernize legacy ETL/ELT across on-prem or cloud environments.

Skills

Data architecture
Lakehouse
Data warehouse
Data lake
Medallion architecture
Dimensional modelling
Star schemas
Snowflake schemas
Data Vault
Data mesh
Batch processing
Streaming
CDC architecture
Event-driven pipelines
Master data
Data governance
Data lineage
Data quality
Metadata management

Education

Bachelor's degree in a relevant field

Tools

Databricks Lakehouse
PySpark
Delta Lake
Delta Live Tables
Unity Catalog
Databricks SQL
Change Data Capture
Schema evolution
Databricks security
Azure Data Factory (ADF)
Mapping Data Flows
Self-hosted Integration Runtime
CI/CD for data pipelines

Job description

Resumes can be shared with devika.raju@kumaran.com

Primary Information:

Work Location - Guindy Olympia Tech

Work Mode - Hybrid - 3 days in the office.

Department - Product (AI) - Candidates are not expected to have AI experience.

Role - Senior Role (Senior Lead/Architect) - Data Engineering.

Experience required - 8 years to 14 years.

Primary Skill sets required:
  • Databricks Lakehouse architecture, PySpark, Delta Lake, Delta Live Tables / Lakeflow capabilities, Unity Catalog, Workflows / Jobs, Databricks SQL, Change Data Capture, Schema evolution, Databricks security and governance
  • Azure Data Factory ADF pipelines, Copy activities, Mapping Data Flows, Parameters and variables, Metadata-driven pipelines, Dynamic pipelines, Integration, Runtime, Self-hosted Integration Runtime, Trigger mechanisms, Error handling, Retry frameworks, Dependency management, Pipeline monitoring, CI/CD
  • Enterprise Data Architecture, Modern Data Lakehouse, Data Warehouse, Data Lake, Lakehouse architecture, Medallion architecture, Dimensional modelling, Star/Snowflake schemas, Data Vault, Data mesh concepts, Batch and streaming architecture, CDC architecture, Event-driven data pipelines, Master/reference data, Data governance, Data lineage, Data quality, Metadata management
  • Metadata-driven ingestion, Dynamic pipeline generation, Automated schema discovery, Automated table creation, Incremental load framework, CDC framework, Data quality framework, Pipeline monitoring, Exception handling, Automated reconciliation, Data validation, Deployment automation, Environment provisioning.
  • Strong experience in Legacy ETL modernisation, Data warehouse migration, Data lake migration, ETL ELT transformation, On-premises Azure migration, Legacy database Lakehouse migration, Batch near-real-time modernisation, stored procedure modernisation, Legacy ETL code conversion.

Notice Period - Immediate Joiner / Early Joiner - 0 days to 15 days.

Resumes can be shared with devika.raju@kumaran.com

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineering Modernization Architect
Data Engineering Modernization Architect

Kumaran Systems • Chennai District

On-site
INR 3,500,000 - 5,500,000
None
Senior Data Engineer
Senior Data Engineer

Kumaran Systems • Chennai

Hybrid
INR 900,000 - 1,600,000
Architect - Data Engineer (Modernization)
Architect - Data Engineer (Modernization)

Kumaran Systems • Chennai

Hybrid
INR 3,500,000 - 5,500,000
Data Engineer
Data Engineer

Kumaran • Hyderabad

On-site
INR 1,000,000 - 1,400,000
Data Architect
Data Architect

Tredence • Kolkata, Bengaluru

Hybrid
INR 1,800,000 - 3,200,000
Lead Data Engineer
Lead Data Engineer

Intellics Global Services • Chennai

Hybrid
INR 2,800,000 - 3,000,000
Data Engineer Advisor
Data Engineer Advisor

NTT DATA, Inc. • Hyderabad

On-site
INR 3,000,000 - 4,500,000
Senior Developer - Data Engineering
Senior Developer - Data Engineering

Annalect, Omnicom Media Group India Private Limited. • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Data Engineering Lead
Data Engineering Lead

Brace Infotech Private Limited • Hyderabad

On-site
INR 4,200,000 - 6,400,000
Data Engineer
Data Engineer

Artihcus • Hyderabad

On-site
INR 1,200,000 - 1,800,000