Resumes can be shared with devika.raju@kumaran.com
Primary Information:
Work Location - Guindy Olympia Tech
Work Mode - Hybrid - 3 days in the office.
Department - Product (AI) - Candidates are not expected to have AI experience.
Role - Senior Role (Senior Lead/Architect) - Data Engineering.
Experience required - 8 years to 14 years.
Primary Skill sets required:
- Databricks Lakehouse architecture, PySpark, Delta Lake, Delta Live Tables / Lakeflow capabilities, Unity Catalog, Workflows / Jobs, Databricks SQL, Change Data Capture, Schema evolution, Databricks security and governance
- Azure Data Factory ADF pipelines, Copy activities, Mapping Data Flows, Parameters and variables, Metadata-driven pipelines, Dynamic pipelines, Integration, Runtime, Self-hosted Integration Runtime, Trigger mechanisms, Error handling, Retry frameworks, Dependency management, Pipeline monitoring, CI/CD
- Enterprise Data Architecture, Modern Data Lakehouse, Data Warehouse, Data Lake, Lakehouse architecture, Medallion architecture, Dimensional modelling, Star/Snowflake schemas, Data Vault, Data mesh concepts, Batch and streaming architecture, CDC architecture, Event-driven data pipelines, Master/reference data, Data governance, Data lineage, Data quality, Metadata management
- Metadata-driven ingestion, Dynamic pipeline generation, Automated schema discovery, Automated table creation, Incremental load framework, CDC framework, Data quality framework, Pipeline monitoring, Exception handling, Automated reconciliation, Data validation, Deployment automation, Environment provisioning.
- Strong experience in Legacy ETL modernisation, Data warehouse migration, Data lake migration, ETL ELT transformation, On-premises Azure migration, Legacy database Lakehouse migration, Batch near-real-time modernisation, stored procedure modernisation, Legacy ETL code conversion.
Notice Period - Immediate Joiner / Early Joiner - 0 days to 15 days.
Resumes can be shared with devika.raju@kumaran.com