Senior AI Engineer Manager

Ecolab; Bengaluru; Hybride; INR 4 000 000 - 7 000 000; Plein temps

Résumé du poste

Ecolab is seeking a Senior Manager, Data Engineering Platform to lead enterprise data platform capabilities enabling analytics, AI, and business decisions. You will own platform operations, integration, observability, data quality, lineage, and security across Databricks, Snowflake, and Azure-based platforms.

You will drive automation, governance, and scalable data ingestion, ETL/ELT, orchestration, and production support, partnering with cross-functional teams to align the platform with

Qualifications

• 10+ years of experience in data engineering, data platform engineering, cloud platform engineering, or enterprise platform operations, including 4+ years managing engineering teams.
• Hands-on experience administering Databricks and Snowflake environments, including Unity Catalog, workspace management, cluster policies, SQL warehouses, roles, resource monitors, and workload governance.
• Strong experience operating cloud-based data platforms on Microsoft Azure; AWS or Google Cloud exposure is a plus.
• Experience with CI/CD, Infrastructure-as-Code, Terraform or similar tools, platform automation, environment management, and release governance.
• Strong understanding of integration, ETL/ELT, CDC, streaming, orchestration, metadata, cataloging, lineage, data quality, monitoring, and DataOps practices using tools such as Azure Data Factory, Airflow, dbt, Kafka/Event Hubs, or similar platforms.
• Experience implementing observability, alerting, dashboards, SLA/SLO reporting, incident management, and production support for enterprise data platforms.
• Strong understanding of data security and access governance, including Zero Trust, RBAC, ABAC, PBAC, identity management, audit logging, encryption, data masking, secrets management, and data protection.

Responsabilités

• Lead the enterprise data engineering platform operating model across Databricks, Snowflake, Azure Data Lake, ingestion, transformation, orchestration, governance, observability, monitoring, cataloging, lineage, and data quality.
• Own platform administration, including workspaces, clusters, SQL warehouses, Unity Catalog, Snowflake roles, resource monitors, workload isolation, and governance controls.
• Define observability and monitoring standards for pipelines, workflows, compute, storage, integrations, data freshness, data quality, lineage, performance, reliability, cost, SLAs, and SLOs.
• Drive automation through self-service provisioning, reusable templates, CI/CD, testing frameworks, release automation, and Infrastructure-as-Code.
• Define integration patterns across Databricks, Snowflake, Azure Data Factory, dbt, Kafka/Event Hubs, APIs, enterprise applications, databases, file sources, BI tools, and downstream platforms.
• Drive semantic and ontology layer capabilities with Data Engineering to enable consistent business definitions, reusable data products, governed consumption, and trusted analytics.
• Set ETL/ELT standards for batch, incremental, streaming, CDC, API-based, and event-driven pipelines using modern DataOps practices.
• Improve production readiness through data quality controls, lineage, metadata, cataloging, alerting, incident response, runbooks, root-cause analysis, and continuous improvement.
• Own data security and access governance, including Zero Trust, RBAC, ABAC, PBAC, data masking, encryption, secrets management, audit logging, policy enforcement, and compliance controls.
• Lead a high-performing platform engineering team through hiring, coaching, performance management, career development, workforce planning, and an inclusive engineering culture.
• Partner with Data Engineering, AI/ML Engineering, Security, Architecture, and business teams to align the platform roadmap with enterprise priorities.

Connaissances

Databricks

Snowflake

Azure

CI/CD

Terraform

DataOps

Observability

Data security

RBAC

ABAC

PBAC

Unity Catalog

Data lineage

Monitoring

Azure Data Factory

dbt

Kafka

Event Hubs

Spark

Delta Lake

Purview

Formation

Bachelor's degree

Outils

Databricks

Snowflake

Azure Data Factory

dbt

Airflow

Kafka

Event Hubs

Terraform

Unity Catalog

Purview

Description du poste

SENIOR MANAGER, DATA ENGINEERING PLATFORM

Ecolab | Data & AI Platform Engineering

Location: [Bangalore/ Hybrid ]

Reports To: Director, Data & AI Platform Engineering

Team: Databricks AI & Data Platform / Snowflake Modern Data Platform

Role Summary

Ecolab is seeking a Senior Manager, Data Engineering Platform to lead enterprise data platform capabilities that enable analytics, AI, and business decision-making. This role owns platform operations, integration, observability, monitoring, data quality, lineage, cataloging, security, and engineering enablement across Databricks, Snowflake, and Azure-based data platforms. The leader will deliver a secure, scalable, reliable, and cost-efficient foundation for ingestion, ETL/ELT, orchestration, governance, semantic and ontology capabilities, and production support across enterprise domains.

Key Responsibilities

• Lead the enterprise data engineering platform operating model across Databricks, Snowflake, Azure Data Lake, ingestion, transformation, orchestration, governance, observability, monitoring, cataloging, lineage, and data quality.
• Own platform administration, including workspaces, clusters, SQL warehouses, Unity Catalog, Snowflake roles, resource monitors, workload isolation, and governance controls.
• Define observability and monitoring standards for pipelines, workflows, compute, storage, integrations, data freshness, data quality, lineage, performance, reliability, cost, SLAs, and SLOs.
• Drive automation through self-service provisioning, reusable templates, CI/CD, testing frameworks, release automation, and Infrastructure-as-Code.
• Define integration patterns across Databricks, Snowflake, Azure Data Factory, dbt, Kafka/Event Hubs, APIs, enterprise applications, databases, file sources, BI tools, and downstream platforms.
• Drive semantic and ontology layer capabilities with Data Engineering to enable consistent business definitions, reusable data products, governed consumption, and trusted analytics.
• Set ETL/ELT standards for batch, incremental, streaming, CDC, API-based, and event-driven pipelines using modern DataOps practices.
• Improve production readiness through data quality controls, lineage, metadata, cataloging, alerting, incident response, runbooks, root-cause analysis, and continuous improvement.
• Own data security and access governance, including Zero Trust, RBAC, ABAC, PBAC, data masking, encryption, secrets management, audit logging, policy enforcement, and compliance controls.
• Lead a high-performing platform engineering team through hiring, coaching, performance management, career development, workforce planning, and an inclusive engineering culture.
• Partner with Data Engineering, AI/ML Engineering, Security, Architecture, and business teams to align the platform roadmap with enterprise priorities.

Required Qualifications

• 10+ years of experience in data engineering, data platform engineering, cloud platform engineering, or enterprise platform operations, including 4+ years managing engineering teams.
• Hands-on experience administering Databricks and Snowflake environments, including Unity Catalog, workspace management, cluster policies, SQL warehouses, roles, resource monitors, and workload governance.
• Strong experience operating cloud-based data platforms on Microsoft Azure; AWS or Google Cloud exposure is a plus.
• Experience with CI/CD, Infrastructure-as-Code, Terraform or similar tools, platform automation, environment management, and release governance.
• Strong understanding of integration, ETL/ELT, CDC, streaming, orchestration, metadata, cataloging, lineage, data quality, monitoring, and DataOps practices using tools such as Azure Data Factory, Airflow, dbt, Kafka/Event Hubs, or similar platforms.
• Experience implementing observability, alerting, dashboards, SLA/SLO reporting, incident management, and production support for enterprise data platforms.
• Strong understanding of data security and access governance, including Zero Trust, RBAC, ABAC, PBAC, identity management, audit logging, encryption, data masking, secrets management, and data protection.

Preferred Qualifications

• Databricks and/or SnowPro certifications (Administrator, Data Engineer).
• Experience supporting multiple business verticals or a hub-and-spoke platform operating model.
• Exposure to LangGraph, MLflow, or other AI/ML platform tooling.
• Experience with BI, semantic layers, MLOps, LLMOps, data cataloging, lineage, observability, data quality, or monitoring tools integrated with Databricks and Snowflake.
• Experience with lakehouse architecture, medallion patterns, Delta Lake, data sharing, semantic layers, and reusable data products at enterprise scale.
• Knowledge of Spark and Snowflake performance tuning, warehouse sizing, cluster policies, auto-scaling, cost controls, and platform FinOps.
• Exposure to orchestration and workflow tools such as Azure Data Factory, Airflow, Databricks Workflows, dbt Cloud, or similar platforms.
• Experience with streaming and near-real-time patterns using Kafka, Azure Event Hubs, Spark Structured Streaming, or similar technologies.
• Familiarity with governance and cataloging platforms such as Microsoft Purview, Unity Catalog, Collibra, Alation, Atlan, OpenLineage, or similar tools.
• Experience with platform reliability practices, including SRE, health dashboards, automated alerting, incident response, capacity forecasting, resiliency testing, and disaster recovery.

Our Commitment to a Culture of Inclusion & Belonging

Ecolab is committed to fair and equal treatment of associates and applicants and furthering the principles of Equal Opportunity to Employment. We will recruit, hire, promote, transfer and provide opportunities for advancement based on individual qualifications and job performance in all matters affecting employment, compensation, benefits, working conditions, and opportunities for advancement. Ecolab will not discriminate against any associate or applicant for employment because of race, religion, color, creed, national origin,citizenship status, sex, sexual orientation, gender identity and expressions, genetic information, marital status, age, or disability.