Sr. Data Engineer

Center for Creative Leadership; Gurugram District; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Employer-paid insurance

Flexi Benefit

Paid time off and paid holidays

Job summary

Center for Creative Leadership (CCL) in India hosts a Senior Data Engineer within the Global Technology Team. The role focuses on designing, building, and running CCL’s enterprise data platform and data products, consolidating legacy Azure workloads onto Microsoft Fabric, and delivering governed data assets for finance, analytics, and AI use cases.

The position emphasizes engineering standards, data quality, security, production reliability, and mentoring engineers as the GCC scales its data

Qualifications

• Bachelor’s or Master’s degree in CS/IT or related field.
• 12–18 years of professional experience in data and technology.
• 7+ years hands-on data engineering experience on Azure data platforms.
• Global/ multinational exposure preferred.

Responsibilities

• Data platform engineering & modernization.
• Data modeling, analytics & AI enablement.
• Finance & business data products.
• Data quality, governance & security.
• DevOps, production support & operational excellence.
• Technical leadership & global collaboration.

Skills

Microsoft Fabric

Data Factory

Azure Synapse

Python

SQL

Spark

Power BI

Git

CI/CD

Data modeling

Data governance

Security

Databricks

Delta Lake

Azure DevOps

Education

Bachelor’s or Master’s in Computer Science / Information Technology

Tools

Databricks

Power BI

Azure DevOps

Git

Delta Lake

Azure Fabric

Azure Synapse

Data Factory

Job description

Center for Creative Leadership (CCL) is a US-based, world-renowned provider of leadership research, coaching, and consulting with over 50 years of experience, dedicated to advancing the understanding, practice, and development of leadership for the benefit of society worldwide. CCL has a Global Capability Center in India which hosts roles across CCL’s Global locations and has grown into a multi-function hub that increasingly owns and runs global processes end to end. Within CCL, the Global Technology Team (GTT) designs, builds, and supports the enterprise platforms, applications, and data assets that power CCL’s client programs, digital learning, and internal operations across the Americas, EMEA, and APAC, and is now investing in a modern, AI-ready data platform built on Microsoft Fabric and Azure.

Within GTT, the Senior Data Engineer is focused on designing, building, and running CCL’s enterprise data platform and data products, acting as the senior technical anchor for data engineering and a trusted partner to global business and technology stakeholders; the role leads the consolidation of a legacy Azure Synapse, Data Factory, and SSIS estate onto Microsoft Fabric, delivers governed and well-documented data products for Finance, Revenue Operations, analytics, and AI use cases, and holds overall responsibility for engineering standards, data quality, security, production reliability, and the mentoring of engineers as the GCC’s data capability scales.

• Data platform engineering & modernization — Designs, builds, and supports scalable production pipelines using Microsoft Fabric (Data Factory, notebooks, Lakehouse, Warehouse), Spark/PySpark, SQL, and Python on a Bronze-Silver-Gold (medallion) architecture, and leads the migration of Azure Synapse, Data Factory, and SSIS workloads to Fabric while retiring duplication and technical debt.
• Data modeling, analytics & AI enablement — Designs dimensional and relational models, reusable datasets, and Power BI semantic models (including Direct Lake) with consistent, business-owned definitions, and prepares governed, well-documented data assets that can safely ground Copilot Studio agents and other AI solutions on CCL’s Microsoft estate.
• Finance & business data products — Partners with Finance, Revenue Operations, and GCC process and data analysts to translate requirements into certified data products, including turning Dynamics 365 Finance & Operations and project data into trusted reporting that reconciles what is sold, contracted, delivered, and invoiced.
• Data quality, governance & security — Embeds automated testing, reconciliation, monitoring, and alerting into every pipeline; applies access, privacy, and security controls (row- and object-level security, Key Vault-managed secrets) to protect sensitive client and participant data; and maintains metadata, lineage, business rules, and ownership using Microsoft Purview.
• DevOps, production support & operational excellence — Uses Git, peer reviews, CI/CD, and Fabric deployment pipelines across development, test, and production; maintains runbooks, alerting, and support documentation; monitors and cost-optimizes Fabric capacity; and leads root-cause analysis so production issues, especially during finance-critical cycles such as month-end close, do not recur.
• Technical leadership & global collaboration — Leads the technical design of complex data solutions as a senior individual contributor, establishes reusable engineering standards and design-review practices, mentors engineers and analysts in India, and communicates options, risks, and recommendations clearly to US and global stakeholders across time zones.
• Technical Depth & Engineering Judgment — Brings hands-on mastery of modern data engineering and makes sound, pragmatic choices on architecture, simplicity, cost, and maintainability; knows when a quick fix is acceptable and when a durable solution is required and takes ownership of the outcome.
• End-to-End Ownership & Accountability — Owns solutions from design through production support rather than handing off at deployment; holds self and others accountable to engineering standards, surfaces risks early, and builds trust by delivering what was committed.
• Operational Discipline & Data Stewardship — Treats data quality, security, governance, and documentation as part of the job, not an afterthought; brings a calm, structured, root-cause approach to incidents and continuously hardens the platform.
• Global Communication & Stakeholder Influence — Explains complex technical concepts in clear business language, listens well, and influences senior global stakeholders (including pushing back when needed); builds strong working relationships across cultures, functions, and time zones.
• Learning Agility & Multiplier Mindset — Keeps pace with a fast-evolving Microsoft Fabric and AI landscape, experiments responsibly, and raises the capability of the people around them through mentoring, code reviews, and shared standards.

Center for Creative Leadership (CCL) is a US-based, world-renowned provider of leadership research, coaching, and consulting with over 50 years of experience, dedicated to advancing the understanding, practice, and development of leadership for the benefit of society worldwide. CCL has a Global Capability Center in India which hosts roles across CCL’s Global locations and has grown into a multi-function hub that increasingly owns and runs global processes end to end. Within CCL, the Global Technology Team (GTT) designs, builds, and supports the enterprise platforms, applications, and data assets that power CCL’s client programs, digital learning, and internal operations across the Americas, EMEA, and APAC, and is now investing in a modern, AI-ready data platform built on Microsoft Fabric and Azure.

Within GTT, the Senior Data Engineer is focused on designing, building, and running CCL’s enterprise data platform and data products, acting as the senior technical anchor for data engineering and a trusted partner to global business and technology stakeholders; the role leads the consolidation of a legacy Azure Synapse, Data Factory, and SSIS estate onto Microsoft Fabric, delivers governed and well-documented data products for Finance, Revenue Operations, analytics, and AI use cases, and holds overall responsibility for engineering standards, data quality, security, production reliability, and the mentoring of engineers as the GCC’s data capability scales.

Principal Duties & Responsibilities:

• Data platform engineering & modernization — Designs, builds, and supports scalable production pipelines using Microsoft Fabric (Data Factory, notebooks, Lakehouse, Warehouse), Spark/PySpark, SQL, and Python on a Bronze-Silver-Gold (medallion) architecture, and leads the migration of Azure Synapse, Data Factory, and SSIS workloads to Fabric while retiring duplication and technical debt.
• Data modeling, analytics & AI enablement — Designs dimensional and relational models, reusable datasets, and Power BI semantic models (including Direct Lake) with consistent, business-owned definitions, and prepares governed, well-documented data assets that can safely ground Copilot Studio agents and other AI solutions on CCL’s Microsoft estate.
• Finance & business data products — Partners with Finance, Revenue Operations, and GCC process and data analysts to translate requirements into certified data products, including turning Dynamics 365 Finance & Operations and project data into trusted reporting that reconciles what is sold, contracted, delivered, and invoiced.
• Data quality, governance & security — Embeds automated testing, reconciliation, monitoring, and alerting into every pipeline; applies access, privacy, and security controls (row- and object-level security, Key Vault-managed secrets) to protect sensitive client and participant data; and maintains metadata, lineage, business rules, and ownership using Microsoft Purview.
• DevOps, production support & operational excellence — Uses Git, peer reviews, CI/CD, and Fabric deployment pipelines across development, test, and production; maintains runbooks, alerting, and support documentation; monitors and cost-optimizes Fabric capacity; and leads root-cause analysis so production issues, especially during finance-critical cycles such as month-end close, do not recur.
• Technical leadership & global collaboration — Leads the technical design of complex data solutions as a senior individual contributor, establishes reusable engineering standards and design-review practices, mentors engineers and analysts in India, and communicates options, risks, and recommendations clearly to US and global stakeholders across time zones.

Key Competencies:

• Technical Depth & Engineering Judgment — Brings hands-on mastery of modern data engineering and makes sound, pragmatic choices on architecture, simplicity, cost, and maintainability; knows when a quick fix is acceptable and when a durable solution is required and takes ownership of the outcome.
• End-to-End Ownership & Accountability — Owns solutions from design through production support rather than handing off at deployment; holds self and others accountable to engineering standards, surfaces risks early, and builds trust by delivering what was committed.
• Operational Discipline & Data Stewardship — Treats data quality, security, governance, and documentation as part of the job, not an afterthought; brings a calm, structured, root-cause approach to incidents and continuously hardens the platform.
• Global Communication & Stakeholder Influence — Explains complex technical concepts in clear business language, listens well, and influences senior global stakeholders (including pushing back when needed); builds strong working relationships across cultures, functions, and time zones.
• Learning Agility & Multiplier Mindset — Keeps pace with a fast-evolving Microsoft Fabric and AI landscape, experiments responsibly, and raises the capability of the people around them through mentoring, code reviews, and shared standards.

Education and Experience:

• Education & Experience — Bachelor’s or Master’s degree (B.E./B.Tech/MCA/M.Tech) in Computer Science, Information Technology, Engineering, Data Analytics, or a related discipline, along with 12-18 years of professional experience in data and technology, including 7+ years of hands‑on data engineering and 3+ years designing solutions on Azure data platforms (Synapse, Data Factory, Databricks, or Fabric).
• Global / MNC Exposure — Sustained experience (typically 5+ years) in multinational environments such as a Global Capability Center, global product company, or international consulting practice, working directly with US or European stakeholders.
• Technical Proficiency — Strong command of SQL, Spark/PySpark, Python, Delta Lake, query optimization, data architecture, and data modeling; production experience with Microsoft Fabric (OneLake, Lakehouse, Warehouse, Data Factory, deployment pipelines) and Power BI semantic models; working knowledge of Azure SQL, Data Lake Storage, Cosmos DB, Logic Apps, Key Vault, SSIS, and Git/Azure DevOps.
• Certifications & Domain Exposure (Preferred) — Microsoft Certified Fabric Data Engineer Associate or Fabric Analytics is a plus; In addition to this , Experience delivering data products on Dynamics 365 Finance & Operations or Project Operations, enterprise governance with Microsoft Purview, and preparing data for generative AI and retrieval-based solutions is an added advantage.

Other Requirements/Experience:

• Willingness to work in India afternoon business hours with a regular 3-4-hour overlap with US Eastern Time for stakeholder meetings and production support.
• Occasional travel may be required, primarily to CCL’s India locations and, where needed, global CCL offices.
• Strong written and spoken English, with the confidence to present to senior global audiences, is essential.

Benefits:

• Employer-paid insurance
• Flexi Benefit

Paid time off and paid holidays

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.