Sr. Data Engineer

CCL; India; Hybrid; INR 4,200,000 - 7,200,000; Full time

Benefits offered by this job

Employer-paid insurance

Paid time off and holidays

Job summary

Center for Creative Leadership (CCL) in India seeks a Senior Data Engineer to design, build, and operate a modern data platform. You will lead the consolidation of Azure Synapse/Data Factory/SSIS onto Microsoft Fabric, and deliver governed data products for analytics and AI use cases.

You will mentor engineers, establish standards, and collaborate with global stakeholders across time zones, ensuring data quality, security, and scalable data solutions for finance and operations.

Qualifications

• Bachelor’s or Master’s in CS/IT/Engineering/Data Analytics with 12–18 years overall tech experience.
• 7+ years hands-on data engineering and 3+ years designing Azure data platform solutions.
• Global/MNC exposure and ability to collaborate with US/EU stakeholders.

Responsibilities

• Design, build, and run the enterprise data platform and data products.
• Lead migration to Microsoft Fabric and consolidate legacy estates.
• Create governed data assets and scalable pipelines for analytics and AI use cases.
• Ensure data quality, security, and production reliability with automated testing.
• Establish engineering standards, CI/CD, and documentation; mentor engineers.
• Partner with Finance, Revenue Ops, and business stakeholders to ground reporting.
• Communicate options and risks clearly to global stakeholders across time zones.

Skills

SQL

Spark/PySpark

Python

Delta Lake

Data modeling

Data architecture

Power BI semantic models

Azure Fabric

Azure SQL

Data Factory

SSIS

Git/Azure DevOps

Databricks

Education

Bachelor’s or Master’s in CS/IT/Engineering/Data Analytics

Tools

Microsoft Fabric

Power BI

Git/Azure DevOps

Databricks

Azure SQL

SSIS

Data Factory

OneLake/Delta Lake

Job description

Center for Creative Leadership (CCL) is a US-based, world-renowned provider of leadership research, coaching, and consulting with over 50 years of experience, dedicated to advancing the understanding, practice, and development of leadership for the benefit of society worldwide. CCL has a Global Capability Center in India which hosts roles across CCL’s Global locations and has grown into a multi-function hub that increasingly owns and runs global processes end to end. Within CCL, the Global Technology Team (GTT) designs, builds, and supports the enterprise platforms, applications, and data assets that power CCL’s client programs, digital learning, and internal operations across the Americas, EMEA, and APAC, and is now investing in a modern, AI-ready data platform built on Microsoft Fabric and Azure.

Within GTT, the Senior Data Engineer is focused on designing, building, and running CCL’s enterprise data platform and data products, acting as the senior technical anchor for data engineering and a trusted partner to global business and technology stakeholders; the role leads the consolidation of a legacy Azure Synapse, Data Factory, and SSIS estate onto Microsoft Fabric, delivers governed and well-documented data products for Finance, Revenue Operations, analytics, and AI use cases, and holds overall responsibility for engineering standards, data quality, security, production reliability, and the mentoring of engineers as the GCC’s data capability scales.

• Data platform engineering & modernization — Designs, builds, and supports scalable production pipelines using Microsoft Fabric (Data Factory, notebooks, Lakehouse, Warehouse), Spark/PySpark, SQL, and Python on a Bronze–Silver–Gold (medallion) architecture, and leads the migration of Azure Synapse, Data Factory, and SSIS workloads to Fabric while retiring duplication and technical debt.
• Data modeling, analytics & AI enablement — Designs dimensional and relational models, reusable datasets, and Power BI semantic models (including Direct Lake) with consistent, business-owned definitions, and prepares governed, well-documented data assets that can safely ground Copilot Studio agents and other AI solutions on CCL’s Microsoft estate.
• Finance & business data products — Partners with Finance, Revenue Operations, and GCC process and data analysts to translate requirements into certified data products, including turning Dynamics 365 Finance & Operations and project data into trusted reporting that reconciles what is sold, contracted, delivered, and invoiced.
• Data quality, governance & security — Embeds automated testing, reconciliation, monitoring, and alerting into every pipeline; applies access, privacy, and security controls (row- and object-level security, Key Vault-managed secrets) to protect sensitive client and participant data; and maintains metadata, lineage, business rules, and ownership using Microsoft Purview.
• DevOps, production support & operational excellence — Uses Git, peer reviews, CI/CD, and Fabric deployment pipelines across development, test, and production; maintains runbooks, alerting, and support documentation; monitors and cost-optimizes Fabric capacity; and leads root-cause analysis so production issues, especially during finance-critical cycles such as month-end close, do not recur.
• Technical leadership & global collaboration — Leads the technical design of complex data solutions as a senior individual contributor, establishes reusable engineering standards and design-review practices, mentors engineers and analysts in India, and communicates options, risks, and recommendations clearly to US and global stakeholders across time zones.
• Technical Depth & Engineering Judgment — Brings hands‑on mastery of modern data engineering and makes sound, pragmatic choices on architecture, simplicity, cost, and maintainability; knows when a quick fix is acceptable and when a durable solution is required and takes ownership of the outcome.
• End-to-End Ownership & Accountability — Owns solutions from design through production support rather than handing off at deployment; holds self and others accountable to engineering standards, surfaces risks early, and builds trust by delivering what was committed.
• Operational Discipline & Data Stewardship — Treats data quality, security, governance, and documentation as part of the job, not an afterthought; brings a calm, structured, root-cause approach to incidents and continuously hardens the platform.
• Global Communication & Stakeholder Influence — Explains complex technical concepts in clear business language, listens well, and influences senior global stakeholders (including pushing back when needed); builds strong working relationships across cultures, functions, and time zones.
• Learning Agility & Multiplier Mindset — Keeps pace with a fast-evolving Microsoft Fabric and AI landscape, experiments responsibly, and raises the capability of the people around them through mentoring, code reviews, and shared standards.

Education and Experience:

• Education & Experience — Bachelor’s or Master’s degree (B.E./B.Tech/MCA/M.Tech) in Computer Science, Information Technology, Engineering, Data Analytics, or a related discipline, along with 12–18 years of professional experience in data and technology, including 7+ years of hands‑on data engineering and 3+ years designing solutions on Azure data platforms (Synapse, Data Factory, Databricks, or Fabric).
• Global / MNC Exposure — Sustained experience (typically 5+ years) in multinational environments such as a Global Capability Center, global product company, or international consulting practice, working directly with US or European stakeholders.
• Technical Proficiency — Strong command of SQL, Spark/PySpark, Python, Delta Lake, query optimization, data architecture, and data modeling; production experience with Microsoft Fabric (OneLake, Lakehouse, Warehouse, Data Factory, deployment pipelines) and Power BI semantic models; working knowledge of Azure SQL, Data Lake Storage, Cosmos DB, Logic Apps, Key Vault, SSIS, and Git/Azure DevOps.
• Certifications & Domain Exposure (Preferred) — Microsoft Certified Fabric Data Engineer Associate or Fabric Analytics is a plus; In addition to this , Experience delivering data products on Dynamics 365 Finance & Operations or Project Operations, enterprise governance with Microsoft Purview, and preparing data for generative AI and retrieval-based solutions is an added advantage.

Other Requirements/Experience:

• Willingness to work in India afternoon business hours with a regular 3–4-hour overlap with US Eastern Time for stakeholder meetings and production support.
• Occasional travel may be required, primarily to CCL’s India locations and, where needed, global CCL offices.
• Strong written and spoken English, with the confidence to present to senior global audiences, is essential.
• Employer-paid insurance

• Paid time off and paid holidays

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
This employer is required to notify all applicants of their rights pursuant to federal employment laws.For further information, please review the Know Your Rights notice from the Department of Labor.