Associate Director - Data Engineering (Microsoft Azure Data Services )

WNS Holdings; Bengaluru; Hybrid; INR 20,00,000 - 30,00,000; Full time

Job summary

A technology services company in Bengaluru is seeking a skilled Data Architect to lead the design and implementation of enterprise data architecture. The ideal candidate will have over 12 years of experience and strong expertise in Microsoft Azure, specifically with Microsoft Fabric. Responsibilities include creating efficient data solutions, optimizing data storage, and ensuring data governance. An excellent opportunity for professionals passionate about data innovation.

Qualifications

• 12+ years of experience in data architecture or a similar role.
• Hands-on experience in Microsoft Azure data services.
• Proficiency in SQL and PySpark/Spark SQL.

Responsibilities

• Design end-to-end data solutions on Azure, incorporating Microsoft Fabric.
• Develop and maintain data models for relational and data warehouse environments.
• Implement data governance and compliance policies.

Skills

Data Architecture

Microsoft Azure

Data Modeling

ETL/ELT Development

Power BI

Spark Jobs

Tools

Azure Data Factory

Azure Synapse Analytics

Azure SQL DB

Job description

Role & responsibilities

Data Architect We are seeking a highly skilled and experienced Data Architect to lead the design, development, and implementation of our enterprise data architecture. The ideal candidate will have deep expertise in the Microsoft Azure cloud ecosystem, with a strong focus on the emerging Microsoft Fabric platform.

You will be responsible for creating scalable, secure, and efficient data solutions that support business intelligence, advanced analytics, and data science needs across the organization.

• Architecture & Design: Design end-to-end data solutions on Azure, incorporating Microsoft Fabric (OneLake, Data Warehouse), Azure Databases, and Power BI.
• Data Modeling: Develop and maintain conceptual, logical, and physical data models for both relational and data warehouse environments.
• Data Storage & Management: Architect and manage data storage solutions using Microsoft Fabric OneLake as the unified data lake.
• Design and optimize Microsoft Fabric Data Warehouses for enterprise-scale analytics. Administer and optimize cloud databases, including Azure PostgreSQL and Azure SQL Server.
• ETL/ELT Development: Design, build, and maintain efficient and reliable data pipelines using Fabric Data Pipelines and Dataflows (Gen2). Develop and optimize large-scale data processing jobs using Spark Jobs (Spark SQL, PySpark, Spark Scala) within Fabric.
• Reporting & Analytics: Architect the semantic layer and data models for enterprise Power BI reports and dashboards.
• Establish best practices for report performance, security, and deployment.
• Governance & Security: Implement data governance, security, and compliance policies across the Fabric platform, including data lineage, cataloging, and access controls.
• Collaboration: Work closely with data engineers, business intelligence developers, data scientists, and business stakeholders to understand requirements and deliver robust data solutions.
• Innovation: Stay current with the latest developments in Azure and Microsoft Fabric, evaluating and recommending new technologies and approaches to improve our data platform.

Preferred candidate profile

• 12+ years of experience in data architecture, data engineering, or a similar role, with at least 3+ years of hands-on experience in Azure.
• Cloud Expertise: Proven experience with Microsoft Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage Gen2, Azure SQL DB).
• Microsoft Fabric (Crucial): Hands-on experience with Microsoft Fabric is essential. This must include: OneLake: Understanding of the OneLake architecture and its role as a unified data lake.
• Fabric Warehousing: Experience building and managing data warehouses within the Fabric environment. Fabric Pipelines & Dataflows: Proficiency in building ETL/ELT pipelines using Fabric's native tools.
• Spark in Fabric: Experience developing and troubleshooting Spark Jobs.
• Databases: Strong proficiency in Azure PostgreSQL and/or Azure SQL Server, including performance tuning, security, and management.
• Power BI: Extensive experience architecting the data backend for Power BI, including designing semantic models and optimizing for performance.
• Programming/Scripting: Proficiency in SQL (advanced required), PySpark/Spark SQL, and Python.
• Experience with PowerShell for automation is a plus.
• Data Modeling: Strong knowledge of data modeling principles (e.g., Star Schema, Kimball, Data Vault).
• Problem-Solving: Excellent analytical and problem-solving skills with the ability to design solutions for complex business requirements.