Microsoft Fabric Data Engineer - Manager - Data & AI - Technology Consulting - Advisory

PwC; Dublin; Presencial; EUR 95.000 - 140.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

PwC perks

Descripción de la vacante

PwC Ireland ищет старшего инженера по данным для проектирования и реализации Enterprise‑grade решений на Microsoft Fabric. Вы будете ответственны за сбор, преобразование и аналитическую подготовку данных для отчетности, AI и бизнес‑интеллекта.

Ключевые задачи включают работу с Lakehouse/OneLake, Data Factory и Dataflows Gen2, настройку CI/CD и взаимодействие с командами архитекторов и бизнес‑пользователями для достижения целей проекта.

Formación

• 6+ лет опыта в Data Engineering и Azure Analytics платформами.
• Практический опыт реализации Microsoft Fabric в продакшн-окружении.
• Глубокие знания Fabric Lakehouse, Fabric Warehouse, OneLake, Data Factory, Dataflows Gen2, Notebooks, Semantic Models.
• Опыт построения масштабируемых ETL/ELT решений и современных дата-платформ.
• Знания SQL, Python, PySpark и принципов моделирования данных.
• Опыт внедрения Medallion Architecture, Delta Lake и современных паттернов аналитики.
• Опыт интеграции данных из API, SaaS, баз и облачных систем.
• Понимание управления данными, метаданных и соблюдения требований.

Responsabilidades

• Дизайн, разработка, развёртывание и поддержка масштабируемых решений на базе Microsoft Fabric.
• Разработка моделей Lakehouse, Warehouse и Medallion Architecture.
• Построение конвейеров преобразования с PySpark и SQL.
• Контроль качества данных, мониторинг и оповещение.
• Участие в настройке CI/CD и DevOps процессах.
• Сотрудничество с Архитекторами решений и бизнес-аналитиками.

Conocimientos

Azure Data Engineering

Fabric Lakehouse

PySpark

SQL

Data Modeling

APIs & Integration

CI/CD / DevOps

Herramientas

Fabric Data Factory

Dataflows Gen2

Notebooks

Semantic Models

OneLake

Delta Lake

Descripción del empleo

Задачи

• Design, develop, deploy, and support enterprise-scale Microsoft Fabric solutions across Data Engineering, Analytics, and AI initiatives.
• Design and maintain scalable Lakehouse, Warehouse, and Medallion Architecture patterns within Microsoft Fabric.
• Build and optimise data ingestion frameworks using Fabric Data Factory, Dataflows Gen2, Fabric Mirroring, shortcuts, APIs, databases, SaaS applications, and cloud-native data sources.
• Develop reusable ingestion patterns and accelerators to support rapid and consistent project delivery.
• Integrate structured, semi-structured, and streaming data into Microsoft Fabric OneLake.
• Develop and optimise Spark, PySpark, and SQL-based transformation pipelines.
• Build scalable ETL/ELT frameworks supporting enterprise reporting, analytics, and AI workloads.
• Design and implement real-time analytics solutions using Eventstreams, Real-Time Intelligence, and streaming data architectures where appropriate.
• Enable AI-ready data foundations supporting Copilot, Fabric Data Agents, Machine Learning, and Generative AI workloads.
• Implement data quality controls, validation frameworks, monitoring processes, and automated alerting mechanisms.
• Implement data governance standards, metadata management, lineage, and security controls using Microsoft Purview and Microsoft Fabric governance capabilities.
• Support the development of trusted, governed, secure, and compliant data platforms.
• Establish CI/CD pipelines, source control standards, testing frameworks, and automated deployment processes using Azure DevOps and Git.
• Develop reusable templates, accelerators, and engineering frameworks to improve delivery quality, consistency, and productivity.
• Monitor platform performance, optimise workloads, and troubleshoot complex data engineering issues.
• Collaborate with Solution Architects, Business Stakeholders, Data Analysts, and AI teams to deliver successful business outcomes.
• Support the implementation of modern analytics, AI, and self-service reporting solutions leveraging the Microsoft Fabric ecosystem.
• Take ownership of end-to-end delivery of data engineering workstreams, ensuring solutions are delivered to agreed quality, governance, security, and performance standards.

Требования

• 6+ years' experience in Data Engineering and Azure Analytics platforms.
• Demonstrated experience delivering modern Azure Data & Analytics solutions, including hands-on Microsoft Fabric implementations in production environments.
• Strong hands-on experience with Fabric Lakehouse, Fabric Warehouse, OneLake, Data Factory, Dataflows Gen2, Notebooks, and Semantic Models.
• Extensive experience building scalable ETL/ELT solutions and modern data platforms.
• Strong expertise in SQL, Python, PySpark, and data modelling principles.
• Experience implementing Medallion Architecture, Delta Lake, and modern analytics patterns.
• Experience integrating data from APIs, SaaS platforms, databases, and cloud-based systems.
• Strong understanding of data governance, security, metadata management, and compliance practices.
• Experience implementing CI/CD pipelines, source control, and DevOps engineering practices.
• Proven ability to troubleshoot, optimise, and support enterprise-scale data platforms.
• Strong communication and stakeholder management skills with experience working across technical and business teams.
• Experience collaborating with Solution Architects, Data Analysts, and engineering teams to deliver complex data platform solutions.

Our commitment to you

We’re committed to building an inclusive culture that empowers our people to thrive and feel a sense of belonging at PwC. We seek to attract talented people from different backgrounds with diverse perspectives who can bring innovation and creativity. At PwC, your hard work doesn't go unnoticed. We celebrate your achievements not just within the firm, but among your peers as well. Our rewards are designed to fit your unique lifestyle and needs. And because being part of PwC should be rewarding every day, you'll have access to PwC perks a handpicked selection of exclusive discounts, experiences, and extras just for being part of our team.

Условия

At PwC Ireland, you’ll be part of a purpose-driven organisation dedicated to building trust in society and solving our clients’ most complex challenges. Here, diverse teams collaborate across sectors and geographies to deliver innovative solutions that make a real difference. We invest in your growth through continuous learning, leadership development, and access to cutting-edge technology, empowering you to shape your career and impact the future of business and society. As a Senior Microsoft Fabric Data Engineer, you will play a key role in designing, developing, and delivering enterprise-grade data platforms on Microsoft Fabric. You will be responsible for the end-to-end implementation of data engineering solutions, from data ingestion and transformation through to analytics enablement, governance, and operational support. Working closely with Solution Architects, Business Stakeholders, Data Analysts, and AI teams, you will translate business requirements into scalable, secure, and high-performing data solutions that support reporting, advanced analytics, and AI-driven use cases. This is a highly hands-on role requiring deep expertise across the Microsoft Fabric ecosystem, including OneLake, Lakehouse, Data Warehouse, Data Factory, Dataflows Gen2, Real-Time Intelligence, Power BI, Semantic Models, and Microsoft Purview. The candidate will take ownership of data engineering workstreams and contribute to the development of reusable frameworks, best practices, and delivery accelerators that improve solution quality and delivery efficiency.