Data platform engineer for analytics and AI

GRAITEC; Barcelona; On-site; EUR 40,000 - 60,000; Full time

Job summary

GRAITEC ищет инженера Data Platform для разработки и эксплуатации платформы на базе Microsoft Fabric: Lakehouse, Warehouses, Pipelines и Notebooks. В задачи входит интеграция данных из Dynamics 365, CRM и телеметрии, построение многоуровневой модели данных и единообразное идентифицирование клиентов и продуктов.

Кандидат должен владеть SQL и Python/PySpark, знать Microsoft Fabric и инструменты DevOps для данных, а также уметь обеспечивать безопасность, контроль доступа и управляемость данных на

Qualifications

• 6+ лет опыта в Data Engineering, включая работу с Microsoft Fabric, Azure Synapse или Databricks
• Опыт работы с SQL и Python/PySpark, моделирование данных для аналитики
• Практический опыт работы с Microsoft Fabric: Lakehouse, Warehouse, Pipelines, Notebooks, OneLake
• Опыт интеграции ERP и CRM-систем, желательно Dynamics 365
• Опыт управления данными и разрешения сущностей, сопоставление клиентов и продуктов
• Реализация политик безопасности и надзора: Entra ID, RLS, Microsoft Purview
• Опыт управления мощностями и стоимостью на общедоступной аналитической платформе
• Использование ИИ-инструментов в работе (Copilot)
• Умение документировать и объяснять технические решения стейкхолдерам
• Экспертиза в аналитическом моделировании данных и архитектуре
• Глубокие знания Microsoft Fabric: Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake
• Знание современных практик безопасности, управления и соответствия
• Понимание операций платформы данных, производительности, масштабируемости и оптимизации затрат
• Практическое применение инструментов ИИ в разработке

Responsibilities

• Разработка и поддержка платформы Microsoft Fabric: Lakehouse, Warehouse, Pipelines, Dataflows
• Извлечение и интеграция данных из Dynamics 365, CRM, Kantata, лицензирования и телеметрии
• Построение слоистой модели данных для сертифицированных наборов данных
• Установление соответствия идентификации между системами и единицами учета
• Мониторинг конвейеров, автоматизация тестирования качества данных
• Управление емкостью платформы и затратами, масштабирование по мере необходимости
• Развертывание источников контроля, окружений и пайплайнов Deployment
• Реализация доступа, классификации, RLS, маскирование и политики конфиденциальности
• Защита чувствительных данных и учетной информации
• Поддержание lineage и документации для поддержки управляемости
• Установка инженерных стандартов и обучение BI-разработчиков
• Сотрудничество с Enterprise Architect и R&D по паттернам интеграции
• Подготовка данных для AI и обеспечение governed доступа к данным

Skills

SQL

Python

PySpark

Data modelling

Microsoft Fabric

Azure Synapse

Databricks

Security governance

CI/CD for data

Git & DevOps

Entity resolution

Communication

Tools

Copilot

dbt

Snowflake

Azure DevOps

Git

OneLake

Job description

Описание:

The Data Platform Engineer builds and runs the platform that all of Graitec's reporting, analytics and AI depend on: the Microsoft Fabric data lake, the pipelines that feed it, and the controls that keep it reliable, secure and affordable.

Задачи:

• Design, build and run the Microsoft Fabric platform: lakehouses, warehouses, pipelines and dataflows.
• Ingest and integrate data from Dynamics 365, CRM, Kantata, licensing and telemetry, using standard connectors and APIs where they fit.
• Build a layered, medallion-style data model that turns raw data into certified, reusable datasets.
• Resolve customer and product identities across CRM, ERP, licensing and telemetry, so every report counts the same customer once.
• Monitor pipelines and automate data quality tests for completeness, freshness, uniqueness and referential integrity, with alerting and clear ownership of failures.
• Manage platform capacity and cost, separating workloads and scaling only when justified.
• Run source control, environments and deployment pipelines for data and BI content.
• Implement access, classification, row- and column-level security, masking and privacy controls with Information Security.
• Protect sensitive data such as compensation, using anonymisation and restricted workspaces.
• Maintain lineage and documentation, supporting the data governance the business agrees.
• Set engineering standards and coach BI developers and analysts in using them.
• Work with the Enterprise Architect and R&D on integration patterns, master data and telemetry.
• Prepare data for AI, exposing governed, well-described data to agents and models through controlled interfaces.

Требования:

• 6+ years of experience in Data Engineering, including at least two years working with Microsoft Fabric, Azure Synapse, or Databricks.
• Strong experience with SQL and Python or PySpark, and data modelling for analytics.
• Hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, Pipelines, Notebooks, and OneLake.
• Experience integrating ERP and CRM data, ideally from Dynamics 365 Finance & Operations and Dataverse.
• Experience with master data management and entity resolution, including matching customers and products across multiple systems.
• Practical experience implementing security and governance, including Entra ID, row-level security, and Microsoft Purview.
• Experience managing capacity and costs on a shared analytics platform.
• Uses AI tools such as Copilot in day-to-day work for code generation, testing, and documentation.
• Strong communication skills, with the ability to document effectively and explain technical trade-offs to non-engineering stakeholders.
• Strong proficiency in SQL and Python/PySpark development.
• Expertise in analytics-focused data modelling and data architecture.
• Deep knowledge of Microsoft Fabric technologies, including Lakehouse, Warehouse, Data Pipelines, Notebooks, OneLake Experience with source control and CI/CD practices for data platforms, including Git and Azure DevOps.
• Knowledge of enterprise security, governance, and compliance frameworks, including Entra ID, Row-Level Security (RLS), Microsoft Purview Understanding of data platform operations, including performance, scalability, and cost optimization.
• Practical application of AI-assisted development tools such as Copilot.

Будет плюсом:

• Experience with product telemetry or event-driven data;
• Experience preparing data for AI solutions, including retrieval, vector search, and governed access for agents (for example through MCP);
• Experience with other modern data platforms and tools such as dbt, Snowflake, or Databricks, and with infrastructure as code;
• Microsoft Fabric Data Engineer (DP-700);
• Microsoft Fabric Analytics Engineer (DP-600);
• Familiarity with modern AI data architectures, including Retrieval-Augmented Generation (RAG), Vector Search, MCP-enabled data access and governance;
• Knowledge of modern data engineering ecosystems, including dbt, Snowflake, Databricks, Infrastructure as Code (IaC) practices

Условия:

Role Targeted Variable Pay Mix: 10% Minimum Annual On Target Earning: € 40,000 Maximum Annual On Target Earning: € 60,000