Data Platform DevOps Engineer

All European Careers BENELUX; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

All European Careers BENELUX ищет опытного инженера платформы данных для проектирования и поддержки экосистемы на базе Microsoft Fabric, Azure Data Factory и Power BI. В задачи входит настройка CI/CD, IaC, автоматизация развёртываний и мониторинг критических сервисов.

Требуется 5+ лет опыта в DevOps/SRE, глубина знаний Azure и Fabric, владение Python/PowerShell/Bash/SQL, англ.)

Qualifications

• Образование: бакалавр или магистр.
• Опыт не менее 5 лет в DevOps, платформах/ reliability engineering.
• Не менее 3 лет практического опыта с Microsoft Azure и Azure DevOps.
• Сильный опыт работы с Microsoft Fabric или аналогичными платформами (Azure Synapse, Data Factory, Power BI).
• Опыт развёртывания Fabric workspaces, capacity и компонентов, знание архитектуры OneLake.
• Глубокие знания CI/CD, IaC и автоматизации развёртываний.
• Владение Python, PowerShell, Bash и SQL.
• Опыт работы с облачным хранением, управляемыми базами данных и оркестрацией ETL/ELT.
• Сильные навыки мониторинга, observability, cloud security, identity management и оптимизации производительности.

Responsibilities

• Задачи: проектирование, сборка и поддержка платформы данных на базе Microsoft Fabric.
• Поддержка CI/CD конвейеров и интеграции с Azure DevOps и REST API.
• Автоматизация инфраструктуры через IaC и скрипты.
• Управление рабочими пространствами Fabric, емкостями и компонентами, мониторинг и оптимизация затрат.
• Настройка мониторинга, алертинга и инцидент-разбор.

Skills

English proficiency

Education

Bachelor's or Master's degree

Tools

Python

PowerShell

Bash

SQL

Azure

Azure DevOps

Microsoft Fabric

OneLake

Terraform

Ansible

ARM templates

GitHub Actions

Docker

Kubernetes

PySpark

Delta Lake

Parquet

Power BI

Job description

Задачи

• Design, build, and maintain the Microsoft Fabric data platform, including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, and Power BI environments
• Build and maintain CI/CD pipelines using Azure DevOps, Fabric Git integration, deployment pipelines, REST APIs, and automation tooling
• Automate infrastructure provisioning, configuration, and deployments using Infrastructure as Code (IaC) and scripting
• Manage Fabric workspaces, capacities, and platform components, including performance, resource utilization, and cost optimization
• Implement monitoring, observability, and alerting across the data platform
• Support incident response and root cause analysis
• Implement platform security, including RBAC, Microsoft Entra, managed identities, encryption, access controls, and data protection
• Support scalable ETL/ELT, data pipeline, and OneLake architectures, including orchestration, storage optimization, and platform integrations
• Collaborate with data engineers, data scientists, analysts, developers, security, and compliance teams to improve platform reliability and developer experience

Требования

• Bachelor's or Master's degree
• At least 5 years of experience in DevOps, platform engineering, or Site Reliability Engineering (SRE)
• At least 3 years of hands-on experience with Microsoft Azure and Azure DevOps
• Strong experience with Microsoft Fabric or related Microsoft data platforms, such as Azure Synapse Analytics, Azure Data Factory, or Power BI
• Experience deploying and managing Microsoft Fabric workspaces, capacities, and items, with knowledge of OneLake architecture
• Strong knowledge of CI/CD, Infrastructure as Code, and deployment automation
• Proficiency in Python, PowerShell, Bash, and SQL
• Experience with cloud storage and managed database services, as well as scalable ETL/ELT and data pipeline orchestration
• Strong knowledge of monitoring, observability, cloud security, identity management, and data platform performance optimization
• Fluent English, both written and spoken

Будет плюсом

• Terraform
• Ansible
• ARM templates
• GitHub Actions
• Docker
• Kubernetes
• Fabric REST APIs
• Microsoft Purview
• Power BI administration
• multi-region or multi-cloud environments
• Delta Lake
• Parquet
• PySpark
• data lakehouse and medallion architectures
• real-time analytics
• streaming
• MLOps
• AI workload integration

Условия

Employee or Contractor Work permit is not provided