Senior Data Platform Engineer

Margo

Poland

Remote

PLN 350,000 - 520,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Margo in Poland seeks a Senior Data Platform Engineer to evolve our Azure-based data platform and lakehouse architecture. You will own the foundations and work hands-on with Airflow orchestration, Azure resource management, and Databricks governance to enable data product teams.

You will collaborate with architects and product owners, lead CI/CD and IaC efforts, monitor observability, and drive cost efficiency while delivering reliable data pipelines for enterprise-scale workloads.

Qualifications

  • Experience operating large Azure-based data platforms.
  • Experience with Apache Airflow and DAG management.
  • Proficiency with Terraform-based IaC for cloud resources.
  • Experience with Databricks and Unity Catalog governance.
  • Understanding of cost governance, tagging and budgets.

Responsibilities

  • Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards.
  • Migrate from Azure Data Factory to Airflow and evolve the metadata-driven orchestration framework.
  • Ensure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring.

Skills

Airflow orchestration
Azure Data Platform
Databricks governance
Unity Catalog
Observability
Cost efficiency
Terraform
CI/CD pipelines
Least privilege
Developer tooling

Tools

Databricks
Azure DevOps
Key Vault

Job description

We are looking for a Senior Data Platform Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture .

This role is focused on the platform itself . The professional will own and evolve the foundations that data product teams build on: Apache Airflow orchestration (migrating from ADF) , Azure resource management (Key Vault, identity and access, networking, storage), Azure DevOps CI/CD and Infrastructure as Code , Databricks and Unity Catalog governance , observability and cost efficiency , while remaining hands-on and close to the teams that use the platform.

Key Responsibilities

Orchestration Platform (Apache Airflow & ADF)

  • Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards .
  • Work on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven Orchestration Framework (DAG generation, reusable operators, dependency and scheduling patterns).
  • Ensure Airflow is reliable and observable : SLAs, alerting, retries, backfills, health monitoring and clear failure ownership.

Azure Resource Management

  • Manage Azure resources with Infrastructure as Code (Terraform) : Databricks workspaces, Data Lake Storage , Data Factory, Key Vault , networking and supporting services.
  • Own secrets and identity management : Key Vault, service principals and managed identities, secret scopes and rotation.
  • Own access management : Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following least privilege , plus access requests and periodic reviews.
  • Own Azure DevOps : repositories, CI/CD pipelines , branch policies and multi-environment promotion , including deployment validation and Terraform state.
  • Track cost and governance of Azure resources: tagging, budgets, right-sizing and cost attribution (e.g. query tagging).

Hands-on Data Platform evolution

  • Contribute to the implementation of the Data Catalog and Data Quality Framework and it’s lineage across the platform.
  • Drive observability : pipelines that are observable, debuggable and alert-driven, with clear ownership of failures.
  • Operate the Databricks platform: Unity Catalog structure, cluster and job policies, Auto Loader ingestion patterns, and performance and cost optimization of workloads.

Technical Leadership

  • Participate in architecture reviews and technical decision-making, stating trade-offs (performance, cost, reliability, complexity) with data.
  • Define and promote engineering standards : naming conventions, patterns and guidelines, through code reviews and design reviews.
  • Collaborate with Architects, Product Owners and data engineers in technical maturation of data products.
  • Build and maintain developer tooling and automation , including AI-assisted engineering workflows (shared agent instructions, skills, automated PR review).

Support & Operations (Run Team Collaboration)

  • Provide second-line support to the Run/Operations team for complex production topics.
  • Troubleshoot and resolve platform incidents , failures and performance issues; lead root cause analysis and post-mortems.
  • Ensure proper handover, documentation and operational readiness of platform changes.
  • Continuously improve runbooks, monitoring and operational processes .
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer CR 12/11/26
Senior Data Platform Engineer CR 12/11/26

Margo Group • Warszawa

On-site
PLN 248,000 - 276,000
DataOps Consultant, Lakehouse Support
DataOps Consultant, Lakehouse Support

Luxoft • Polska

On-site
PLN 180,000 - 240,000
Data Architect
Data Architect

Link Group • Województwo mazowieckie

On-site
PLN 120,000 - 180,000
DAMA-DMBOK
TOGAF
Senior Data Engineer Azure (ID: 4054)
Senior Data Engineer Azure (ID: 4054)

Stafide • Warszawa

On-site
PLN 180,000 - 240,000
Remote Data Engineer - Azure & Databricks Platform
Remote Data Engineer - Azure & Databricks Platform

QAPOT • Polska

Hybrid
PLN 140,000 - 200,000
Data Engineer
Data Engineer

QAPOT • Polska

Hybrid
PLN 140,000 - 200,000
Senior Data Engineer (Azure / Snowflake / DevOps)
Senior Data Engineer (Azure / Snowflake / DevOps)

Vecten • Województwo mazowieckie

On-site
PLN 180,000 - 250,000
Azure Platform Engineer — Cloud Infra, Kubernetes & Data
Azure Platform Engineer — Cloud Infra, Kubernetes & Data

Solid Company • Wrocław

On-site
PLN 220,000 - 300,000
Data Platform Engineer/Lakehouse Architecture
Data Platform Engineer/Lakehouse Architecture

Infotree Global Solutions Inc. • Kraków

On-site
PLN 240,000 - 360,000
Senior Data Engineer/Analyst - Azure Databricks
Senior Data Engineer/Analyst - Azure Databricks

Euroclear • Polska

On-site
PLN 180,000 - 260,000
Top locations