Azure Platform & Data Engineer

emagine; Poland; Remote; PLN 231,000 - 385,000; Full time

Benefits offered by this job

Remote work

Job summary

emagine is seeking an Azure Platform & Data Engineer to design, build and optimize Azure-based infrastructure and data pipelines. You will implement IaC with Terraform, manage Azure networking, storage, security and Databricks environments, and drive CI/CD using Azure DevOps, GitHub actions.

You'll work on data ingestion/ETL, ensure platform reliability, monitoring and governance across 40-hour weeks, with English + Polish language requirements and a long-term engagement.

Qualifications

• Strong experience with Terraform and Azure infrastructure management.
• Proficient in Azure Networking, Storage, IAM and security.
• Experience with Azure DevOps, GitHub and GitHub Actions.
• Proficient in PySpark and SQL for data processing.
• CI/CD experience in cloud environments.

Responsibilities

• Design, build, and maintain Azure-based platform services and infrastructure.
• Define and maintain Infrastructure-as-Code standards using Terraform.
• Manage Azure networking, storage, security, identity, and access management.
• Troubleshoot infrastructure and platform-related issues.
• Drive automation and standardization across development and operational environments.
• Develop and maintain CI/CD pipelines in Azure DevOps.
• Develop and maintain data ingestion and transformation pipelines.
• Work with Azure Data Factory, Databricks, and Data Lake technologies.
• Build and optimize ETL/ELT processes.
• Support data integration from internal and external source systems.

Skills

Terraform

Azure infrastructure

Azure Networking

Azure Storage

Azure Security & IAM

Azure DevOps/GitHub Actions

CI/CD

PySpark

SQL

Tools

Databricks Administration

Databricks Automation Bundles

Azure Data Factory

Job description

• Project language: English + Polish
• Industry: dairy
• Recruitment process: 2 interviews with the client.
• Workload: full-time (40 hours per week).

• Work model: remote.
• Rate: B2B: up to 185 zl/h.
• Start: ASAP
• Project length: > 12 months + possible extensions
• Project language: English + Polish
• Industry: dairy
• Recruitment process: 2 interviews with the client.
• Workload: full-time (40 hours per week).

Summary

The main function of the Azure Platform & Data Engineer role is to manage and enhance the Azure infrastructure and platform capabilities while also engaging in data engineering activities as needed. The primary objective is to ensure reliable, efficient data workflows and environment stabilization within the Azure ecosystem.

Main Responsibilities

• Design, build, and maintain Azure-based platform services and infrastructure.
• Define and maintain Infrastructure-as-Code standards using Terraform.
• Manage Azure networking, storage, security, identity, and access management.
• Troubleshoot infrastructure and platform-related issues.
• Drive automation and standardization across development and operational environments.
• Manage and maintain Databricks workspaces and related services.
• Configure and govern clusters, access controls, and workspace standards.
• Support platform performance, reliability, and operational stability.
• Establish best practices for Databricks usage and deployment.
• Develop and maintain CI/CD pipelines in Azure DevOps.
• Automate platform provisioning and deployment processes.
• Support release management and environment governance.
• Improve monitoring, logging, and operational tooling.
• Develop and maintain data ingestion and transformation pipelines.
• Work with Azure Data Factory, Databricks, and Data Lake technologies.
• Build and optimize ETL/ELT processes.
• Support data integration from internal and external source systems.

Key Requirements

• Strong experience with Terraform.
• Experience in Azure Infrastructure management.
• Knowledge of Azure Networking.
• Proficiency in Azure Storage solutions.
• Understanding of Azure Security & IAM.
• Experience with Azure DevOps, GitHub, and GitHub Actions.
• CI/CD experience.
• Proficiency in Pyspark and SQL.

Nice to Have

• Experience with Databricks Administration.
• Familiarity with Databricks Automation Bundles.
• Experience leveraging Azure Data Factory.
• Knowledge of Data Lake Architecture.

Other Details

• Category: Role Focus; Detail: Platform-focused engineer.
• Category: Skill Distribution; Detail: 35% Azure Platform & Infrastructure, 20% Terraform, 20% Databricks Administration, 25% Data Engineering.