Senior Platform Engineer (Azure Infrastructure)

EPAM Systems; Poland; On-site; PLN 180,000 - 240,000; Full time

Job summary

EPAM Systems, Inc. in Poland is seeking an Azure Databricks Platform Engineer to ensure stability, scalability, and security of Azure Databricks and Data Lake environments in a remote or hybrid setting.

You will implement automation, governance, and performance optimizations that impact mission-critical data processes. Collaborate with stakeholders to align platform standards, monitor health, and drive incident response while applying Databricks governance concepts such as Unity Catalog and data

Qualifications

• Experience with Azure Databricks and Data Lake Storage in enterprise environments.
• Strong knowledge of RBAC and Entra ID.
• Hands-on with Terraform for Databricks deployment.
• Basic Python scripting for automation.
• Familiarity with Unity Catalog and data governance concepts.
• DevOps practices including monitoring and incident response.

Responsibilities

• Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces.
• Implement access control using RBAC and Entra ID.
• Apply governance concepts including Unity Catalog and data lineage.
• Develop automation scripts and REST API integrations for environment configuration and monitoring.
• Monitor platform health, ensure operational reliability, and handle incident response.
• Collaborate with stakeholders to align platform standards and governance practices.
• Troubleshoot and resolve platform issues, optimizing performance and efficiency.
• Document processes and maintain platform best practices.

Skills

Azure Databricks

Data Lake Storage

RBAC

Entra ID

Unity Catalog

Terraform

Python basics

REST APIs

DevOps observability

Monitoring

Troubleshooting

Data governance

Tools

Terraform

Job description

We're looking for an Azure Databricks Platform Engineer to join our team in Poland in a remote or hybrid working mode. In this role, you’ll ensure the stability, scalability, and security of our Azure Databricks and Data Lake environments, enabling advanced data analytics and governance at scale. You’ll contribute to efficient data operations by implementing automation, governance frameworks, and performance optimizations that impact mission-critical data processes.

Responsibilities

• Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces
• Implement and enforce access control using RBAC and Entra ID
• Apply Databricks governance concepts, including Unity Catalog, data lineage, and access policies
• Develop automation scripts and REST API integrations for environment configuration and monitoring
• Monitor platform health, ensure operational reliability, and handle incident response
• Collaborate with stakeholders to align platform standards and governance practices
• Troubleshoot and resolve platform issues, optimizing performance and efficiency
• Document processes and maintain platform best practices

Requirements

• Strong experience with Microsoft Azure services, particularly Azure Databricks and Data Lake Storage
• Proficiency in Azure access management (RBAC, Entra ID)
• Knowledge of Databricks governance, including Unity Catalog for security and data lineage
• Hands‑on experience using Terraform for deploying and managing Databricks infrastructure
• Basic Python programming skills for automation and scripting
• Familiarity with REST APIs for system configuration
• Understanding of DevOps principles including observability, monitoring, and incident response
• Experience working in enterprise environments, ideally global organizations
• Strong analytical and problem‑solving abilities

Nice to have

• Familiarity with Agile methodologies (Scrum, SAFe)
• Experience in Databricks administration such as job orchestration and cluster policy design
• Contributions to shared automation or governance frameworks
• Knowledge of infrastructure‑as‑code tools (e.g., Terraform, ARM templates)
• Exposure to CI/CD pipelines and DevOps toolchains