Senior Platform Engineer (Azure Infrastructure)

EPAM Systems; Deutschland; Hybrid; EUR 42.000 - 55.000; Vollzeit

Zusammenfassung

EPAM Systems in Poland is seeking an Azure Databricks Platform Engineer to join our team in a remote or hybrid role. You will ensure stability, scalability, and security of Azure Databricks and Data Lake environments to enable advanced analytics and governance at scale.

You will implement automation, governance frameworks, and performance optimizations, collaborate with stakeholders to align standards, and document best practices while troubleshooting issues and driving reliability across

Qualifikationen

• Experience with Azure Databricks and Data Lake Storage Gen2.
• Hands-on with Terraform for deploying and managing Databricks infrastructure.
• Proficiency in Python for automation and scripting.
• Familiarity with REST APIs for system configuration.
• Understanding of RBAC and Entra ID for access control.
• Knowledge of Databricks governance, including Unity Catalog for security and data lineage.
• Exposure to DevOps practices including observability, monitoring, and incident response.
• Experience in enterprise/global organizations.

Aufgaben

• Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces.
• Implement and enforce access control using RBAC and Entra ID.
• Apply Databricks governance concepts, including Unity Catalog, data lineage, and access policies.
• Develop automation scripts and REST API integrations for environment configuration and monitoring.
• Monitor platform health, ensure operational reliability, and handle incident response.
• Collaborate with stakeholders to align platform standards and governance practices.
• Troubleshoot and resolve platform issues, optimizing performance and efficiency.
• Document processes and maintain platform best practices.

Kenntnisse

Azure Databricks

Data Lake Storage Gen2

RBAC & Entra ID

Python scripting

REST APIs

Terraform

DevOps practices

Data governance

Tools

Azure Databricks

Data Lake Storage Gen2

RBAC

Entra ID

Terraform

Python

REST APIs

Unity Catalog

Data governance concepts

Jobbeschreibung

We're looking for an Azure Databricks Platform Engineer to join our team in Poland in a remote or hybrid working mode. In this role, you’ll ensure the stability, scalability, and security of our Azure Databricks and Data Lake environments, enabling advanced data analytics and governance at scale. You’ll contribute to efficient data operations by implementing automation, governance frameworks, and performance optimizations that impact mission-critical data processes.

Responsibilities

• Administer and manage Azure Databricks and Data Lake Storage Gen2 workspaces
• Implement and enforce access control using RBAC and Entra ID
• Apply Databricks governance concepts, including Unity Catalog, data lineage, and access policies
• Develop automation scripts and REST API integrations for environment configuration and monitoring
• Monitor platform health, ensure operational reliability, and handle incident response
• Collaborate with stakeholders to align platform standards and governance practices
• Troubleshoot and resolve platform issues, optimizing performance and efficiency
• Document processes and maintain platform best practices

Requirements

• Strong experience with Microsoft Azure services, particularly Azure Databricks and Data Lake Storage
• Proficiency in Azure access management (RBAC, Entra ID)
• Knowledge of Databricks governance, including Unity Catalog for security and data lineage
• Hands-on experience using Terraform for deploying and managing Databricks infrastructure
• Basic Python programming skills for automation and scripting
• Familiarity with REST APIs for system configuration
• Understanding of DevOps principles including observability, monitoring, and incident response
• Experience working in enterprise environments, ideally global organizations
• Strong analytical and problem-solving abilities

Nice to have

• Familiarity with Agile methodologies (Scrum, SAFe)
• Experience in Databricks administration such as job orchestration and cluster policy design
• Contributions to shared automation or governance frameworks
• Knowledge of infrastructure-as-code tools (e.g., Terraform, ARM templates)
• Exposure to CI/CD pipelines and DevOps toolchains