Cloud Infrastructure & Platform Specialist, Databricks, AWS, Azure – Mid-Level

Jobtailor; Deutschland; Remote; EUR 90.000 - 120.000; Vollzeit

Zusammenfassung

Jobtailor is seeking a cloud infrastructure and platform engineering specialist to provision and manage AWS and Azure environments supporting a Databricks-based data estate. You will handle VPCs, networking, storage, compute, and private endpoints while enforcing secure DEV/QA/PROD guardrails.

Responsibilities include onboarding Data Engineering, Data Science, and MLOps projects, defining cluster policies, and guiding IAM access. Strong IAM, governance, and FinOps focus are required.

Qualifikationen

• 3-5 years of experience in cloud infrastructure, platform engineering, cloud administration, or a closely related role.
• Hands-on experience with both AWS and Microsoft Azure, including IAM and role provisioning, cloud networking, storage services, and compute and platform resources.
• Hands-on experience administering Databricks, including workspace provisioning and configuration, Unity Catalog, catalogs and schemas, metastores, cluster policies, and workspace and data-access controls.
• Working knowledge of Infrastructure-as-Code (IaC) tools; Terraform preferred.
• Experience with Azure ARM/Bicep or AWS CloudFormation is valuable.
• Strong understanding of IAM concepts, including RBAC, least-privilege access, service principals, managed identities, SSO, SCIM, and SAML.
• Familiarity with VPC/VNet architecture, subnets and routing, private connectivity, network segmentation, secrets management, encryption, and key management.
• Ability to quickly troubleshoot infrastructure, networking, identity, permission, and platform-access issues.
• Strong communication skills for explaining infrastructure and access issues to technical teams.
• Familiarity with SOC 2, ISO 27001, and GDPR.
• Understanding of audit logging, access reviews, administrative activity tracking, and evidence collection.
• Preferred: Experience supporting Data Engineering, Data Science, and MLOps teams
• Preferred: Experience with CI/CD, GitHub Actions, Databricks Asset Bundles, infrastructure deployment automation, and DEV QA PROD promotion
• Preferred: FinOps and cloud cost-management practices
• Preferred: Experience implementing cloud and Databricks policies
• Preferred: Certifications such as AWS Solutions Architect, Azure Solutions Architect, Azure Administrator, or Databricks Platform Administrator
• Nice to have: Asset Integrity Pipeline, auditability, and controlled-access experience

Aufgaben

• Provision, configure, and manage AWS and Azure infrastructure supporting Databricks-based data estate.
• Manage VPCs/VNets, subnets, route tables, storage, compute resources, private endpoints, and related networking services.
• Establish and maintain secure DEV, QA, and PROD environments with isolation and platform guardrails.
• Support cloud landing-zone implementation and enforce security, governance, and cost policies.
• Version, review, test, and deploy infrastructure changes through controlled workflows.
• Troubleshoot infrastructure, networking, and cloud-service issues affecting data and ML workloads.
• Manage IAM roles, service principals, managed identities, groups, access policies, RBAC, identity federation, and access reviews.
• Create and administer Databricks workspaces, Unity Catalog metastores, catalogs, schemas, storage credentials, external locations, and permissions.
• Onboard Data Engineering, Data Science, and MLOps projects with appropriate platform resources and access.
• Define and maintain Databricks cluster policies and workspace-level guardrails.
• Act as the primary escalation point for Databricks platform and infrastructure issues.
• Implement private connectivity, network segmentation, encryption, key management, audit logging, and compliance controls.
• Monitor spend, enforce tagging and resource policies, support showback/chargeback, and optimize cloud and Databricks costs.
• Automate workspace provisioning, catalog and schema setup, IAM assignment, access provisioning, environment configuration, and platform onboarding.
• Monitor platform health, respond to incidents, troubleshoot production issues, and maintain runbooks and technical documentation

Kenntnisse

AWS Cloud Infrastructure Management

Azure Cloud Administration

Databricks Administration

Terraform

IAM Role Provisioning

VPC/VNet Configuration

Cloud Networking

Audit Logging

Cost Management

Tools

Terraform

AWS CloudFormation

Azure ARM/Bicep

Databricks

GitHub Actions

Jobbeschreibung

Provision, configure, and manage AWS and Azure cloud infrastructure supporting Irth’s Databricks-based data estate
Manage VPCs/VNets, subnets, route tables, storage, compute resources, private endpoints, and related networking services
Establish and maintain secure DEV, QA, and PROD environments with isolation and platform guardrails
Support cloud landing-zone implementation and enforce security, governance, and cost policies
Version, review, test, and deploy infrastructure changes through controlled workflows
Troubleshoot infrastructure, networking, and cloud-service issues affecting data and ML workloads
Manage IAM roles, service principals, managed identities, groups, access policies, RBAC, identity federation, and access reviews
Create and administer Databricks workspaces, Unity Catalog metastores, catalogs, schemas, storage credentials, external locations, and permissions
Onboard Data Engineering, Data Science, and MLOps projects with appropriate platform resources and access
Define and maintain Databricks cluster policies and workspace-level guardrails
Act as the primary escalation point for Databricks platform and infrastructure issues
Implement private connectivity, network segmentation, encryption, key management, audit logging, and compliance controls
Monitor spend, enforce tagging and resource policies, support showback/chargeback, and optimize cloud and Databricks costs
Automate workspace provisioning, catalog and schema setup, IAM assignment, access provisioning, environment configuration, and platform onboarding
Monitor platform health, respond to incidents, troubleshoot production issues, and maintain runbooks and technical documentation

Requirements

• 3-5 years of experience in cloud infrastructure, platform engineering, cloud administration, or a closely related role
• Hands-on experience with both AWS and Microsoft Azure, including IAM and role provisioning, cloud networking, storage services, and compute and platform resources
• Hands-on experience administering Databricks, including workspace provisioning and configuration, Unity Catalog, catalogs and schemas, metastores, cluster policies, and workspace and data-access controls
• Working knowledge of Infrastructure-as-Code (IaC) tools; Terraform preferred
• Experience with Azure ARM/Bicep or AWS CloudFormation is valuable
• Strong understanding of IAM concepts, including RBAC, least-privilege access, service principals, managed identities, SSO, SCIM, and SAML
• Familiarity with VPC/VNet architecture, subnets and routing, private connectivity, network segmentation, secrets management, encryption, and key management
• Ability to quickly troubleshoot infrastructure, networking, identity, permission, and platform-access issues
• Strong communication skills for explaining infrastructure and access issues to technical teams
• Familiarity with SOC 2, ISO 27001, and GDPR
• Understanding of audit logging, access reviews, administrative activity tracking, and evidence collection
• Preferred: Experience supporting Data Engineering, Data Science, and MLOps teams
• Preferred: Experience with CI/CD, GitHub Actions, Databricks Asset Bundles, infrastructure deployment automation, and DEV QA PROD promotion
• Preferred: FinOps and cloud cost-management practices
• Preferred: Experience implementing cloud and Databricks policies
• Preferred: Relevant industry certifications such as AWS Solutions Architect, Microsoft Azure Solutions Architect, Azure Administrator, or Databricks Platform Administrator
• Nice to have: Asset Integrity Pipeline, utility, energy, oil & gas, pipeline, GIS, geospatial, regulatory, compliance, data residency, auditability, and controlled-access experience

Core Competencies

Demonstrates expertise in managing AWS and Azure cloud infrastructure, with a strong focus on Databricks administration, IAM management, and Infrastructure-as-Code practices. Proficient in troubleshooting and optimizing cloud environments while ensuring compliance and security standards are met.

Highest-signal resume keywords

• AWS Cloud Infrastructure Management
• Azure Cloud Administration
• Databricks Administration
• Infrastructure-as-Code (IaC) with Terraform
• IAM Role Provisioning and Management

ATS Optimization Keywords

Hard Skills

• Cloud Infrastructure Management
• Databricks Workspace Provisioning
• IAM Role Management
• VPC/VNet Configuration
• Infrastructure-as-Code (IaC)
• Cloud Networking
• Storage Services Management
• Audit Logging
• Cost Management
• Network Segmentation

Soft Skills

• Strong Communication Skills
• Problem-Solving Abilities

Certifications & Qualifications

• AWS Solutions Architect
• Microsoft Azure Solutions Architect
• Azure Administrator
• Databricks Platform Administrator

Industry Keywords

• SOC 2
• ISO 27001
• GDPR
• Data Engineering
• Data Science
• MLOps
• FinOps
• Compliance
• Auditability
• Controlled-Access

Tools & Technologies

• Terraform
• AWS CloudFormation
• Azure ARM/Bicep
• Databricks
• GitHub Actions