Senior Azure & Databricks Infrastructure Architect (Remote)

Interon IT Solutions; Dublin (CA); Remoto; USD 150.000 - 210.000; Tempo pieno

Descrizione del lavoro

Interon IT Solutions is seeking a Senior Infrastructure Architect to design and support Azure and Azure Databricks platforms for enterprise clients in a remote setting. You will build scalable analytics environments, assist with onboarding and migrating applications to Databricks, and enhance data access and platform operations.

The role emphasizes collaboration with cross-functional teams in an Agile environment, focusing on platform architecture, provisioning, configuration, and operational

Competenze

• Approximately 7 years of experience in infrastructure, cloud, or data platform engineering.
• Hands-on experience writing Spark jobs using PySpark.
• Experience integrating data platforms with Azure Data Lake Storage (ADLS).
• Experience building and managing Azure Data Factory (ADF) pipelines.
• Experience with Azure Databricks workspaces, Unity Catalog, and Delta Sharing.
• Strong knowledge of Azure resource provisioning, security, and RBAC.
• Experience supporting Azure IaaS and PaaS services in production environments.
• Familiarity with Azure networking, Azure Policy, Linux, Python or Bash scripting, and ARM templates.
• Understanding of Azure high availability and disaster recovery approaches.
• Experience working with Agile teams.
• Preferred experience provisioning Azure AI services such as Azure Bot Service, Text Analytics, and related offerings.

Mansioni

• Design and implement Databricks Delta Sharing across the organization and its affiliates.
• Deploy and configure Azure Databricks workspaces.
• Onboard applications to Databricks and support migration.
• Build and configure Unity Catalog, including troubleshooting workspace access issues.
• Design, develop, and optimize data pipelines using PySpark, ADLS, and Azure Data Factory.
• Create and configure Azure resources, access controls, and RBAC.
• Provision, secure, and support Azure services used by application teams.
• Design and deploy Platform as a Service (PaaS) solutions using Azure services.
• Troubleshoot Azure resource issues across IaaS and PaaS services.
• Apply Azure high availability and disaster recovery patterns.
• Work with Azure networking, Azure Policy, Linux, and scripting tools such as Bash and Python.
• Use ARM templates to provision and manage Azure infrastructure.
• Collaborate with cross-functional teams using Agile methodologies.

Conoscenze

PySpark

Azure cloud

Architecture design

RBAC

IaaS

PaaS

Agile

Security controls

Strumenti

Azure Databricks

Unity Catalog

Delta Sharing

Azure Data Factory

ARM templates

RBAC

Descrizione del lavoro

Interon IT Solutions is seeking a Senior Infrastructure Architect to design and support Azure and Azure Databricks platforms for enterprise clients in a remote setting. You will build scalable analytics environments, assist with onboarding and migrating applications to Databricks, and enhance data access and platform operations.

The role emphasizes collaboration with cross-functional teams in an Agile environment, focusing on platform architecture, provisioning, configuration, and operational