Azure Databricks Solutions Architect

Pyramid Consulting, Inc; Ciudad de México; Presencial; MXN 900.000 - 1.200.000; Jornada completa

Descripción de la vacante

Pyramid Consulting, Inc. seeks a Databricks SME on Azure to design and implement scalable Databricks environments on the Azure platform. You will work with data engineering, analytics, and IT teams to deploy, optimize, and securely manage Databricks solutions across cloud resources.

The role requires deep Databricks expertise and extensive experience with Azure cloud services, including DevOps practices for CI/CD and automation. Collaboration across teams is essential.

Formación

• Deep expertise in Databricks and Azure cloud services.
• Experience designing, implementing, and managing Databricks environments on Azure.
• Ability to work with data engineering, analytics, and IT teams to deploy and manage Databricks solutions.

Responsabilidades

• Architect and deploy scalable Databricks solutions on Azure.
• Develop data pipelines, ETL processes, and ML workflows using Databricks and Azure services.
• Monitor Databricks performance and optimize configurations for cost and efficiency.
• Ensure Databricks environments comply with security standards and regulatory requirements.
• Perform maintenance tasks, updates, patches, and backups; provide advanced support.
• Collaborate with data engineers, scientists, and analysts to optimize data workflows.
• Deliver training on Databricks best practices and document architectures and procedures.

Conocimientos

Databricks architecture

Spark & Delta Lake

Azure services

Python/SQL/Scala

Azure DevOps

Data Factory

Power BI

Cloud cost optimization

Herramientas

Azure DevOps

Jenkins

GitHub Actions

Nexus

JIRA

Descripción del empleo

Pyramid Consulting, Inc. seeks a Databricks SME on Azure to design and implement scalable Databricks environments on the Azure platform. You will work with data engineering, analytics, and IT teams to deploy, optimize, and securely manage Databricks solutions across cloud resources.

The role requires deep Databricks expertise and extensive experience with Azure cloud services, including DevOps practices for CI/CD and automation. Collaboration across teams is essential.