Senior Azure Databricks & Lakehouse Engineer

Environmental and Safety Solutions, Inc.; Glendale (AZ); Presencial; USD 140.000 - 180.000; Jornada completa

Descripción de la vacante

Environmental and Safety Solutions, Inc. is seeking a Senior Azure Databricks Engineer to design, implement, and govern enterprise data platforms on Azure.

You will work with cross-functional teams to build scalable data pipelines, enforce security controls, and drive the Lakehouse initiative using Databricks, Unity Catalog, and Delta Lake. Responsibilities include workspace administration, governance, performance optimization, monitoring, and migration of legacy systems to modern Data Lakehouse

Formación

• 8–10 years designing enterprise data platforms.
• 5+ years hands-on Azure Databricks in enterprise environments.
• Experience with Delta Lake and Unity Catalog in Lakehouse architecture.
• Strong SQL and Python/PySpark development skills.
• Experience with security, governance, and RBAC in Azure.
• Experience with CI/CD pipelines using Azure DevOps.

Responsabilidades

• Collaborate with Data Platforms and Integration teams to architect scalable data platform solutions on Azure Databricks.
• Design and develop enterprise data engineering frameworks for batch, streaming, ELT/ETL, and real-time analytics.
• Administer and maintain Azure Databricks workspaces, Unity Catalog, and security configurations.
• Define and implement enterprise security architecture with Entra ID, RBAC, PIM, Key Vault.
• Establish data governance standards using Unity Catalog including lineage and metadata management.
• Optimize workloads with Spark tuning, Delta optimization, and cost controls.
• Develop monitoring, dashboards, and platform health using Azure Monitor and Log Analytics.
• Create reusable architecture patterns and documentation.
• Support migration of legacy data warehouses to Lakehouse architecture.
• Provide incident response and troubleshooting for Databricks and data pipelines.

Conocimientos

Python

PySpark

SQL

Data modeling

CI/CD

Herramientas

Azure Databricks

Delta Lake

Unity Catalog

Azure Data Lake Storage Gen2

Azure Monitor

Azure AD

Key Vault

Azure DevOps

Descripción del empleo

Environmental and Safety Solutions, Inc. is seeking a Senior Azure Databricks Engineer to design, implement, and govern enterprise data platforms on Azure.

You will work with cross-functional teams to build scalable data pipelines, enforce security controls, and drive the Lakehouse initiative using Databricks, Unity Catalog, and Delta Lake. Responsibilities include workspace administration, governance, performance optimization, monitoring, and migration of legacy systems to modern Data Lakehouse