Senior Azure Databricks Engineer

Global Technical Talent, an Inc. 5000 Company; Glendale (AZ); Hybrid; USD 71,000 - 92,000; Part time

Benefits offered by this job

Medical, Vision, and Dental Insurance

401k Retirement Fund

Job summary

Senior Azure Databricks Engineer based in Glendale, AZ, with 8 to 10 years of experience required. The role collaborates with Data Platforms and Integration teams to architect scalable enterprise data platform solutions using Azure Databricks, Delta Lake, Unity Catalog, and related Azure services.

The engineer will design data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics workloads, while maintaining security, governance, and cost optimization.

Qualifications

• 8–10 years designing and implementing enterprise data platforms.
• 5+ years hands-on Azure Databricks experience in enterprise environments.
• Experience with architecting modern Lakehouse solutions using Azure Databricks and Delta Lake.
• Experience administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security.

Responsibilities

• Collaborate with Data Platforms and Integration team in architecting and implementing scalable enterprise data platform solutions utilizing Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, and related Azure services.
• Design and develop enterprise data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics workloads.
• Administer and maintain Azure Databricks workspaces including cluster configuration, job scheduling, workspace administration, Unity Catalog implementation, secret management, compute policies, cluster policies, and workspace governance.
• Define and implement enterprise security architecture including identity integration with Microsoft Entra ID (Azure AD), RBAC, PIM, data encryption, private networking, managed identities, Key Vault integration, and secure access patterns.
• Establish enterprise data governance standards utilizing Unity Catalog including data lineage, data quality, metadata management, catalog organization, access policies, and audit capabilities.
• Optimize Databricks workloads through performance tuning, Spark optimization, cluster sizing, workload isolation, caching strategies, partitioning, Delta optimization, Photon, and cost optimization best practices.
• Design enterprise monitoring, logging, operational dashboards, alerting, and platform health monitoring utilizing Azure Monitor, Log Analytics, Application Insights, and Databricks system tables.
• Develop reusable architecture patterns, reference implementations, development standards, naming conventions, coding standards, operational procedures, and platform documentation.
• Support migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehouse architecture.
• Provide technical support and troubleshooting for production incidents related to Azure Databricks, Spark workloads, data pipelines, and platform infrastructure.

Skills

Azure Databricks expertise

Apache Spark (PySpark/Spark SQL)

CI/CD with Azure DevOps

Data governance with Unity Catalog

Azure Data Lake Storage Gen2

Security architecture (RBAC, Private)

Data modelling (Dim modelling, Data Ve

Performance optimization (Databricks/“

Python

SQL

Cluster management

Tools

Azure Databricks

Unity Catalog

Delta Lake

Photon

Azure Data Lake Storage Gen2

Key Vault

Azure Monitor

Application Insights

Log Analytics

Azure Entra ID

Job description

Onsite Flexibility: Hybrid — 3 days onsite per week

• Position Type: Contract
• Contract Duration: 12 months
• Pay Rate: $51.40–$66.71 / Hour (USD)
• Work Authorization: Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

Senior Azure Databricks Engineer

Location: Glendale, AZ

Contract Details

• Position Type: Contract
• Contract Duration: 12 months
• Pay Rate: $51.40–$66.71 / Hour (USD)
• Work Authorization: Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

Job Summary

This role is for a Senior Azure Databricks Engineer based in Glendale, AZ, with 8 to 10 years of experience required. The engineer will collaborate with Data Platforms and Integration teams to architect and implement scalable enterprise data platform solutions.

Key Responsibilities

• Collaborate with Data Platforms and Integration team in architecting and implementing scalable enterprise data platform solutions utilizing Azure Databricks, Delta Lake, Unity Catalog, Azure Data Lake Storage Gen2, and related Azure services.
• Design and develop enterprise data engineering frameworks supporting batch, streaming, ELT/ETL, and real-time analytics workloads.
• Administer and maintain Azure Databricks workspaces including cluster configuration, job scheduling, workspace administration, Unity Catalog implementation, secret management, compute policies, cluster policies, and workspace governance.
• Define and implement enterprise security architecture including identity integration with Microsoft Entra ID (Azure AD), Role-Based Access Control (RBAC), Privileged Identity Management (PIM), data encryption, private networking, managed identities, Key Vault integration, and secure access patterns.
• Establish enterprise data governance standards utilizing Unity Catalog including data lineage, data quality, metadata management, catalog organization, access policies, and audit capabilities.
• Optimize Databricks workloads through performance tuning, Spark optimization, cluster sizing, workload isolation, caching strategies, partitioning, Delta optimization, Photon, and cost optimization best practices.
• Design enterprise monitoring, logging, operational dashboards, alerting, and platform health monitoring utilizing Azure Monitor, Log Analytics, Application Insights, and Databricks system tables.
• Develop reusable architecture patterns, reference implementations, development standards, naming conventions, coding standards, operational procedures, and platform documentation.
• Support migration of legacy enterprise data warehouses, ETL solutions, and reporting platforms to Azure Databricks and modern Lakehouse architecture.
• Provide technical support and troubleshooting for production incidents related to Azure Databricks, Spark workloads, data pipelines, and platform infrastructure.

Required Experience

• At least 8–10 years of experience in designing and implementing enterprise data platforms.
• At least 5 years of hands‑on Azure Databricks experience in enterprise environments.

Required Skills

• Experience with architecting modern Lakehouse solutions using Azure Databricks and Delta Lake.
• Experience in administering Azure Databricks workspaces, clusters, Unity Catalog, compute policies, job orchestration, and workspace security.
• Experience in developing data engineering solutions using Apache Spark (PySpark and/or Spark SQL).
• Experience in implementing enterprise data governance utilizing Unity Catalog, metadata management, data lineage, and fine‑grained access controls.
• Experience designing and working with enterprise security architectures including RBAC, Managed Identities, Private Endpoints, Key Vault integration, encryption, and network security.
• Experience implementing enterprise data quality frameworks, monitoring, observability, and operational dashboards.
• Strong understanding of data modelling techniques including dimensional modelling, Data Vault, medallion architecture, and enterprise data warehouse concepts.
• Strong knowledge of Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, Microsoft Entra ID (Azure AD), and Azure networking.
• Strong SQL programming skills and proficiency in Python and PySpark development.
• Strong experience implementing CI/CD pipelines utilizing Azure DevOps, automated testing, release management, and deployment automation.

Benefits

• Medical, Vision, and Dental Insurance Plans
• 401k Retirement Fund

About the Client

This client is a privately held global leader in engineering, procurement, and construction, with more than 125 years of experience delivering complex infrastructure projects across 160 countries on all seven continents — totaling more than 25,000 projects. The organization's portfolio spans energy and industrial, infrastructure, nuclear and environmental remediation, government services, and mining and metals, serving national governments, global energy companies, and the world's largest public agencies at exceptional scale. With a Glassdoor rating of 4.0 stars from nearly 2,500 employee reviews — including a 4.0‑star rating for career opportunities, one of the highest in its sector — the organization has earned strong employee endorsement, with 78 percent of employees recommending it to a friend. Teams here include civil and structural engineers, project controls specialists, procurement managers, SAP technical specialists, ERP developers, and nuclear and environmental remediation professionals who operate in demanding, fast‑paced environments on landmark projects of global scope.

About GTT

GTT is a minority-owned staffing firm and a subsidiary of Chenega Corporation, a Native American-owned company in Alaska. We highly value diverse and inclusive workplaces and support Fortune 500 organizations across banking, financial services, technology, life sciences, biotech, utilities, and retail sectors throughout the U.S. and Canada.

Job Number: 26-16439 Industry: Information Technology