Databricks Data Architect

buscojobs Brasil; Paraná; Teletrabalho; BRL 160.000 - 200.000; Tempo integral

Resumo da oferta

A tech solutions company is seeking a Solution Architect with expertise in Azure Databricks for a remote position. The role involves leading data architecture, ensuring best practices, and collaborating with cross-functional teams. The ideal candidate will have proven experience with Unity Catalog, PySpark, and Delta Live Tables, along with strong problem-solving skills and stakeholder management.

Qualificações

• Proven experience as a Solution Architect or Senior Data Engineer working with Azure Databricks.
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing and transformation.

Responsabilidades

• Lead solution architecture and design for Azure Databricks projects.
• Implement and manage Unity Catalog for data governance and security.
• Develop and optimize data pipelines using PySpark and Delta Live Tables.

Conhecimentos

Azure Databricks

Unity Catalog

PySpark

Delta Live Tables

Azure cloud services

Descrição da oferta de emprego

Overview

Job Title : Solution Architect – Databricks

Location : Remote Work

12 months

About the Role

Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables. In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure, and high-performance implementations.

Responsibilities

• Lead solution architecture and design for Azure Databricks projects, ensuring best practices and performance optimization.
• Implement and manage Unity Catalog for data governance and security.
• Develop and optimize data pipelines using PySpark and Delta Live Tables.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Provide technical leadership and guidance to development teams.
• Ensure architecture compliance with enterprise standards and security policies.
• Support pre-sales activities, including solution design, effort estimation, and client presentations.
• Travel to client locations as needed for project delivery and stakeholder engagement.

Required Skills & Qualifications

• Proven experience as a Solution Architect or Senior Data Engineer working with Azure Databricks.
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing and transformation.
• Experience with Delta Live Tables for building automated and reliable data pipelines.
• In-depth understanding of Azure cloud services, data architecture, and big data technologies.
• Excellent problem-solving, communication, and stakeholder management skills.

Preferred Qualifications

• Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse).
• Familiarity with enterprise data governance frameworks.
• Prior consulting or client-facing experience in large-scale data projects.