Databricks Data Architect

buscojobs Brasil; Santa Catarina; Teletrabalho; BRL 160.000 - 200.000; Tempo integral

Resumo da oferta

A technology solutions firm is seeking a Solution Architect – Databricks to lead architecture and design for data solutions. The role involves implementing Azure Databricks, managing Unity Catalog, and optimizing data pipelines using PySpark. Candidates should have proven experience and strong problem-solving skills. This position is remote, allowing for flexibility while delivering high-performance data solutions.

Qualificações

• Proven experience as a Solution Architect or Senior Data Engineer with Azure Databricks.
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing.

Responsabilidades

• Lead solution architecture for Azure Databricks projects.
• Implement Unity Catalog for data governance.
• Develop data pipelines using PySpark and Delta Live Tables.

Conhecimentos

Azure Databricks

Unity Catalog

PySpark

Delta Live Tables

Azure cloud services

Problem-solving

Communication

Stakeholder management

Ferramentas

Azure Data Factory

Azure Synapse

Descrição da oferta de emprego

Overview

Job Title: Solution Architect – Databricks

Location: Remote Work

12 months

About the Role

Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables. In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure, and high-performance implementations.

Responsibilities

• Lead solution architecture and design for Azure Databricks projects, ensuring best practices and performance optimization.
• Implement and manage Unity Catalog for data governance and security.
• Develop and optimize data pipelines using PySpark and Delta Live Tables.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Provide technical leadership and guidance to development teams.
• Ensure architecture compliance with enterprise standards and security policies.
• Support pre-sales activities, including solution design, effort estimation, and client presentations.
• Travel to client locations as needed for project delivery and stakeholder engagement.

Required Skills & Qualifications

• Proven experience as a Solution Architect or Senior Data Engineer working with Azure Databricks.
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing and transformation.
• Experience with Delta Live Tables for building automated and reliable data pipelines.
• In-depth understanding of Azure cloud services, data architecture, and big data technologies.
• Excellent problem-solving, communication, and stakeholder management skills.

Preferred Qualifications

• Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse).
• Familiarity with enterprise data governance frameworks.
• Prior consulting or client-facing experience in large-scale data projects.