Databricks Data Architect

buscojobs Brasil; Espumoso; Teletrabalho; BRL 160.000 - 200.000; Tempo integral

Resumo da oferta

A leading technology consulting firm is seeking a Solution Architect specializing in Azure Databricks to lead the design and delivery of advanced data solutions. The role involves optimizing data pipelines and ensuring compliance with enterprise standards. Candidates should have a strong background in PySpark, Unity Catalog, and Azure cloud services. This position offers remote work flexibility.

Qualificações

• Proven experience as a Solution Architect or Senior Data Engineer with Azure Databricks.
• Hands-on experience with Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing.

Responsabilidades

• Lead solution architecture and design for Azure Databricks projects.
• Implement and manage Unity Catalog for data governance.
• Develop and optimize data pipelines using PySpark.

Conhecimentos

Azure Databricks

Unity Catalog

PySpark

Delta Live Tables

Azure cloud services

Problem-solving

Descrição da oferta de emprego

Overview

Job Title: Solution Architect – Databricks

Location: Remote Work

12 months

About the Role

Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables. In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure, and high-performance implementations.

Responsibilities

• Lead solution architecture and design for Azure Databricks projects, ensuring best practices and performance optimization.
• Implement and manage Unity Catalog for data governance and security.
• Develop and optimize data pipelines using PySpark and Delta Live Tables.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Provide technical leadership and guidance to development teams.
• Ensure architecture compliance with enterprise standards and security policies.
• Support pre-sales activities, including solution design, effort estimation, and client presentations.
• Travel to client locations as needed for project delivery and stakeholder engagement.

Required Skills & Qualifications

• Proven experience as a Solution Architect or Senior Data Engineer working with Azure Databricks.
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing and transformation.
• Experience with Delta Live Tables for building automated and reliable data pipelines.
• In-depth understanding of Azure cloud services, data architecture, and big data technologies.
• Excellent problem-solving, communication, and stakeholder management skills.

Preferred Qualifications

• Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse).
• Familiarity with enterprise data governance frameworks.
• Prior consulting or client-facing experience in large-scale data projects.