Databricks Data Architect

buscojobs Brasil; Uberlândia; Teletrabalho; BRL 160.000 - 200.000; Tempo integral

Resumo da oferta

A leading data solutions provider is seeking an experienced Data Architect to lead the design and delivery of data solutions. The role requires expertise in Azure Databricks, Unity Catalog, and strong skills in PySpark for building reliable data pipelines. Candidates will work remotely and should be adept in translating business requirements into technical solutions.

Qualificações

• Proven experience as a Solution Architect or Senior Data Engineer working with Azure Databricks.
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing and transformation.

Responsabilidades

• Lead solution architecture and design for Azure Databricks projects.
• Implement and manage Unity Catalog for data governance and security.
• Develop and optimize data pipelines using PySpark and Delta Live Tables.

Conhecimentos

Azure Databricks

Unity Catalog

PySpark

Delta Live Tables

Data governance

Problem-solving

Stakeholder management

Descrição da oferta de emprego

Overview

Celebal Technologies is seeking an experienced Data Architect with deep expertise in Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables. In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure, and high-performance implementations.

Location: Remote Work

Contract: 12 months

Key Responsibilities

• Lead solution architecture and design for Azure Databricks projects, ensuring best practices and performance optimization.
• Implement and manage Unity Catalog for data governance and security.
• Develop and optimize data pipelines using PySpark and Delta Live Tables .
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Provide technical leadership and guidance to development teams.
• Ensure architecture compliance with enterprise standards and security policies.
• Support pre-sales activities, including solution design, effort estimation, and client presentations.
• Travel to client locations as needed for project delivery and stakeholder engagement.

Required Skills & Qualifications

• Proven experience as a Solution Architect or Senior Data Engineer working with Azure Databricks .
• Hands-on expertise in Unity Catalog setup and governance.
• Strong proficiency in PySpark for data processing and transformation.
• Experience with Delta Live Tables for building automated and reliable data pipelines.
• In-depth understanding of Azure cloud services, data architecture, and big data technologies.
• Excellent problem-solving, communication, and stakeholder management skills.

Preferred Qualifications

• Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse).
• Familiarity with enterprise data governance frameworks.
• Prior consulting or client-facing experience in large-scale data projects.