Data Engineer

Mercado de Ti; São Paulo; Hybrid; BRL 180,000 - 260,000; Full time

Job summary

Mercado de Ti procura Engenheiro de Dados com atuação prática em Databricks para construir pipelines de dados na camada bruta, transformando dados em camadas curadas para o negócio.

Você trabalhará com PySpark, SQL e Delta Lake, validará dados e manterá qualidade em produção, com governança via Unity Catalog e documentação clara.

Qualifications

• 8+ anos em engenharia de dados.
• 5+ anos com Databricks em produção.
• Profundo conhecimento em PySpark, Python e SQL avançado.

Responsibilities

• Construir e otimizar pipelines Databricks com PySpark, SQL e Delta Lake.
• Gerenciar deploys em Azure DevOps, repositórios e boards.
• Monitorar jobs, depurar e otimizar custo e desempenho.
• Implementar governança com Unity Catalog e validação de dados.

Skills

Databricks

PySpark

Python

SQL Avançado

ETL/ELT

Data Modeling

Notebooks

Workflows

Delta Lake

Unity Catalog

Azure DevOps

Git

Education

Bachelor's degree in Computer Science, Engineering or related field

Tools

Databricks

Delta Lake

Unity Catalog

Azure DevOps

Git

Job description

# Data EngineerPIXIECandidate-searrow\\_forwardCanal oficial da empresaFreelanceEngenharia de Dadospin\\_dropSão Paulo, Brasilschedulehá 8 horasPublicidade# publicidade## O que a vaga pede**Mission Context**As part of a data engineering project, our client is looking for a hands-on **Databricks Engineer** to build and support data pipelines on top of the raw layer owned by the Platform team.**Missions*** Build and optimize Databricks pipelines using **PySpark**, **SQL** and **Delta Lake*** Transform Raw data into curated and business-ready layers* Own production deployments through **Azure DevOps (ADO)**, including code reviews, testing and releases* Track work in ADO Boards* Monitor, troubleshoot and tune jobs for performance, reliability and cost* Implement data quality checks and governance using **Unity Catalog*** Partner with business users and the Platform team to turn requirements into technical solutions* Maintain clear documentation and support runbooks**Required Profile*** **8+ years of experience in data engineering*** **5+ years of hands-on Databricks experience in production*** Strong **hands-on experience with Databricks**, including notebooks, jobs, workflows and clusters* Proficiency in **PySpark**, **Python** and **advanced SQL*** Solid understanding of **Delta Lake**, **data modeling** and **ETL/ELT** patterns* Experience supporting production workloads, with strong debugging and data validation skills* Working knowledge of **Git** and **CI/CD**, ideally **Azure DevOps (Repos, Pipelines, Boards)*** Bachelor's degree in Computer Science, Engineering or related field, or equivalent experience* Excellent written and verbal English* Self-starter who takes initiative, works independently and proactively solves problems* Ability to own work end to end, from requirements to production support, and meet commitments* Comfortable working with business users and explaining technical topics simply* Collaborative communicator who shares proactive updates, raises risks early and works well across time zones**Additional Information*** **Location: Brazil (Hybrid 2x days in office per week)*** **Working Hours: Must be willing to work US CST hours*** **Work type: Contract/freelance**