Data Engineer

Jobtailor; Joinville; Presencial; BRL 120 000 - 190 000; Tempo integral

Resumo da oferta

Jobtailor in Joinville, Brazil is seeking an experienced Data Engineer to design and maintain data pipelines using Azure Databricks, PySpark, ADF and Synapse. You will work with Delta Lake in a Medallion Architecture and implement CDC/SCD for incrementally ingested data.

The role requires cloud data architecture skills in Azure, experience with data governance, quality, security, and data warehousing. You will collaborate with cross-functional teams and support BI solutions with Power BI and the

Qualificações

• Hands-on data engineering with Azure Databricks, Delta Lake, PySpark, ADF, Synapse, Python and SQL.
• Cloud data architecture experience in Azure and strong data governance, quality and security knowledge.
• Dimensional modeling and Data Warehousing experience.
• Data integration and modernization project experience.
• GIT, version control and CI/CD experience.
• Agile and cross-functional team collaboration experience.
• Desirable: Databricks and Microsoft Fabric certifications.

Responsabilidades

• Develop and maintain data pipelines using Azure Databricks, PySpark, ADF and Synapse.
• Work with Delta Lake and Medallion Architecture (Bronze, Silver, Gold) and implement CDC/SCD.
• Integrate with ERP systems and other data sources; support BI with Power BI/Power Platform.
• Contribute to data governance, quality, performance, scalability and security of data solutions.

Conhecimentos

Azure Databricks

Data Engineering

PySpark

Azure Data Factory

Delta Lake

Data Governance

Python

SQL

Git

CI/CD

Ferramentas

Azure Synapse

Power BI

Power Platform

Microsoft Fabric

Descrição da oferta de emprego

• Develop and maintain data pipelines using Azure Databricks, PySpark, Azure Data Factory (ADF), and Azure Synapse
• Work with Delta Lake and the Medallion Architecture (Bronze, Silver, and Gold)
• Implement incremental ingestion, Change Data Capture (CDC), and Slowly Changing Dimensions (SCD) processes
• Integrate with various data sources and ERP systems, such as Protheus, RM, and internal products
• Support data and BI solutions using Power BI and Power Platform
• Contribute to the quality, performance, scalability, and governance of data solutions

Requirements

• Hands-on experience in Data Engineering, working with Azure Databricks, Delta Lake, PySpark, Azure Data Factory (ADF), Azure Synapse, Python, and SQL
• Experience with data architecture in cloud environments, particularly Azure
• Knowledge of data governance, quality, and security
• Experience with dimensional modeling and Data Warehousing
• Experience working on data integration and modernization projects
• Knowledge of Git, code version control, and CI/CD
• Experience working in agile and cross-functional environments
• Knowledge of Microsoft Fabric is a plus
• Databricks and Microsoft Fabric certifications are a plus

Core Competencies

Proficient in developing and maintaining data pipelines using Azure Databricks, PySpark, and Azure Data Factory, with a strong focus on data governance, quality, and security. Experienced in data architecture and integration within cloud environments, particularly Azure, while supporting BI solutions with Power BI.

Highest-signal resume keywords

• Azure Databricks
• Data Engineering
• PySpark
• Azure Data Factory (ADF)
• Data Governance

Hard Skills

• Data Pipeline Development
• SQL
• Dimensional Modeling
• Data Warehousing
• Change Data Capture (CDC)
• Slowly Changing Dimensions (SCD)
• Incremental Ingestion
• Data Integration
• Data Architecture
• Python

Soft Skills

• Collaboration
• Agile Methodologies
• Cross-Functional Teamwork

Certifications & Qualifications

• Databricks Certification
• Microsoft Fabric Certification

Industry Keywords

• Medallion Architecture
• Data Quality
• Data Security
• Data Modernization
• ERP Systems

Tools & Technologies

• Azure Synapse
• Power BI
• Power Platform
• Delta Lake
• Git
• Microsoft Fabric