Azure Data Engineer

CrackaJack Digital Solutions LLC; São Paulo; Presencial; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A leading digital solutions firm in São Paulo is seeking an experienced Azure Data Engineer to design and optimize data pipelines on the Azure cloud platform. The ideal candidate should have 5+ years of experience in data engineering and a strong background in Azure Data Factory, Databricks, PySpark, and Python. You will collaborate with business teams to ensure high-performance data solutions and create insightful Power BI reports. This role offers competitive compensation and opportunities for professional development.

Qualificações

• 5+ years of experience as a Data Engineer.
• Strong hands-on experience with Azure Data Factory.
• Expertise in Azure Databricks, PySpark, and Python.
• Experience building scalable data pipelines.

Responsabilidades

• Design and maintain end-to-end data pipelines using Azure Data Factory.
• Build and optimize ETL/ELT workflows using Azure Databricks and PySpark.
• Ensure data quality, performance, and reliability of data solutions.
• Create and optimize Power BI datasets and reports.

Conhecimentos

Azure Data Factory

Azure Databricks

PySpark

Python

Power BI

SQL

Data Modeling

Descrição da oferta de emprego

Job Title: Azure Data Engineer

Experience: 5+ Years

Job Description

We are looking for a skilled Azure Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have strong hands-on experience with Azure Data Factory, Databricks, PySpark, Python, and Power BI, and will work closely with business and analytics teams to deliver reliable, high-performance data solutions.

Key Responsibilities

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF).
• Build and optimize ETL/ELT workflows using Azure Databricks and PySpark.
• Develop data processing logic and transformations using Python.
• Ensure data quality, performance, scalability, and reliability of data solutions.
• Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
• Support data modeling and prepare curated datasets for reporting and analytics.
• Create and optimize Power BI datasets and reports for business insights.
• Monitor, troubleshoot, and optimize data pipelines in production environments.

Required Skills & Qualifications

• 5+ years of experience as a Data Engineer.
• Strong hands-on experience with Azure Data Factory (ADF).
• Expertise in Azure Databricks, PySpark, and Python.
• Experience building scalable data pipelines and processing large datasets.
• Strong SQL and data modeling skills.
• Hands-on experience with Power BI (datasets, reports, performance optimization).
• Good understanding of cloud data architecture and best practices.

Preferred Qualifications

• Experience with Azure data services such as Azure Data Lake, Synapse Analytics.
• Understanding of data governance, security, and access controls.
• Experience working in Agile/Scrum environments.
• Strong communication and problem-solving skills.

Nice to Have

• Experience in regulated industries (Finance, Healthcare, etc.).
• Exposure to CI/CD pipelines for data engineering workloads.