Databricks Engineer – Brazil

Darwin Recruitment; São Paulo; Hybrid; BRL 180,000 - 280,000; Full time

Job summary

Darwin Recruitment is seeking a Data Engineer to develop and support a global procurement Data Lake. The role focuses on back-end data integration, processing and modelling across SAP, ERP, D365, and ServiceNow.

Key tasks include building scalable data pipelines with Azure Data Factory and Azure Synapse, using Databricks for transformations, and ensuring robust CI/CD with Azure DevOps and Git. Strong SQL and Python skills are essential for distributed processing.

Qualifications

• 5+ years of Advanced SQL experience.
• Strong Python and PySpark for distributed processing and notebook development.
• Experience with Azure Data Factory for ingestion and orchestration.
• Proficient in Azure Synapse Analytics for processing and serving data.
• Databricks notebooks and data transformation expertise.
• Usage of Azure DevOps and Git for version control and automation.
• REST API integration, authentication, pagination and incremental loads.
• Relational and analytical modelling to define granularity and relations.

Responsibilities

• Develop and support a global procurement Data Lake focusing on data integration and modelling.
• Work across SAP, ERP, D365 and ServiceNow for backend data flows.
• Implement ingestion, processing, and orchestration using ADF and Synapse.
• Create notebooks in Databricks for data transformation and automation.
• Collaborate on CI/CD for data components with Azure DevOps and Git.

Skills

Advanced SQL

Python & PySpark

Azure Data Factory

Azure Synapse Analytics

Databricks

Azure DevOps & Git

REST API integration

Relational data modelling

Tools

Azure Data Factory

Azure Synapse Analytics

Databricks

Azure DevOps

Git

Job description

Role: Data Engineer (Databricks, Python, SQL)

Location: Sao Paulo, Brazil – 80% remote

Start: December 2026/Jan 2027

Type: Full time, long term engagement (Contract/B2B) – 3+ Years minimum

About: This global manufacturing customer are looking for a Data Engineer to develop and support a global procurement Data Lake, focused exclusively on back end data integration, processing and modelling. This will focus across Enterprise Applications (SAP, ERP, D365, ServiceNow).

Essential Skills

• Advanced SQL: 5+ Years


• Python and PySpark for distributed processing, automation, integrations and notebook development, with modular, testable and documented code.


• Azure Data Factory for ingestion and orchestration


• Azure Synapse Analytics for processing and serving data; Databricks for notebooks and data transformation.


• Azure DevOps and Git for version control, code review, and automated testing and deployment of data components.


• Integration with REST APIs and corporate sources: authentication, pagination, error handling, rate limits and incremental load strategies.


• Relational and analytical modelling: defining granularity, keys and relationships; ETL/ELT; layered Data Lake/Lakehouse architecture.