Compliance jobs in United States
Human Resources Manager (Middle level)
TurnKey Tech Staffing
Tech Service & Formulation Expert Pet Food
Dsm-Firmenich
Aprendiz – Udc
Imediato Nexway
Lead Wordpress Developer
Olly Olly
Discover more opportunities than anywhere else. Find more jobs nowGerente Executivo Financeiro | Remoto
GRAN
Infrastructure automation engineer
Hyqoo
Data Engineer
Zunzun Solutions
Connect with headhunters to apply for similar jobsConsultor(A) Financeiro Fp&A Sr - Finance Business Partner (Local)
Bridgestone Brasil
Especialista Em Banco De Dados Postgresql
Zukk
Sr. Sap Developer – Cpi (Cloud Platform Integration) – Advanced English
Hcltech
Data Management Analyst
Incomm Payments
Lead Wordpress Developer
Olly Olly
Coordenador(a) de Planejamento Comercial (S&OP)
Syngenta Group
Sre - Brazil
Decskill
Assistente de Suporte N1 - Vaga exclusiva para pessoas comdeficiência
Contato Seguro
Hr Business Partner - Remote Work
Bairesdev
Sre - Brazil
Decskill
Vendedor(A) Outlet Só Marcas - Rommanel Mg
Rommanel
Public Relations Manager - Latam
Cooler Master
Data Engineer
Job summary
A technology solutions company in Brazil seeks a highly skilled Data Engineer (Azure Databricks) to design and optimize enterprise-grade data pipelines. The role requires expertise in Azure Databricks, Azure Data Factory, and strong SQL skills. The ideal candidate has over 5 years of experience in data engineering, focusing on building scalable solutions in the Azure Cloud. This position offers the opportunity to work on innovative data challenges and collaborate with cross-functional teams.
Qualifications
- 5+ years of hands-on expertise with Azure Databricks, Python, PySpark, and Delta Lake.
- 5+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines.
- Strong SQL Server / T-SQL experience with a focus on query optimization.
Responsibilities
- Design, build, and optimize ETL / ELT pipelines using Azure Databricks and Azure Data Factory.
- Develop data flows and complex transformations for seamless data extraction.
- Work with cross-functional teams using Git for version control.
Skills
Education
We are seeking a highly skilled Data Engineer (Azure Databricks) to design, implement, and optimize enterprise‑grade data pipelines. In this role, you will leverage Azure Databricks, Azure Data Factory, SQL Server, and Python to enable scalable, governed, and performant data solutions. You will play a key role in modernizing our data platform on the Azure Cloud, ensuring reliability, efficiency, and compliance across the full data lifecycle.
- Data Pipeline Development : Design, build, and optimize ETL / ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF).
- Data Flows & Transformations : Develop pipelines, data flows, and complex transformations with ADF, PySpark, and T‑SQL for seamless data extraction, transformation, and loading.
- Data Processing : Develop Databricks Python notebooks for tasks such as joining, filtering, and pre‑aggregation.
- Database & Query Optimization : Optimize database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation.
- SSIS & Migration Support : Maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud‑native pipelines.
- Collaboration & DevOps : Work with cross‑functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI / CD) for deployment.
- Data Governance & Security : Partner with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role‑based security.
- API & External Integration : Implement REST APIs to retrieve analytics data from diverse external data feeds, enhancing accessibility and interoperability.
- Automation : Automate ETL processes and database maintenance tasks using SQL Agent Jobs, ensuring data integrity and operational reliability.
- Advanced SQL Expertise : Craft and optimize complex T‑SQL queries to support efficient data processing and analytical workloads.
- 5+ years of hands‑on expertise with Azure Databricks, Python, PySpark, and Delta Lake.
- 5+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines.
- Strong SQL Server / T‑SQL experience with a focus on query optimization, indexing strategies, and coding best practices.
- Demonstrated experience in SSIS package design, deployment, and performance tuning.
- Hands‑on knowledge of Unity Catalog for governance.
- Experience with Git (Azure DevOps Repos) and CI / CD practices in data engineering projects.
- Exposure to Change Data Capture (CDC), Change Data Feed (CDF), and Temporal Tables.
- Experience with Microsoft Purview, Power BI, and Azure‑native integrations.
- Familiarity with Profisee Master Data Management (MDM).
- Working in Agile / Scrum environments.
Microsoft Certified : Azure Data Engineer Associate (DP-203)
Microsoft Certified : Azure Solutions Architect Expert or equivalent advanced Azure certification
Databricks Certified Data Engineer Associate or Professional
Additional Microsoft SQL Server or Azure certifications demonstrating advanced database and cloud expertise
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.