Jobs in Manaus, France
Databricks Data Engineer
Globalsource It
Support Administrator
Sonata Software
Tech Lead React Native
BRQ Digital Solutions
Discover more opportunities than anywhere else. Find more jobs nowLíder Técnico
BRQ Digital Solutions
Senior Developer, Delivery (Fully Remote)
Rise Vision Inc.
Connect with headhunters to apply for similar jobsAI Gateway Engineer
AVM Consulting Inc
Senior.Net Developer
Decskill
Marketing Automation Specialist
Hire With Near
Engenheiro De Software
Synolo Biometrics, Inc.
Resource Manager, Professional Services
Cai Software, Llc
Senior Engineering Manager | CXTech
Wellhub
Full Stack Engineer
HeartCentrix Solutions
Lead Wordpress Developer
Olly Olly
Senior Java Developer
Decskill
Desenvolvedor Sap Abap Fiori
Nyx Solucoes
Consultor(a) SAP FI-CA Sênior
Inetum
Analista Iam Pleno Ou Sênior
Zarbe Arievilo
Databricks Data Engineer
Job summary
A technology solutions provider is seeking a hands-on Databricks Data Engineer to join their remote team. This role involves building scalable ETL/ELT data pipelines using Spark, PySpark, and Delta Lake, as well as ingesting data from diverse sources. The ideal candidate will have advanced SQL skills and experience with CI/CD in Azure. Key responsibilities include optimizing pipeline performance and delivering insights through Power BI dashboards, making it essential to have hands-on experience in Databricks and distributed computing.
Qualifications
- Strong hands-on Databricks experience, particularly with Spark, PySpark, and Delta Lake.
- Advanced SQL skills for processing large-scale datasets.
- Experience in integrating data from structured and unstructured sources.
Responsibilities
- Build and optimize ETL/ELT pipelines in Databricks using modern tools.
- Ingest, clean, and transform data from diverse sources effectively.
- Design curated datasets and deliver insights via dashboards.
Skills
Tools
Databricks Data Engineer
Fully Remote Contract
We’re looking for a hands‑on Databricks Data Engineer with strong experience building scalable data pipelines using Spark, PySpark, SQL, and Delta Lake. This role focuses on ingesting data from multiple sources, transforming it for analytics, and publishing high‑quality datasets and visualizations.
- Build and optimize ETL / ELT pipelines in Databricks using PySpark, Spark SQL, and Delta Lake.
- Ingest, clean, and transform data from diverse sources (APIs, SQL databases, cloud storage, SAP / legacy systems, streaming).
- Develop reusable pipeline frameworks, data validation logic, and performance‑tuned transformations.
- Design curated datasets and deliver insights through Power BI dashboards.
- Implement best practices for lakehouse development, orchestration, and version control.
- Troubleshoot pipeline performance issues and ensure data accuracy, reliability, and quality.
- Strong hands‑on Databricks experience (Spark, PySpark, Delta Lake).
- Advanced SQL for large‑scale data processing.
- Experience integrating data from multiple structured and unstructured sources.
- Solid understanding of distributed computing, performance tuning, and debugging Spark jobs.
- Power BI (reports, models, DAX preferred).
- Experience with CI / CD pipelines in an Azure environment.
- Experience with data quality frameworks, Lakehouse monitoring, or DQX.
- Knowledge of Airflow, ADF, IoT, Kafka or other tools is a plus.
- Experience with SAP data is a plus.
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.