Data Engineer: Databricks & ADF ETL Specialist
Robotic Technologies Automation
Recebe uma resposta deste recrutador
O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.
Resumo da oferta
Robotic Technologies Automation in Dallas, TX is seeking a Data Engineer specializing in Databricks and Azure Data Factory (ADF) to design, build, and optimize complex data pipelines. This contract role focuses on ETL/ELT development, data processing, and ensuring data quality across multiple sources.
The ideal candidate will have hands-on experience with Databricks, ADF, SQL, and PySpark, and will work within Azure cloud services to deliver scalable data solutions for data warehouses and data
Qualificações
- Experience with Databricks and Azure Data Factory (ADF).
- Strong understanding of ETL/ELT concepts.
- Good knowledge of SQL and data transformations.
- Basic experience with Python or PySpark.
- Understanding of Azure cloud services and data lake concepts.
Responsabilidades
- Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Work with Databricks for data processing and transformation.
- Write and optimize SQL queries for data extraction and transformation.
- Work with PySpark or Python for large-scale data processing.
- Integrate data from multiple sources into data warehouses or data lakes.
- Monitor, troubleshoot, and optimize data pipelines.
- Collaborate with teams to ensure data quality and reliability.
Conhecimentos
Ferramentas
Descrição da oferta de emprego
Robotic Technologies Automation in Dallas, TX is seeking a Data Engineer specializing in Databricks and Azure Data Factory (ADF) to design, build, and optimize complex data pipelines. This contract role focuses on ETL/ELT development, data processing, and ensuring data quality across multiple sources.
The ideal candidate will have hands-on experience with Databricks, ADF, SQL, and PySpark, and will work within Azure cloud services to deliver scalable data solutions for data warehouses and data
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
