Data Engineer: Databricks & Azure Data Factory

Robotic Technologies Automation; Fort Wayne (IN); Presencial; USD 98 000 - 139 000; Tempo integral

Resumo da oferta

Robotic Technologies Automation is seeking a Data Engineer with hands-on experience in Databricks and Azure Data Factory to build, optimize, and maintain robust data pipelines. The role involves ETL/ELT development, data transformation, and ensuring data quality across multiple sources and environments.

You will work with PySpark or Python for large-scale processing and collaborate with cross-functional teams to deliver reliable data solutions in a modern Azure-based data lake ecosystem.

Qualificações

• Experience with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Good knowledge of SQL and data transformations.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

Responsabilidades

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with Python or PySpark for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.

Conhecimentos

ETL/ELT concepts

SQL/data transformations

Python or PySpark

Azure cloud services / data lake

Ferramentas

Databricks

Azure Data Factory (ADF)

Descrição da oferta de emprego

Robotic Technologies Automation is seeking a Data Engineer with hands-on experience in Databricks and Azure Data Factory to build, optimize, and maintain robust data pipelines. The role involves ETL/ELT development, data transformation, and ensuring data quality across multiple sources and environments.

You will work with PySpark or Python for large-scale processing and collaborate with cross-functional teams to deliver reliable data solutions in a modern Azure-based data lake ecosystem.