Data Engineer: Databricks & ADF ETL Specialist

Robotic Technologies Automation; Irving (TX); Presencial; USD 98 000 - 139 000; Tempo integral

Resumo da oferta

Robotic Technologies Automation in Irving, TX, seeks a Data Engineer to build and optimize data pipelines using Databricks and Azure Data Factory. You will develop ETL/ELT processes, write SQL, and use PySpark to transform data for data warehouses and data lakes.

The role requires strong SQL, Python/PySpark skills, and experience with Azure cloud services. It’s a 12-month engagement with potential extension and collaboration across teams to ensure data quality.

Qualificações

• Must understand ETL/ELT concepts and data pipelines.
• Experience building data pipelines and transformations.

Responsabilidades

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with PySpark or Python for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.

Conhecimentos

ETL/ELT concepts

Data modeling

Data quality

Big data processing

Ferramentas

Databricks

Azure Data Factory (ADF)

SQL

Python / PySpark

Azure cloud services

Descrição da oferta de emprego

Robotic Technologies Automation in Irving, TX, seeks a Data Engineer to build and optimize data pipelines using Databricks and Azure Data Factory. You will develop ETL/ELT processes, write SQL, and use PySpark to transform data for data warehouses and data lakes.

The role requires strong SQL, Python/PySpark skills, and experience with Azure cloud services. It’s a 12-month engagement with potential extension and collaboration across teams to ensure data quality.