Data Engineer: Databricks & ADF ETL (Onsite Dallas)

Robotics Technologies; Dallas (TX); Presencial; USD 91 000 - 124 000; Tempo integral

Resumo da oferta

Robotics Technologies is seeking a Data Engineer to design, build, and optimize ETL/ELT workflows using Azure Data Factory (ADF) and Databricks. The role emphasizes SQL development and large-scale processing with PySpark or Python to ensure reliable data movement into data lakes and data warehouses.

You will develop pipelines, process data at scale, and collaborate across teams to maintain data quality and reliability in a demanding on-site Dallas environment.

Qualificações

• Experience with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Solid SQL and data transformations knowledge.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

Responsabilidades

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Use Databricks for data processing, transformation, and related pipeline activities.
• Write and optimize SQL queries for data extraction and transformation.
• Perform large-scale data processing with PySpark or Python.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines to support stable operations.
• Collaborate with other teams to support data quality and reliability.

Conhecimentos

Databricks

Azure Data Factory

ETL/ELT concepts

SQL

Python / PySpark

Azure cloud services

Data lake

Ferramentas

Databricks

Azure Data Factory

Descrição da oferta de emprego

Robotics Technologies is seeking a Data Engineer to design, build, and optimize ETL/ELT workflows using Azure Data Factory (ADF) and Databricks. The role emphasizes SQL development and large-scale processing with PySpark or Python to ensure reliable data movement into data lakes and data warehouses.

You will develop pipelines, process data at scale, and collaborate across teams to maintain data quality and reliability in a demanding on-site Dallas environment.