Data Engineer – Databricks & ADF (ETL)

Robotics Technologies; Dallas (TX); Presencial; USD 91 000 - 124 000; Tempo integral

Resumo da oferta

Robotics Technologies is seeking a Data Engineer to design, build, and optimize ETL/ELT workflows using Azure Data Factory (ADF) and Databricks. The role emphasizes SQL development and large-scale processing with PySpark or Python to ensure reliable data movement into data lakes and data warehouses.

You will develop pipelines, process data at scale, and collaborate across teams to maintain data quality and reliability in a demanding on-site Dallas environment.

Qualificações

• Experience with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Solid SQL and data transformations knowledge.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

Responsabilidades

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Use Databricks for data processing, transformation, and related pipeline activities.
• Write and optimize SQL queries for data extraction and transformation.
• Perform large-scale data processing with PySpark or Python.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines to support stable operations.
• Collaborate with other teams to support data quality and reliability.

Conhecimentos

Databricks

Azure Data Factory

ETL/ELT concepts

SQL

Python / PySpark

Azure cloud services

Data lake

Ferramentas

Databricks

Azure Data Factory

Descrição da oferta de emprego

The Data Engineer role at Robotics Technologies is centered on designing, building, and optimizing ETL and ELT workflows using Azure Data Factory (ADF) and Databricks. The position also includes SQL development and large-scale processing with PySpark or Python to support reliable data movement into data lakes and data warehouses.

Key Responsibilities

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Use Databricks for data processing, transformation, and related pipeline activities.
• Write and optimize SQL queries for data extraction and transformation.
• Perform large-scale data processing with PySpark or Python.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines to support stable operations.
• Collaborate with other teams to support data quality and reliability.

Required Qualifications

• Experience working with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Good knowledge of SQL and data transformations.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

Technology Stack

• Databricks
• Azure Data Factory (ADF)
• ETL, ELT
• SQL
• PySpark, Python
• Azure cloud services
• Data lake

Location and Compensation

This is an onsite role in Dallas, TX. Compensation is listed as USD 78 per hour.