Data Engineer: Azure Databricks & ADF Pipelines

Robotics Technologies LLC; Richardson (TX); On-site; USD 98,000 - 139,000; Full time

Job summary

Robotics Technologies LLC in Richardson, TX is seeking a Data Engineer to develop, maintain, and optimize data pipelines and ETL processes. The role focuses on Databricks and Azure Data Factory to process data, with emphasis on SQL, Python/PySpark, and Azure data lake concepts.

It offers a 12-month+ extension engagement and supports multiple work arrangements. The candidate will collaborate with cross-functional teams to ensure data quality and reliability while handling large-scale data

Qualifications

• Experience with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Good knowledge of SQL and data transformations.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with PySpark or Python for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.

Skills

Databricks

Azure Data Factory

ETL/ELT

SQL

Python

PySpark

Azure Cloud

Data Lakes

Job description

Robotics Technologies LLC in Richardson, TX is seeking a Data Engineer to develop, maintain, and optimize data pipelines and ETL processes. The role focuses on Databricks and Azure Data Factory to process data, with emphasis on SQL, Python/PySpark, and Azure data lake concepts.

It offers a 12-month+ extension engagement and supports multiple work arrangements. The candidate will collaborate with cross-functional teams to ensure data quality and reliability while handling large-scale data