Data Engineer – Databricks & ADF (ETL)

Robotic Technologies Automation; Dallas (TX); On-site; USD 89,000 - 126,000; Full time

Job summary

Robotic Technologies Automation in Dallas, TX is seeking a Data Engineer specializing in Databricks and Azure Data Factory (ADF) to design, build, and optimize complex data pipelines. This contract role focuses on ETL/ELT development, data processing, and ensuring data quality across multiple sources.

The ideal candidate will have hands-on experience with Databricks, ADF, SQL, and PySpark, and will work within Azure cloud services to deliver scalable data solutions for data warehouses and data

Qualifications

• Experience with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Good knowledge of SQL and data transformations.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with PySpark or Python for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.

Skills

Databricks

Azure Data Factory

SQL

PySpark

Python

Azure Cloud

Data Lake

Tools

Databricks</name>

ADF

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title:Data Engineer – Databricks & ADF (ETL)
Location: Dallas, TX
Duration: 10 Months
Bill Rate: $78/hour (C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

• We are looking for a Data Engineer with experience in Databricks and Azure Data Factory (ADF) to develop, maintain, and optimize data pipelines and ETL processes.
• Responsibilities:
• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with PySpark or Python for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.
• Required Skills:Experience with Databricks and Azure Data Factory (ADF).
• Strong understanding of ETL/ELT concepts.
• Good knowledge of SQL and data transformations.
• Basic experience with Python or PySpark.
• Understanding of Azure cloud services and data lake concepts.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.