Data Engineer: Databricks & ADF ETL Pipelines (Azure)

Ethereum Technologies; Dallas (TX); On-site; USD 89,000 - 126,000; Full time

Job summary

Ethereum Technologies in Dallas, TX is seeking a Data Engineer specialized in Databricks and Azure Data Factory (ADF) to build, maintain and optimize ETL pipelines for large-scale data processing.

You will develop ETL/ELT workflows with ADF and Databricks, write efficient SQL, and leverage PySpark/Python to transform data, integrating data into data lakes and warehouses while ensuring quality and reliability.

Qualifications

• Experience with Databricks and Azure Data Factory (ADF) is required.
• Strong SQL and data transformation skills are essential.
• Basic experience with Python or PySpark is preferred.

Responsibilities

• Develop and maintain ETL/ELT pipelines.
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Collaborate with teams to ensure data quality and reliability.
• Monitor, troubleshoot, and optimize data pipelines.
• Integrate data from multiple sources into data warehouses or data lakes.

Skills

Databricks

Azure Data Factory (ADF)

ETL/ELT concepts

SQL

Python/PySpark

Tools

Azure Cloud Services

Azure Data Lake

Job description

Ethereum Technologies in Dallas, TX is seeking a Data Engineer specialized in Databricks and Azure Data Factory (ADF) to build, maintain and optimize ETL pipelines for large-scale data processing.

You will develop ETL/ELT workflows with ADF and Databricks, write efficient SQL, and leverage PySpark/Python to transform data, integrating data into data lakes and warehouses while ensuring quality and reliability.