Data Engineer: Databricks & Azure Data Factory Expert

Ethereum Technologies; Fort Wayne (IN); On-site; USD 98,000 - 139,000; Full time

Job summary

Ethereum Technologies in Fort Wayne, IN is seeking a Data Engineer to design, build, and optimize data pipelines using Databricks and Azure Data Factory. The role focuses on ETL/ELT development, SQL data transformations, and Python/PySpark for large-scale processing.

This is an on-site, 12+ month engagement with flexible extension options. You'll collaborate with cross-functional teams to ensure data quality and reliability across data warehouses and lakes, and to deliver scalable data solutions

Qualifications

• Experience with Databricks and Azure Data Factory (ADF).
• Strong ETL/ELT concepts and data transformations.
• Proficient in SQL and data transformations.
• Basic Python/PySpark experience.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with PySpark or Python for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.

Skills

SQL

Python

PySpark

ETL/ELT concepts

Tools

Databricks

Azure Data Factory (ADF)

Job description

Ethereum Technologies in Fort Wayne, IN is seeking a Data Engineer to design, build, and optimize data pipelines using Databricks and Azure Data Factory. The role focuses on ETL/ELT development, SQL data transformations, and Python/PySpark for large-scale processing.

This is an on-site, 12+ month engagement with flexible extension options. You'll collaborate with cross-functional teams to ensure data quality and reliability across data warehouses and lakes, and to deliver scalable data solutions