Data Engineer: Databricks & Azure Data Factory Expert

Ethereum Technologies; Plano (TX); Presencial; USD 98 000 - 139 000; Tempo integral

Resumo da oferta

Ethereum Technologies in Plano, TX is seeking a Data Engineer to design, develop, and optimize data pipelines using Databricks and Azure Data Factory (ADF). You will implement ETL/ELT processes, write efficient SQL, and collaborate with teams to ensure data quality and reliability.

The role involves hands-on data processing with PySpark/Python and integrating data from diverse sources into data lakes or warehouses, supporting data-driven decision-making.

Qualificações

• Experience building ETL/ELT pipelines with Databricks and ADF.
• Strong SQL skills for data extraction and transformation.
• Familiarity with Python or PySpark for large-scale processing.

Responsabilidades

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Work with Databricks for data processing and transformation.
• Write and optimize SQL queries for data extraction and transformation.
• Work with PySpark or Python for large-scale data processing.
• Integrate data from multiple sources into data warehouses or data lakes.
• Monitor, troubleshoot, and optimize data pipelines.
• Collaborate with teams to ensure data quality and reliability.

Conhecimentos

Databricks

Azure Data Factory (ADF)

SQL

Python/PySpark

ETL/ELT

Azure cloud services

Ferramentas

Azure Data Factory (ADF)

Descrição da oferta de emprego

Ethereum Technologies in Plano, TX is seeking a Data Engineer to design, develop, and optimize data pipelines using Databricks and Azure Data Factory (ADF). You will implement ETL/ELT processes, write efficient SQL, and collaborate with teams to ensure data quality and reliability.

The role involves hands-on data processing with PySpark/Python and integrating data from diverse sources into data lakes or warehouses, supporting data-driven decision-making.