Data Engineer - Databricks + ADF Data Pipelines

Ethereum Technologies

Plano (TX)

On-site

USD 118,000 - 136,000

Part time

7 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ethereum Technologies in Plano, TX is seeking a Data Engineer to design, build and optimize data pipelines using Databricks and Azure Data Factory. You will develop ETL/ELT processes, write SQL, and implement PySpark for large-scale data processing.

Collaborate with cross-functional teams to ensure data quality and reliability, monitor pipelines, troubleshoot issues, and optimize performance in a cloud environment leveraging Azure data services.

Qualifications

  • Experience with Databricks and ADF to develop data pipelines.
  • Strong SQL and data transformation skills.
  • Proficiency in Python or PySpark for large-scale processing.
  • Understanding Azure cloud services and data lake concepts.

Responsibilities

  • Develop and maintain ETL/ELT pipelines using Azure Data Factory.
  • Work with Databricks for data processing and transformation.
  • Write and optimize SQL queries for data extraction and transformation.
  • Work with PySpark or Python for large-scale data processing.
  • Integrate data from multiple sources into data warehouses or data lakes.
  • Monitor, troubleshoot, and optimize data pipelines.
  • Collaborate with teams to ensure data quality and reliability.

Skills

Databricks
ADF
ETL/ELT
SQL
Python
PySpark
Azure Cloud
Data Lake

Job description

Ethereum Technologies in Plano, TX is seeking a Data Engineer to design, build and optimize data pipelines using Databricks and Azure Data Factory. You will develop ETL/ELT processes, write SQL, and implement PySpark for large-scale data processing.

Collaborate with cross-functional teams to ensure data quality and reliability, monitor pipelines, troubleshoot issues, and optimize performance in a cloud environment leveraging Azure data services.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Azure Databricks & ADF Pipelines
Data Engineer: Azure Databricks & ADF Pipelines

Ethereum Technologies LLC • Plano (TX)

On-site
USD 101,000 - 136,000
Data Engineer: Databricks & ADF ETL Pipelines (Azure)
Data Engineer: Databricks & ADF ETL Pipelines (Azure)

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 89,000 - 126,000
Data Engineer: Databricks & Azure Data Factory Expert
Data Engineer: Databricks & Azure Data Factory Expert

Ethereum Technologies LLC • Plano (TX)

On-site
USD 98,000 - 139,000
Data Engineer - Databricks & Azure Data Factory
Data Engineer - Databricks & Azure Data Factory

Ethereum Technologies LLC • Plano (TX)

On-site
USD 96,000 - 152,000
Data Engineer: Azure Databricks & ADF ETL
Data Engineer: Azure Databricks & ADF ETL

Ethereum Technologies LLC • Houston (TX)

On-site
USD 89,000 - 126,000
Data Engineer | Databricks & Azure Data Factory
Data Engineer | Databricks & Azure Data Factory

MACHINE LEARNING TECHNOLOGIES LLC • Plano (TX)

On-site
USD 118,000 - 136,000
Senior Data Engineer: Databricks & ADF ETL Lead
Senior Data Engineer: Databricks & ADF ETL Lead

Ethereum Technologies LLC • Sunnyvale (CA)

On-site
USD 91,000 - 124,000
Data Engineer: Azure Databricks & ADF Pipelines (Plano)
Data Engineer: Azure Databricks & ADF Pipelines (Plano)

Robotic Process Automation LLC • Plano (TX)

On-site
USD 101,000 - 136,000
Data Engineer: Databricks & ADF Pipelines
Data Engineer: Databricks & ADF Pipelines

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 90,000 - 130,000
Data Engineer — Databricks & ADF Pipelines
Data Engineer — Databricks & ADF Pipelines

Quantum Technologies. LLC • Atlanta (GA)

On-site
USD 90,000 - 150,000