Senior Azure Data Engineer: Pipelines, Databricks & SQL

Ethereum Technologies LLC

Houston (TX)

On-site

USD 120,000 - 180,000

Full time

26 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ethereum Technologies seeks a senior data engineer to design and optimize data pipelines on Azure, leveraging Data Factory and Databricks. You will implement modular data engineering code in Python or Scala, optimize SQL for large-scale datasets, and collaborate with stakeholders on testing and delivery.

Ideal candidate has 8–10 years in data engineering, 3+ years Azure experience, and hands-on work with ADLS Gen2, Parquet and Delta Lake.

Qualifications

  • 8-10 years of data engineering experience.
  • At least 3 years of Azure experience.
  • Advanced SQL.
  • Python or Scala.
  • Experience with large datasets and data pipeline optimization.

Responsibilities

  • Develop and optimize Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
  • Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
  • Write modular data engineering code in Python or Scala with unit tests.
  • Write and tune advanced SQL queries for large datasets.

Skills

Azure Data Factory
Azure Databricks
SQL
Python or Scala
Large datasets

Tools

ADLS Gen2
Parquet
Z-Ordering
OPTIMIZE
VACUUM

Job description

Ethereum Technologies seeks a senior data engineer to design and optimize data pipelines on Azure, leveraging Data Factory and Databricks. You will implement modular data engineering code in Python or Scala, optimize SQL for large-scale datasets, and collaborate with stakeholders on testing and delivery.

Ideal candidate has 8–10 years in data engineering, 3+ years Azure experience, and hands-on work with ADLS Gen2, Parquet and Delta Lake.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Senior Azure Data Engineer: Pipelines & Databricks
Senior Azure Data Engineer: Pipelines & Databricks

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Azure Data Engineer: Build Scalable ELT Pipelines
Azure Data Engineer: Build Scalable ELT Pipelines

Ethereum Technologies • Austin (TX)

On-site
USD 90,000 - 130,000
Data Engineer: Azure Databricks & ADF Pipelines
Data Engineer: Azure Databricks & ADF Pipelines

Ethereum Technologies LLC • Plano (TX)

On-site
USD 101,000 - 136,000
Data Engineer: Databricks & ADF ETL Pipelines (Azure)
Data Engineer: Databricks & ADF ETL Pipelines (Azure)

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 89,000 - 126,000
Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Azure Data Engineer: ETL, Data Lake & Databricks
Azure Data Engineer: ETL, Data Lake & Databricks

Ethereum Technologies • Atlanta (GA)

On-site
USD 90,000 - 130,000
Data Engineer - Databricks + ADF Data Pipelines
Data Engineer - Databricks + ADF Data Pipelines

Ethereum Technologies LLC • Plano (TX)

On-site
USD 118,000 - 136,000
Senior Azure Data Engineer — Pipelines & Databricks
Senior Azure Data Engineer — Pipelines & Databricks

Speridian • Austin (TX)

On-site
USD 140,000 - 190,000
Azure Data Engineer: Pipelines, Lakehouse & Synapse
Azure Data Engineer: Pipelines, Lakehouse & Synapse

Ethereum Technologies LLC • Raleigh (NC)

On-site
USD 120,000 - 150,000
None