Senior Azure Data Engineer: Data Factory & Databricks Lead

MACHINE LEARNING TECHNOLOGIES LLC

Houston (TX)

On-site

USD 74,000 - 99,000

Full time

16 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Houston, TX seeks a Lead Azure Data Engineer to design and optimize data pipelines for aerospace/airline use cases. You will build Azure Data Factory pipelines, Databricks notebooks, and Delta Lake solutions at scale.

The role requires 8–10 years in data engineering, proficiency with SQL, Python or Scala, and strong experience with large datasets, data partitioning, and CI/CD support in Azure environments.

Qualifications

  • 8–10 years of data engineering experience.
  • At least 3 years of Azure experience.
  • Experience with large datasets and data pipeline optimization.

Responsibilities

  • Develop Azure Data Factory pipelines, data flows, triggers and integration runtimes.
  • Build and optimize Azure Databricks notebooks, jobs and Delta Lake solutions.
  • Write modular data engineering code using Python or Scala with unit tests.
  • Write and tune advanced SQL queries using CTEs and window functions.
  • Manage data storage with ADLS Gen2, Parquet, partitioning and VACUUM/OPTIMIZE.
  • Support Git-based CI/CD and promote code across Azure environments.

Skills

Azure Data Factory
Azure Databricks
SQL
Python
Scala
Data pipelines

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Houston, TX seeks a Lead Azure Data Engineer to design and optimize data pipelines for aerospace/airline use cases. You will build Azure Data Factory pipelines, Databricks notebooks, and Delta Lake solutions at scale.

The role requires 8–10 years in data engineering, proficiency with SQL, Python or Scala, and strong experience with large datasets, data partitioning, and CI/CD support in Azure environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Data Engineer: Pipelines & Databricks
Senior Azure Data Engineer: Pipelines & Databricks

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Lead Azure Data Engineer
Lead Azure Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC • Houston (TX)

On-site
USD 74,000 - 99,000
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake

Robotic Process Automation LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer - Onsite Houston, 10-Month
Lead Azure Data Engineer - Onsite Houston, 10-Month

Robotics Technologies • Houston (TX)

On-site
USD 72,000 - 102,000
Azure Databricks Engineer
Azure Databricks Engineer

ZEUS SOLUTIONS INC • Houston (TX)

On-site
USD 140,000 - 180,000
Senior Azure Data Engineer — Pipelines & Databricks
Senior Azure Data Engineer — Pipelines & Databricks

Speridian • Austin (TX)

On-site
USD 140,000 - 190,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Ethereum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Azure Data Engineer
Azure Data Engineer

TechDigital Group • Pleasanton (CA)

On-site
USD 120,000 - 170,000
Data Engineer – Databricks & Azure Data Factory
Data Engineer – Databricks & Azure Data Factory

CloudBigD • Plano (TX)

On-site
USD 98,000 - 139,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000