Lead Azure Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC

Houston (TX)

On-site

USD 74,000 - 99,000

Full time

4 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Houston, TX seeks a Lead Azure Data Engineer to design and optimize data pipelines for aerospace/airline use cases. You will build Azure Data Factory pipelines, Databricks notebooks, and Delta Lake solutions at scale.

The role requires 8–10 years in data engineering, proficiency with SQL, Python or Scala, and strong experience with large datasets, data partitioning, and CI/CD support in Azure environments.

Qualifications

  • 8–10 years of data engineering experience.
  • At least 3 years of Azure experience.
  • Experience with large datasets and data pipeline optimization.

Responsibilities

  • Develop Azure Data Factory pipelines, data flows, triggers and integration runtimes.
  • Build and optimize Azure Databricks notebooks, jobs and Delta Lake solutions.
  • Write modular data engineering code using Python or Scala with unit tests.
  • Write and tune advanced SQL queries using CTEs and window functions.
  • Manage data storage with ADLS Gen2, Parquet, partitioning and VACUUM/OPTIMIZE.
  • Support Git-based CI/CD and promote code across Azure environments.

Skills

Azure Data Factory
Azure Databricks
SQL
Python
Scala
Data pipelines

Job description

Job Overview

  • Job ID: J55503
  • Job Title: Lead Azure Data Engineer
  • Location: Houston, TX
  • Duration: 10 Months + Extension
  • Domain Exposure: Aerospace/ Airlines
  • Client: To Be Discussed Later
  • Employment Type: W-2, 1099, C2C
  • Work Authorization: US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
  • Bill Rate: $63/hour (C2C)
  • Job Type: W-2, 1099, C2C
  • Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Job Description
  • Develop Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
  • Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
  • Develop modular data engineering code using Python or Scala with unit testing practices.
  • Write and tune advanced SQL queries using CTEs, window functions, and large datasets.
  • Manage data storage and optimization using ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
  • Support Git-based CI/CD and promotion across Azure Data Factory and Databricks environments.
  • Collaborate with stakeholders and participate in testing and delivery activities.
Required Skills & Experience
  • 8-10 years of data engineering experience
  • At least 3 years of Azure experience
  • Azure Data Factory
  • Azure Databricks
  • Advanced SQL
  • Python or Scala
  • Experience with large datasets and data pipeline optimization

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Azure Data Engineer
Lead Azure Data Engineer

Robotic Process Automation LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Ethereum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Lead Azure Data Engineer
Lead Azure Data Engineer

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Atlanta (GA)

On-site
USD 90,000 - 130,000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 120,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Azure Databricks Engineer
Azure Databricks Engineer

MACHINE LEARNING TECHNOLOGIES LLC • Dallas (TX)

On-site
USD 72,000 - 102,000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Austin (TX)

On-site
USD 90,000 - 130,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Plano (TX)

On-site
USD 98,000 - 139,000