Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC

Houston (TX)

On-site

USD 120,000 - 170,000

Full time

23 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC seeks an experienced data engineer to design and implement scalable data pipelines in Azure, optimizing data flows with Data Factory and Databricks. You will develop modular code in Python or Scala, test rigorously, and ensure reliable CI/CD promotion across environments.

The role focuses on handling large datasets, improving storage with Delta Lake, and collaborating with stakeholders through testing and delivery activities to meet business needs.

Qualifications

  • 8–10 years of data engineering experience.
  • At least 3 years of Azure experience.
  • Strong SQL, Python or Scala proficiency.
  • Experience with large datasets and pipeline optimization.

Responsibilities

  • Develop Azure Data Factory pipelines and data flows.
  • Build Databricks notebooks and Delta Lake solutions.
  • Write modular data engineering code with tests.
  • Optimize storage with ADLS Gen2, Parquet, partitioning, Z-Ordering.
  • Support Git-based CI/CD and promotion across Azure Data Factory and Databricks environments.
  • Collaborate with stakeholders and participate in testing and delivery.

Skills

Advanced SQL
Large data pipelines
Data modeling
CI/CD

Tools

Azure Data Factory
Azure Databricks
Python
Scala
SQL
ADLS Gen2
Delta Lake

Job description

Valiant Technologies LLC seeks an experienced data engineer to design and implement scalable data pipelines in Azure, optimizing data flows with Data Factory and Databricks. You will develop modular code in Python or Scala, test rigorously, and ensure reliable CI/CD promotion across environments.

The role focuses on handling large datasets, improving storage with Delta Lake, and collaborating with stakeholders through testing and delivery activities to meet business needs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Ethereum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Azure Data Engineer: Pipelines & Databricks
Senior Azure Data Engineer: Pipelines & Databricks

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Data Engineer: Databricks & ADF Pipelines
Data Engineer: Databricks & ADF Pipelines

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 90,000 - 130,000
Azure Data Engineer: Cloud Data Pipelines & Spark Pro
Azure Data Engineer: Cloud Data Pipelines & Spark Pro

Valiant Technologies LLC • Austin (TX)

On-site
USD 110,000 - 160,000
Azure Databricks Engineer - Scalable Data Pipelines & Lakehouse
Azure Databricks Engineer - Scalable Data Pipelines & Lakehouse

Valiant Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 170,000
Azure Data Engineer: Pipelines, Data Lakes & CDC
Azure Data Engineer: Pipelines, Data Lakes & CDC

Valiant Technologies LLC • Grand Rapids (MI)

On-site
USD 110,000 - 150,000
Azure Data Engineer: Build Scalable Cloud Data Pipelines
Azure Data Engineer: Build Scalable Cloud Data Pipelines

Valiant Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000
Azure Data Engineer: ETL, Data Factory & Analytics
Azure Data Engineer: ETL, Data Factory & Analytics

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000
Senior Azure Data Engineer — Pipelines & Databricks
Senior Azure Data Engineer — Pipelines & Databricks

Speridian • Austin (TX)

On-site
USD 140,000 - 190,000