Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake

Robotic Process Automation LLC

Houston (TX)

On-site

USD 120,000 - 170,000

Full time

22 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotic Technologies Automation in Houston, TX seeks a senior data engineer to design, build, and optimize data pipelines on Azure. You will implement ADF pipelines and Databricks notebooks, creating Delta Lake solutions and modular code in Python or Scala with unit tests.

Ideal candidates have 8–10 years of data engineering experience, strong Azure skills, and expert SQL capabilities for large-scale datasets. Collaboration with stakeholders and involvement in testing/delivery are expected.

Qualifications

  • 8-10 years of data engineering experience.
  • At least 3 years of Azure experience.
  • Advanced SQL and Python or Scala.
  • Experience with large datasets and data pipeline optimization.

Responsibilities

  • Develop Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
  • Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
  • Develop modular data engineering code using Python or Scala with unit testing practices.
  • Write and tune advanced SQL queries using CTEs, window functions, and large datasets.

Skills

Advanced SQL
Python or Scala
Large datasets
Data pipeline optimization

Tools

Azure Data Factory
Azure Databricks
ADLS Gen2
Delta Lake

Job description

Robotic Technologies Automation in Houston, TX seeks a senior data engineer to design, build, and optimize data pipelines on Azure. You will implement ADF pipelines and Databricks notebooks, creating Delta Lake solutions and modular code in Python or Scala with unit tests.

Ideal candidates have 8–10 years of data engineering experience, strong Azure skills, and expert SQL capabilities for large-scale datasets. Collaboration with stakeholders and involvement in testing/delivery are expected.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Robotic Process Automation LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Azure Data Engineer: Scale Data Pipelines & Lakehouse
Azure Data Engineer: Scale Data Pipelines & Lakehouse

Robotic Process Automation LLC • Raleigh (NC)

On-site
USD 110,000 - 160,000
Azure Data Engineer: Scalable Pipelines & Lakehouse
Azure Data Engineer: Scalable Pipelines & Lakehouse

Robotics Technologies LLC • Raleigh (NC)

On-site
USD 110,000 - 150,000
Data Engineer: Azure Databricks & ADF Pipelines (Plano)
Data Engineer: Azure Databricks & ADF Pipelines (Plano)

Robotic Process Automation LLC • Plano (TX)

On-site
USD 101,000 - 136,000
Azure Databricks Engineer: Pipelines, Governance & CI/CD
Azure Databricks Engineer: Pipelines, Governance & CI/CD

Robotic Process Automation LLC • Cincinnati (OH)

On-site
USD 94,000 - 103,000
Azure Data Engineer — Databricks & ADF ETL Expert
Azure Data Engineer — Databricks & ADF ETL Expert

Robotic Process Automation LLC • Richardson (TX)

On-site
USD 98,000 - 139,000
Senior Azure Data Engineer — Big Data Pipelines
Senior Azure Data Engineer — Big Data Pipelines

Robotic Process Automation LLC • Dallas (TX)

On-site
USD 83,000 - 124,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Data Engineer: Databricks & Azure Data Factory
Data Engineer: Databricks & Azure Data Factory

Robotic Process Automation LLC • Fort Wayne (IN)

On-site
USD 98,000 - 139,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Ethereum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000