Senior Data Engineer-Azure/Databricks

Technology Recruiting Solutions

Houston (TX)

Hybrid

USD 120,000 - 180,000

Full time

8 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision coverage
401(k) plan
Pension
Life insurance
Paid time off
Paid holidays
Wellness programs

Job summary

Technology Recruiting Solutions in Houston seeks a Senior Data Engineer to design, build, and maintain Azure cloud-based data platforms. You will work on Databricks, Delta Lake, and medallion architecture to deliver scalable Lakehouse solutions and robust ELT/ETL pipelines.

Responsibilities include integrating ERP data from Oracle and SQL Server, implementing security controls, and collaborating in an Agile environment with DevOps practices. On-site presence in Houston is required as needed.

Qualifications

  • 5+ years of hands-on Databricks data engineering experience.
  • Delta Lake, PySpark/Spark SQL, notebooks, jobs, and cluster management.
  • Azure Data Lake Storage Gen2 and Azure Data Factory experience.
  • ETL/ELT pipelines and Lakehouse/medallion architectures.
  • Dimensional modeling and incremental data loads.
  • Oracle and SQL Server (PL/SQL/T-SQL) experience.
  • Data security and access controls implementation.
  • Git and CI/CD/DevOps practices.
  • Power BI knowledge.

Responsibilities

  • Build, implement, and maintain scalable cloud-based data solutions using Azure and Databricks.
  • Develop and support Lakehouse and medallion architecture solutions.
  • Design and maintain ELT/ETL workflows with Databricks, Azure Data Factory, Lakeflow, and Azure Data Lake Storage.
  • Integrate data from ERP systems, Oracle, SQL Server, and other platforms.
  • Develop solutions using Python, PySpark/Spark SQL, Delta Lake, and SQL.
  • Configure Databricks Unity Catalog including access policies, metadata, and lineage.
  • Implement data security and access controls (RBAC/ABAC).
  • Monitor pipelines, troubleshoot failures, and resolve data quality issues.
  • Participate in DevOps and CI/CD using Git, Azure DevOps and/or GitHub Actions.
  • Create and maintain technical documentation and runbooks.
  • Collaborate with technical and business teams in Agile environments.

Skills

Databricks
Delta Lake
PySpark
Azure
ETL/ELT pipelines
Lakehouse architecture
RBAC/ABAC
Git
CI/CD
Power BI
Oracle
SQL Server
Python
Data security

Tools

Azure Data Factory
Lakeflow
Databricks Unity Catalog
FiveTran
dbt
Kafka
Event Hubs

Job description

Location: Houston, TX – Hybrid

Position Type: Full-Time

A well-established Houston-based company is seeking an experienced Senior Data Engineer to join its Data & BI team and help implement and support a modern Azure cloud-based data platform.

This is a hands-on, delivery-focused role for a senior data engineer with strong experience in Databricks, Python, Azure data technologies, and enterprise data integration. The Senior Data Engineer will build and maintain scalable Lakehouse solutions, develop ELT/ETL pipelines, integrate data from multiple enterprise systems, and help ensure the performance, security, and reliability of the company's data platform.

Candidates must reside in the Houston area and be available to work onsite at the company's Houston office as needed.

Key Responsibilities
  • Build, implement, and maintain scalable cloud-based data solutions using Azure and Databricks.
  • Develop and support Lakehouse and medallion architecture solutions.
  • Design and maintain ELT/ETL workflows using Databricks, Azure Data Factory, Lakeflow, and Azure Data Lake Storage.
  • Integrate data from enterprise applications and databases, including ERP systems, Oracle, SQL Server, and other business platforms.
  • Develop solutions using Python, PySpark/Spark SQL, Delta Lake, and SQL.
  • Configure and maintain Databricks Unity Catalog, including access policies, metadata, and lineage.
  • Implement data security and access controls, including RBAC/ABAC and row‑and column‑level security.
  • Monitor data pipelines, troubleshoot failures, resolve data‑quality and performance issues, and support production environments.
  • Participate in DevOps and CI/CD processes using Git, Azure DevOps and/or GitHub Actions.
  • Develop and maintain technical documentation, including data flows, pipeline designs, runbooks, and configuration documentation.
  • Collaborate with technical and business teams in an Agile environment.
Required Qualifications
  • 5+ years of hands‑on Databricks data engineering experience.
  • Strong experience with Databricks, including Delta Lake, PySpark/Spark SQL, notebooks, jobs, and cluster management.
  • Hands‑on experience with the Microsoft Azure data ecosystem, including Azure Data Lake Storage Gen2 and Azure Data Factory.
  • Strong experience developing ETL/ELT pipelines and implementing Lakehouse/medallion architectures.
  • Experience with dimensional modeling and incremental data loads.
  • Strong database experience with Oracle and SQL Server, including PL/SQL and/or T‑SQL.
  • Experience integrating data from enterprise applications and multiple source systems.
  • Hands‑on experience implementing data security and access controls.
  • Experience with Git and modern CI/CD/DevOps practices.
  • Working knowledge of Power BI.
  • Strong troubleshooting, documentation, and communication skills.
Preferred Experience
  • Experience extracting and integrating data from JD Edwards (JDE).
  • Experience with Databricks Unity Catalog and Lakeflow.
  • FiveTran and/or dbt experience.
  • Streaming technologies such as Event Hubs, Kafka, or Structured Streaming.
  • Machine learning and AI development or deployment experience.
Work Arrangement

This is a Houston‑based hybrid position. Candidates must currently reside in the Houston metropolitan area and be available to work onsite at the Houston office when business needs require.

Candidates must be authorized to work in the United States on a permanent basis without current or future sponsorship. Third‑party and C2C submissions will not be considered.

The company offers a comprehensive benefits package that includes medical, dental and vision coverage, 401(k), pension, life insurance, paid time off, paid holidays, and wellness programs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Azure & Databricks (Hybrid, Houston)
Senior Data Engineer: Azure & Databricks (Hybrid, Houston)

Technology Recruiting Solutions • Houston (TX)

Hybrid
USD 120,000 - 180,000
Medical, dental, vision coverage
401(k) plan
Pension
+4
Senior Data Engineer
Senior Data Engineer

HumCap • Plano (TX)

Hybrid
USD 120,000 - 170,000
Senior Data Engineer, Azure Databricks
Senior Data Engineer, Azure Databricks

Nextech Solutions • United States

Remote
USD 130,000 - 170,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Virtue America • New York (NY)

On-site
USD 140,000 - 190,000
Senior Data Engineer on-site)
Senior Data Engineer on-site)

Ziosk • Dallas (TX)

On-site
USD 140,000 - 190,000
Senior Software Developer
Senior Software Developer

HeartCentrix Solutions • Arlington (TX)

Hybrid
USD 110,000 - 170,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Hillwood Development Company LLC • Dallas (TX)

On-site
USD 140,000 - 180,000
Medical Insurance
Dental Insurance
Vision Insurance
+12
Senior Solutions Consultant
Senior Solutions Consultant

Unison Group • San Francisco (CA)

On-site
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

General Motors Company • Austin (TX)

Hybrid
USD 130,000 - 190,000
Relocation benefits available