Senior Data Engineer: Azure & Databricks Lakehouse (Hybrid)

Technology Recruiting Solutions,Inc.; Houston (TX); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical, dental and vision coverage

401(k)

Pension plan

Life insurance

Paid time off

Paid holidays

Wellness programs

Job summary

Technology Recruiting Solutions,Inc. is seeking a Senior Data Engineer in the Houston area to lead the development of a modern Azure-based data platform. This hands-on role focuses on Databricks, Python, and enterprise data integration, building scalable Lakehouse solutions, and ensuring security and reliability.

You will design and maintain ELT/ETL pipelines, integrate ERP systems and databases, and contribute to DevOps practices. Onsite presence in Houston is required as needed.

Qualifications

• 5 years of hands-on Databricks data engineering experience.
• Strong Python development skills.
• Strong experience with Databricks, including Delta Lake, PySpark/Spark SQL, notebooks, jobs, and cluster management.
• Hands-on experience with the Microsoft Azure data ecosystem, including Azure Data Lake Storage Gen2 and Azure Data Factory.
• Strong experience developing ETL/ELT pipelines and implementing Lakehouse/medallion architectures.
• Experience with dimensional modeling and incremental data loads.
• Strong database experience with Oracle and SQL Server, including PL/SQL and/or T-SQL.
• Experience integrating data from enterprise applications and multiple source systems.
• Hands-on experience implementing data security and access controls.
• Experience with Git and modern CI/CD/DevOps practices.
• Working knowledge of Power BI.

Responsibilities

• Build, implement, and maintain scalable cloud-based data solutions using Azure and Databricks.
• Develop and support Lakehouse and medallion architecture solutions.
• Design and maintain ELT/ETL workflows using Databricks, Azure Data Factory, Lakeflow, and Azure Data Lake Storage.
• Integrate data from enterprise applications and databases, including ERP systems, Oracle, SQL Server, and other business platforms.
• Develop solutions using Python, PySpark/Spark SQL, Delta Lake, and SQL.
• Configure and maintain Databricks Unity Catalog, including access policies, metadata, and lineage.
• Implement data security and access controls, including RBAC/ABAC and row- and column-level security.
• Monitor data pipelines, troubleshoot failures, resolve data-quality and performance issues, and support production environments.
• Participate in DevOps and CI/CD processes using Git, Azure DevOps and/or GitHub Actions.
• Develop and maintain technical documentation, including data flows, pipeline designs, runbooks, and configuration documentation.
• Collaborate with technical and business teams in an Agile environment.

Skills

Databricks

Python

Delta Lake

PySpark / Spark SQL

Azure data ecosystem

ETL/ELT pipelines

Lakehouse / medallion architecture

Oracle

SQL Server

Git / CI/CD / DevOps

Power BI

Tools

Databricks Unity Catalog

Lakeflow

Azure Data Factory

Azure Data Lake Storage Gen2

Git

Azure DevOps / GitHub Actions

Job description

Technology Recruiting Solutions,Inc. is seeking a Senior Data Engineer in the Houston area to lead the development of a modern Azure-based data platform. This hands-on role focuses on Databricks, Python, and enterprise data integration, building scalable Lakehouse solutions, and ensuring security and reliability.

You will design and maintain ELT/ETL pipelines, integrate ERP systems and databases, and contribute to DevOps practices. Onsite presence in Houston is required as needed.