Data Engineer Lead

RandomTrees; Houston (TX); On-site; USD 120,000 - 150,000; Part time

Job summary

A technology solutions provider in Houston is seeking an experienced Director with deep expertise in Databricks and Azure data services. The ideal candidate will have over 12 years in data engineering, strong stakeholder management skills, and the ability to lead strategic initiatives in a high-volume, real-time processing environment. Certifications in Azure Data Engineering and Databricks are preferred. This position offers a contract employment opportunity.

Qualifications

• 12+ years of experience in data engineering and analytics.
• Certifications in Azure Data Engineering and Databricks preferred.

Responsibilities

• Lead cross-functional teams to drive strategic data initiatives.
• Optimise Databricks for real-time data processing.
• Manage stakeholder communications and accountability.

Skills

Databricks DLT

PySpark

Python

SQL

Azure data services

Stakeholder management

Strategic data initiatives

Education

Bachelor’s or Master’s degree in IT or related discipline

Job description

Overview

Deep experience with Databricks DLT, Structured Streaming, PySpark, Python, and SQL. Strong knowledge of Azure data services (ADF, ADLS, Synapse, Stream Analytics). Proven ability to optimise Databricks for high-volume, real-time data processing. Experience with ETRM platforms and trading data workflows. Strong stakeholder management and executive communication skills. Demonstrated ownership, accountability, and passion for delivering impactful solutions. Ability to lead cross-functional teams and drive strategic data initiatives. Bachelor’s or Master’s degree in IT or related discipline. 12+ years of experience in data engineering and analytics. Certifications in Azure Data Engineering and Databricks (preferred).

Seniority level

• Director

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting