Senior Data Platform Engineer - Databricks & Azure

United Global Technologies; Houston (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading technology firm in Houston is seeking a deeply technical Data Engineer to enhance a large-scale cloud data platform. Responsibilities include diagnosing performance issues, optimizing architecture, and mentoring junior engineers. Candidates should possess deep knowledge of Databricks, strong Python expertise, and advanced SQL skills. This hands-on role requires the ability to analyze complex data pipelines and propose improvements. The ideal candidate thrives in a collaborative environment and is comfortable tackling ambiguous challenges.

Qualifications

• Strong technical depth and hands-on individual contributor ability.
• Ability to analyze pipelines end-to-end.
• Comfortable challenging Databricks as a product.

Responsibilities

• Diagnose performance, latency, and cost issues in cloud data platforms.
• Propose and prove better approaches via POCs.
• Collaborate with and mentor other data engineers.

Skills

Deep understanding of Databricks internals

Performance tuning and optimization

Strong Python

Advanced SQL

PySpark (advanced)

Tools

Qlik Replicate

Azure Data Lake Storage

Databricks

Job description

A leading technology firm in Houston is seeking a deeply technical Data Engineer to enhance a large-scale cloud data platform. Responsibilities include diagnosing performance issues, optimizing architecture, and mentoring junior engineers. Candidates should possess deep knowledge of Databricks, strong Python expertise, and advanced SQL skills. This hands-on role requires the ability to analyze complex data pipelines and propose improvements. The ideal candidate thrives in a collaborative environment and is comfortable tackling ambiguous challenges.