Senior Data Engineer: AI-Ready Lakehouse Lead

Hillwood; Dallas (TX); Presencial; USD 120.000 - 180.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical Insurance

Dental Insurance

Vision Insurance

401(k) with company match

Tuition assistance

Health Savings Account (HSA)

Descripción de la vacante

Hillwood in Dallas, TX is seeking a Senior Data Engineer to design, build, and scale data pipelines on the Databricks lakehouse platform. You will partner with business teams to understand data requirements, ensure data quality, and deliver trusted datasets to enable analytics and AI initiatives.

Ideal candidates bring 5+ years in data engineering, strong SQL/PySpark skills, and experience with Unity Catalog, CI/CD, and cloud data architectures. This role offers growth and impact.

Formación

• Minimum five years of data engineering experience with production pipelines.
• Experience on Databricks and Spark-based architectures.
• Strong SQL, Python, and data modeling skills.
• Knowledge of data governance, Unity Catalog, and data quality.
• Experience collaborating with business stakeholders.

Responsabilidades

• Design, develop, and maintain scalable data pipelines on Databricks.
• Develop data models across Bronze to Gold following medallion framework.
• Implement CDC and incremental processing for timely data delivery.
• Administer Unity Catalog and ensure data governance.
• Design production pipelines with scheduling, monitoring, and CI/CD.
• Improve performance, scalability, and cost efficiency of workloads.
• Document standards and operational procedures for sustainability.
• Partner with stakeholders to define data requirements and quality.

Conocimientos

SQL

Python

PySpark

Data Modeling

CI/CD

Azure Cloud

Databricks

Unity Catalog

Communication

Problem Solving

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Databricks

Unity Catalog

Azure DevOps

GitHub

Delta Lake

Spark SQL

Descripción del empleo

Hillwood in Dallas, TX is seeking a Senior Data Engineer to design, build, and scale data pipelines on the Databricks lakehouse platform. You will partner with business teams to understand data requirements, ensure data quality, and deliver trusted datasets to enable analytics and AI initiatives.

Ideal candidates bring 5+ years in data engineering, strong SQL/PySpark skills, and experience with Unity Catalog, CI/CD, and cloud data architectures. This role offers growth and impact.