Lead Data Engineer: Databricks Lakehouse Architect

Talentify; Spring (TX); On-site; USD 140,000 - 170,000; Full time

Job summary

INSPYR Solutions seeks a Lead Data Engineer to drive end-to-end data platforms using Databricks, Delta Lake, Unity Catalog, and DBT. You will own architecture, delivery planning, and mentor teams while building scalable pipelines and quality frameworks.

This role collaborates with product, QA, and business stakeholders to deliver analytics-ready data products. The ideal candidate has 10+ years in data engineering, 5+ years with Databricks, and strong leadership and communication skills.

Qualifications

• Extensive experience designing and delivering enterprise data platforms.
• Hands-on Databricks development in enterprise environments.
• Senior technical lead capable of architecture, estimations, and mentoring.
• Experience with data quality frameworks and QA collaboration.
• Strong SQL and PySpark development skills.

Responsibilities

• Own end-to-end technical data engineering for enterprise platforms.
• Lead technical implementation while remaining hands-on with development.
• Provide delivery estimates, sprint planning input, and technical guidance to engineering teams.
• Mentor and coach data engineers while establishing engineering best practices.
• Design and maintain enterprise dimensional data models that support scalable reporting and analytics.
• Build modular, reusable Databricks pipelines and DBT transformations.
• Develop data quality validations and automation for lineage and schema evolution.
• Collaborate with QA, analytics, and business stakeholders to ensure data models support self-service analytics.
• Monitor and optimize pipeline performance and ensure high availability.

Skills

Databricks

Delta Lake

Unity Catalog

DBT

PySpark

SQL

Data modeling

Leadership

Mentoring

Problem solving

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field

Equivalent practical experience

Tools

Databricks

Delta Lake

Unity Catalog

Delta Live Tables

DBT

PySpark

SQL

Git

Azure DevOps

Job description

INSPYR Solutions seeks a Lead Data Engineer to drive end-to-end data platforms using Databricks, Delta Lake, Unity Catalog, and DBT. You will own architecture, delivery planning, and mentor teams while building scalable pipelines and quality frameworks.

This role collaborates with product, QA, and business stakeholders to deliver analytics-ready data products. The ideal candidate has 10+ years in data engineering, 5+ years with Databricks, and strong leadership and communication skills.