Data Platform Lead - Databricks & Governance

Sunmed Llc; El Paso (TX); On-site; USD 128,000 - 145,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k)

Paid time off

Paid holidays

Bereavement leave

Employee Assistance Program

Job summary

AirLife seeks a Data Engineering & Platform Manager to own the enterprise data platform, including Databricks, Unity Catalog, and related pipelines. You will govern data quality, define medallion architecture, and enable BI and AI teams to trust data.

You will lead a diverse team, collaborate with AI leads and FP&A, manage Databricks licensing and cost, and drive scalable, compliant data solutions within Azure. Travel up to 15% as required.

Qualifications

• 7-12 years of data engineering experience, including 3+ years of hands-on Databricks administration and pipeline development in an enterprise environment.
• Bachelor's degree in a related field; Databricks/Azure certifications preferred.

Responsibilities

• Own and administer the AirLife Databricks environment end-to-end, including workspace management, Unity Catalog governance configuration, cluster lifecycle management, access control administration, and platform performance optimization.
• Supervise staff including setting goals, mentoring staff, ensuring proper training and preparation for team assignments, and performance management
• Design, build, and maintain scalable, reliable data pipelines that ingest, transform, and deliver data from SAP ECC, Microsoft Dynamics GP, Salesforce, and other platforms into the Databricks Lakehouse in a governed, auditable manner.
• Establish and enforce data governance standards across the Databricks platform, including cataloging, metadata management, data lineage, data quality rule definition and monitoring.
• Define, implement, and maintain AirLife's medallion data architecture (bronze/silver/gold) ensuring datasets are clearly separated, documented, and fit for consumption.
• Partner with AI Lead, business analytics managers, and FP&A to align data with business needs.
• Monitor data pipeline health, performance, and data quality metrics; resolve issues proactively.
• Manage Databricks licensing, cost governance, and Azure billing to drive cost efficiency.
• Define and document data engineering standards, patterns, and runbooks for maintainability.
• Lead data integration designs and on-boarding of new data sources.
• Contribute to data strategy and roadmap discussions led by senior leadership.

Skills

Databricks

Team leadership

Data pipelines

Azure data services

Data governance

SQL & Python

Data modeling

ERP integration

Data security

Analytics requirements

Cost management

Regulatory compliance

dbt

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field

Databricks Certified Data Engineer or equivalent Azure data certification

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage Gen2

Job description

AirLife seeks a Data Engineering & Platform Manager to own the enterprise data platform, including Databricks, Unity Catalog, and related pipelines. You will govern data quality, define medallion architecture, and enable BI and AI teams to trust data.

You will lead a diverse team, collaborate with AI leads and FP&A, manage Databricks licensing and cost, and drive scalable, compliant data solutions within Azure. Travel up to 15% as required.