Data Platform Engineer: Azure Databricks & Governance

employerdirecthealthcare; Town of Texas, Fort Worth (WI, TX); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Lantern is seeking a Platform Engineer to administer Azure Databricks and Unity Catalog, manage Lakebase Postgres, and enforce governance. You will build self-serve infrastructure, handle IaC with Terraform, and ensure reliability with observability tools.

Based in Dallas, TX, this hybrid role requires collaboration with data domain teams and ongoing optimization of the platform. You will report to Platform Engineering and support CI/CD for data workloads.

Responsibilities

• Platform Administration: Administer Azure Databricks and Unity Catalog platform according to architecture standards.
• Self-Serve Enablement: Build self-serve infrastructure for domain teams to manage their data products.
• Postgres Database Administration (Lakebase): DBA for Lakebase, provisioning, tuning, backups, and sync with lakehouse.
• Infrastructure-as-Code: Maintain Terraform scripts for Azure resources and security controls.
• Access & Governance: Implement Unity Catalog access models, ABAC, and RLS across teams.
• Audit & Lineage: Build audit and lineage layers for decentralized ownership and incident response.
• Observability: Operate Databricks, Lakebase, and Azure services observability for reliability.
• Reliability & Disaster Recovery: Manage provisioning, backups, DR testing for platform and DB workloads.
• Support Coverage: No overnight on-call; occasional support for deployments and incidents.
• CI/CD: Enable CI/CD for notebooks, jobs, DLT pipelines, and migrations.

Skills

Azure Databricks

Unity Catalog

Postgres

Terraform

IaC

Data governance

DBA

Tools

Databricks

Lakehouse

Job description

Lantern is seeking a Platform Engineer to administer Azure Databricks and Unity Catalog, manage Lakebase Postgres, and enforce governance. You will build self-serve infrastructure, handle IaC with Terraform, and ensure reliability with observability tools.

Based in Dallas, TX, this hybrid role requires collaboration with data domain teams and ongoing optimization of the platform. You will report to Platform Engineering and support CI/CD for data workloads.