Data Platform Engineer — Self-Serve Data Infra

Lantern; Dallas (TX); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical Insurance

Vision Insurance

Short & Long Term Disability

Life Insurance

401k with company match

Flexible Time Off

Job summary

Lantern is transforming its data platform to empower domain teams with self-serve infrastructure and governance. This hybrid Dallas-based role focuses on administering Databricks and Lakebase, managing Unity Catalog, and implementing robust access controls and automation.

You will collaborate with Cloud Platform, Security, and Analytics teams to ensure compliant, scalable, and observable data pipelines across the organization.

Qualifications

• Minimum 4 years in a platform or infrastructure engineering role.
• Deep hands-on experience with Databricks (workspace administration, Unity Catalog, Delta Lake) and Azure (Entra ID, networking, Key Vault).
• PostgreSQL administration experience (user/role management, backups, HA/DR).
• Experience with identity and access architecture (OBO, service principals vs user auth).
• CI/CD pipelines experience with GitHub Actions and/or Azure DevOps.
• Proficiency in Python scripting for automation and tooling.
• Experience using AI tools to accelerate engineering work (e.g., Copilot, ChatGPT).
• Comfort operating in regulated PHI environments (HIPAA/SOC 2).
• Ability to enforce architecture and security standards via automation.
• Strong problem-solving, communication, and collaboration with cross-functional teams.

Responsibilities

• Platform Administration: manage Databricks and Unity Catalog per standards; cost visibility and chargeback.
• Self-Serve Enablement: build provisioning workflows and templates for domain teams.
• Postgres DBA: manage Lakebase instances, backups, tuning, and recovery.
• IaC & Azure: script and provision resources with Terraform; manage Key Vault and Entra ID.
• Access Governance: implement Unity Catalog access controls and ABAC/OBO patterns.
• Audit & Lineage: build audit trails and lineage for decentralized ownership.
• Observability: operate Datadog/instrumentation for reliability across services.
• Reliability & DR: lifecycle management, backups, DR testing for platform workloads.
• CI/CD & GitHub: maintain pipelines and repo structure for data workloads.
• Cross-team collaboration: align with Security, HIPAA, and Core Apps on standards.

Skills

Databricks administration

Azure platform

PostgreSQL DBA

IaC with Terraform

GitHub Actions CI/CD

Python scripting

Observability tooling (Datadog/OpenTei

Access governance (ABAC/OBO)

HIPAA/SOC2 awareness

Tools

Databricks

Azure

Lakebase

Unity Catalog

Terraform

GitHub Actions

dbt

Job description

Lantern is transforming its data platform to empower domain teams with self-serve infrastructure and governance. This hybrid Dallas-based role focuses on administering Databricks and Lakebase, managing Unity Catalog, and implementing robust access controls and automation.

You will collaborate with Cloud Platform, Security, and Analytics teams to ensure compliant, scalable, and observable data pipelines across the organization.