Data Platform Engineer - Self-Serve Infra

Lantern; Dallas (TX); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Medical Insurance

Vision Insurance

Disability Insurance

Life Insurance

401k with company match

Flexible Time Off

Job summary

Lantern is transforming its data platform; this role administers the Databricks and Lakebase estate, enforces standards, and enables domain teams to self-serve with secure access patterns. You will work with Azure, Terraform, and GitHub Actions to deliver reliable, compliant data infrastructure.

Hybrid role based in Dallas, TX, focused on platform administration, governance, and observability. Strong collaboration with security, cloud, and analytics teams is essential.

Qualifications

• Minimum of 4 years in a platform or infrastructure engineering role supporting a data or analytics organization.
• Deep hands-on experience with Databricks (workspace administration, Unity Catalog, Delta Lake) and Azure services.
• Hands-on PostgreSQL administration experience (Lakebase or similar).
• Experience building CI/CD pipelines with GitHub Actions and/or Azure DevOps.
• Proficiency in Python or another scripting language for automation.
• Experience with Infrastructure-as-Code (Terraform/Bicep) and cloud security practices.
• Familiarity with HIPAA/SOC 2 environments and PHI data handling.
• Strong communication and collaboration skills to work with cross-functional teams.

Responsibilities

• Administer Azure Databricks and Unity Catalog per data-architecture standards; manage workspace, metastore, catalogs, schemas, and cost controls.
• Build self-serve infrastructure layers, provisioning workflows, templates, and access patterns for domain teams.
• DBA for Lakebase Postgres: provisioning, user/role management, performance tuning, backups, and DR planning.
• Develop and maintain IaC for Azure resources; ensure repeatable, auditable platform changes.
• Enforce platform access models (Unity Catalog, ABAC, OBO) across teams; manage data masking and RBAC.
• Implement audit and lineage capabilities; monitor telemetry and incident response for platform components.
• Maintain observability with Datadog/OpenTelemetry; ensure reliability and SLAs across Databricks and Lakebase.
• Support the platform lifecycle: provisioning, decommissioning, DR testing, and incident support.

Skills

Databricks

Azure

PostgreSQL

CI/CD

GitHub Actions

Python

Terraform

Security & IAM

Tools

Terraform

dbt

GitHub Actions

Azure SQL

Job description

Lantern is transforming its data platform; this role administers the Databricks and Lakebase estate, enforces standards, and enables domain teams to self-serve with secure access patterns. You will work with Azure, Terraform, and GitHub Actions to deliver reliable, compliant data infrastructure.

Hybrid role based in Dallas, TX, focused on platform administration, governance, and observability. Strong collaboration with security, cloud, and analytics teams is essential.