Databricks Lakehouse Architect - Remote/Hybrid, 6-Month CTH

Elios, Inc.; Houston (TX); Hybrid; USD 286,541,000 - 372,503,000; Full time

Benefits offered by this job

Mostly remote

Occasional onsite in Houston

Job summary

Elios, Inc. in Houston seeks a Databricks Architect to design and stand up lakehouse platforms that enterprise teams will run. You will own architecture end to end, from ingestion and medallion design to governance and cost controls, ensuring the platform is operable by the client's team.

The role is remote-first with periodic onsite time in Houston, and starts as a six-month contract with a path to full-time. You will lead architecture sessions and mentor client engineers.

Qualifications

• 8+ years in data engineering or data architecture.
• Production Databricks design experience.
• Strong SQL and Python proficiency.
• Travel to Houston onsite as needed.

Responsibilities

• Design lakehouse architectures on Databricks, including medallion layering and Delta Lake strategy.
• Lead client-facing architecture sessions and translate requirements into a platform plan.
• Build and tune ingestion and transformations with Spark, Delta Live Tables, and Databricks Workflows.
• Stand up Unity Catalog for governance, access controls, lineage, and cross-workspace sharing.
• Set standards for CI/CD and infrastructure as code for maintainability.
• Monitor cost with cluster policies and proper sizing.
• Plan migrations from legacy warehouses and on-prem Hadoop/SQL Server environments.
• Mentor client engineers and document decisions to ensure longevity of the platform.
• Prepare data foundations for ML and GenAI use cases.

Skills

Databricks architecture

Spark (PySpark)

SQL

Python

Cloud platforms

Data governance

Tools

Terraform

Azure DevOps

GitHub Actions

Kafka

Databricks

Job description

Elios, Inc. in Houston seeks a Databricks Architect to design and stand up lakehouse platforms that enterprise teams will run. You will own architecture end to end, from ingestion and medallion design to governance and cost controls, ensuring the platform is operable by the client's team.

The role is remote-first with periodic onsite time in Houston, and starts as a six-month contract with a path to full-time. You will lead architecture sessions and mentor client engineers.