Senior Databricks Lakehouse Architect & Platform Lead

Scicominfra; Atlanta (GA); On-site; USD 180,000 - 240,000; Full time

Job summary

Scicominfra is seeking an experienced Data Architect to lead Databricks lakehouse design and platform strategy. You will drive reference architectures for batch, streaming, analytics, and ML workloads while standardizing cluster, compute, and workspace setup.

You will ensure scalability, reliability, and cost efficiency and collaborate with data engineering, analytics, ML, and security teams to govern data platforms.

Qualifications

• 7+ years in data engineering, analytics, or platform architecture.
• 3–5+ years hands-on Databricks experience in production environments.
• Proven experience applying the Databricks Well-Architected Framework.
• Experience designing cloud-native lakehouse architectures.
• Experience supporting mission-critical data platforms.

Responsibilities

• Design enterprise Databricks Lakehouse architectures aligned with the Databricks Well-Architected Framework.
• Define reference architectures for batch, streaming, analytics, and ML workloads.
• Select and standardize cluster, compute, and workspace architectures.
• Design multi-workspace strategies (dev/test/prod, shared vs. isolated).
• Ensure architectures meet scalability, availability, and performance requirements.

Skills

Databricks Lakehouse Platform

Apache Spark

Delta Lake

Delta Live Tables

Structured Streaming

Unity Catalog

Cloud platforms

Infrastructure as Code

CI/CD

Parquet/JSON/Avro

Tools

Terraform

GitHub Actions

Azure DevOps

GitLab

Job description

Scicominfra is seeking an experienced Data Architect to lead Databricks lakehouse design and platform strategy. You will drive reference architectures for batch, streaming, analytics, and ML workloads while standardizing cluster, compute, and workspace setup.

You will ensure scalability, reliability, and cost efficiency and collaborate with data engineering, analytics, ML, and security teams to govern data platforms.