AWS Databricks Architect

HMG AMERICA LLC; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

HMG AMERICA LLC is seeking a senior AWS Databricks Architect to lead end-to-end cloud data initiatives. You will design scalable Lakehouse platforms on AWS using Databricks, drive governance and security, and act as a trusted advisor to executive stakeholders.

You will guide migrations from legacy warehouses to modern AWS data ecosystems, work with Terraform or CloudFormation IaC, and mentor delivery teams while ensuring cost-efficient, high-performance solutions.

Qualifications

• Experience leading end-to-end cloud data enterprise initiatives.
• Strong background in IT consulting and professional services.
• Proven ability to guide architecture, design and execution of Lakehouse platforms on AWS.

Responsibilities

• Architect scalable data platforms on AWS using Databricks Lakehouse.
• Implement Medallion Architecture for real-time and batch pipelines.
• Enforce governance with Unity Catalog, IAM, and KMS.
• Lead client workshops and translate requirements into technical roadmaps.
• Develop IaC and CI/CD pipelines for Databricks notebooks and Spark jobs.

Skills

Cloud data architecture

Databricks Lakehouse

Client engagement

IaC

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Terraform

CloudFormation

Delta Live Tables

Spark

Job description

Job Title: AWS Databricks Architect (Remote)

Location: 100% Remote

Employment Type: Full-Time

Job Summary

We are seeking a senior AWS Databricks Architect with a strong background in IT consulting and professional services to lead end-to-end cloud data enterprise initiatives. In this role, you will act as a trusted technical advisor to client stakeholders while leading the architecture, design, and execution of scalable Lakehouse platforms on AWS using Databricks.

The ideal candidate possesses exceptional client engagement abilities, deep hands-on expertise with the Databricks Medallion Architecture and Unity Catalog, and proven experience migrating legacy data warehouses to modern AWS data ecosystems.

Key Responsibilities

1. Solution Architecture & Technical Delivery

• Architect, design, and implement scalable, enterprise-grade data platforms on AWS using Databricks Lakehouse.
• Establish data architecture patterns using the Medallion Architecture (Bronze, Silver, Gold layers) for real-time and batch data pipelines.
• Implement robust governance, security, and access control models across datasets using Databricks Unity Catalog, AWS IAM, and KMS.
• Optimize workspace configurations, cluster sizing, auto-scaling, and Delta Lake optimizations (Z-Ordering, Liquid Clustering) for high performance and cost efficiency.
• Integrate AWS-native services (S3, Glue, Lambda, EventBridge, Redshift, Athena, Secrets Manager) seamlessly with Databricks.

2. Client Engagement & Advisory (Consulting)

• Lead discovery workshops, technical assessments, and architecture reviews with C-level executives, VPs of Data, and Enterprise Architects.
• Translate complex business requirements into high-level architecture diagrams, technical roadmaps, and Statements of Work (SOWs).
• Educate clients on cloud data best practices, cost-optimization strategies, and modern Lakehouse paradigms.
• Drive client migration strategy from legacy data warehouses (e.g., Teradata, Netezza, Snowflake, On-Prem Hadoop) to AWS Databricks.
• Mentor and lead cross-functional delivery teams of Data Engineers, Analytics Engineers, and DevOps Engineers.
• Enforce Infrastructure-as-Code (IaC) practices using Terraform or CloudFormation for enterprise workspace deployments.
• Build CI/CD automation pipelines for Databricks notebooks, Delta Live Tables (DLT), and Spark jobs.