Databricks Platform Architect - hitachi

OpenTalent; Dallas (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

Hitachi is seeking a highly skilled Databricks Platform Architect to lead design and implementation of scalable, enterprise-grade data platforms using Databricks on AWS. You will combine deep data engineering expertise with architectural leadership and stakeholder engagement to deliver analytics-ready lakehouses.

The role emphasizes governance, security, and FinOps-driven cost optimization while enabling AI capabilities across GenAI, Vector Search, and Model Serving.

Qualifications

• Proven experience designing and implementing enterprise data platforms on cloud.
• Strong leadership and stakeholder engagement abilities across technical and business teams.
• Expertise in data governance, security, and compliance within large-scale environments.

Responsibilities

• Architect and deliver a secure, scalable Databricks Lakehouse platform on AWS.
• Design data platforms leveraging S3, Delta Lake, Unity Catalog and Databricks Workspaces for analytics and AI.
• Define networking architecture including VPC, PrivateLink, IAM roles, security groups, and encryption standards.

Skills

Databricks

Terraform

Kubernetes

CI/CD

GitHub

AWS

Spark/PySpark

Delta Lake

Unity Catalog

CloudWatch

Kafka

Airflow

MLflow

Tools

Databricks

AWS

S3

Delta Lake

Unity Catalog

Spark/PySpark

Terraform

GitHub

CI/CD

CloudWatch

Mosaic AI

Genie

Vector Search

MLflow

Kafka

Airflow

Kubernetes

Job description

Function

Job description

Role Summary

We are looking for a highly skilled Databricks Platform Architect to lead the design and implementation of scalable, enterprise‑grade data platforms using Databricks. The ideal candidate will combine strong technical expertise in data engineering and cloud platforms (AWS/Azure/GCP) with architectural leadership, solution design capability, and strong stakeholder engagement skills.

Key Responsibilities

Databricks on AWS Platform Architect – Platform Architecture

• Architect and manage a secure, scalable, and highly available Databricks Lakehouse Platform on AWS .
• Design data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Workspaces for enterprise analytics and AI.
• Define networking architecture including VPC, PrivateLink, IAM roles, security groups, and encryption standards .
• Establish multi‑environment strategies (Dev, Test, UAT, Prod) with automated provisioning through Terraform and Infrastructure as Code (IaC) .
• Implement enterprise‑wide data governance, lineage, metadata management, and compliance controls using Unity Catalog.
• Design high‑performance data ingestion and processing architectures supporting batch, streaming, and real‑time analytics workloads .
• Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces .
• Define CI/CD, monitoring, logging, and observability frameworks using GitHub, Jenkins, CloudWatch, and Databricks Workflows .
• Optimize platform performance, reliability, scalability, and cloud costs through FinOps and workload optimization practices.
• Provide architectural leadership and best practices for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption.

Core Technologies: Databricks, AWS S3, Delta Lake, Unity Catalog, Spark/PySpark, Terraform, GitHub, CI/CD, CloudWatch, Mosaic AI, Genie, Vector Search, MLflow, Kafka, Airflow, Kubernetes.

#LI-MS2

Fostering innovation through diverse perspectives

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit‑based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.

How we look after you