Databricks Solution Architect — Lead Data Platforms

Hitachi Digital Services; Dallas (TX); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Hitachi Digital Services is seeking a Databricks Solution Architect to lead design and implementation of scalable data platforms across AWS/Azure/GCP. You will combine data engineering expertise with architectural leadership to deliver enterprise-grade solutions.

You will guide end-to-end architectures, oversee ETL/ELT pipelines, real-time streaming, data governance, and security while collaborating with stakeholders to translate requirements into scalable technical designs.

Qualifications

• Strong hands-on Databricks experience with clusters, notebooks, Delta Lake, MLflow, and Unity Catalog.
• Proficient in Spark, Python, SQL, and distributed data processing.
• Experience designing large-scale data solutions and real-time streaming.

Responsibilities

• Design end-to-end data architectures using Databricks Lakehouse.
• Architect scalable ETL/ELT pipelines and real-time streaming solutions.
• Lead technical discussions and mentor data engineers.
• Collaborate with product owners and analytics teams to translate requirements into scalable technical solutions.
• Define governance, security, and compliance across Databricks workspaces.
• Stay updated on Databricks features and propose improvements.

Skills

Databricks

Cloud platforms

Spark

Python

SQL

Data architecture

Streaming

CI/CD

Tools

Delta Lake

MLflow

Unity Catalog

Job description

Hitachi Digital Services is seeking a Databricks Solution Architect to lead design and implementation of scalable data platforms across AWS/Azure/GCP. You will combine data engineering expertise with architectural leadership to deliver enterprise-grade solutions.

You will guide end-to-end architectures, oversee ETL/ELT pipelines, real-time streaming, data governance, and security while collaborating with stakeholders to translate requirements into scalable technical designs.