Databricks Platform Architect for Scalable Data Solutions

OpenTalent; Newport Beach (CA); On-site; USD 170,000 - 230,000; Full time

Job summary

OpenTalent is seeking an experienced Databricks Technical Architect to design, build, and implement scalable data and analytics solutions on the Databricks platform in a cloud-first environment. The role requires deep hands-on expertise with Spark, PySpark, SQL, Delta Lake, and data governance, plus experience migrating legacy systems to Databricks across AWS/Azure/GCP.

You will lead architecture discussions, define best practices, and collaborate with stakeholders to deliver robust data

Qualifications

• 8+ years of experience in Data Engineering/Data Architecture.
• Strong hands-on experience with Databricks, Apache Spark, PySpark, and SQL.
• Experience with Azure Databricks, AWS, or GCP cloud platforms.
• Knowledge of Delta Lake, Data Lakehouse architecture, and data governance.
• Experience with CI/CD, DevOps, and data integration tools.
• Strong stakeholder management and solution architecture skills.

Responsibilities

• Design and implement enterprise-scale data platforms using Databricks.
• Define data architecture, governance, security, and best practices.
• Build and optimize ETL/ELT pipelines using Spark, PySpark, and SQL.
• Collaborate with business and technical stakeholders to deliver data solutions.
• Lead migration of legacy data platforms to Databricks and cloud environments.
• Provide technical leadership, solution design, and architecture guidance.
• Optimize performance, scalability, and cost efficiency of data workloads.

Skills

Databricks

Apache Spark

PySpark

SQL

Delta Lake

Data Lakehouse

Cloud platforms

CI/CD

DevOps

Data governance

Stakeholder management

Solution architecture

Tools

Azure Databricks

Databricks Delta Lake

CI/CD tools

Job description

OpenTalent is seeking an experienced Databricks Technical Architect to design, build, and implement scalable data and analytics solutions on the Databricks platform in a cloud-first environment. The role requires deep hands-on expertise with Spark, PySpark, SQL, Delta Lake, and data governance, plus experience migrating legacy systems to Databricks across AWS/Azure/GCP.

You will lead architecture discussions, define best practices, and collaborate with stakeholders to deliver robust data