Databricks Technical Architect - Tangentia

OpenTalent; Newport Beach (CA); On-site; USD 170,000 - 230,000; Full time

Job summary

OpenTalent is seeking an experienced Databricks Technical Architect to design, build, and implement scalable data and analytics solutions on the Databricks platform in a cloud-first environment. The role requires deep hands-on expertise with Spark, PySpark, SQL, Delta Lake, and data governance, plus experience migrating legacy systems to Databricks across AWS/Azure/GCP.

You will lead architecture discussions, define best practices, and collaborate with stakeholders to deliver robust data

Qualifications

• 8+ years of experience in Data Engineering/Data Architecture.
• Strong hands-on experience with Databricks, Apache Spark, PySpark, and SQL.
• Experience with Azure Databricks, AWS, or GCP cloud platforms.
• Knowledge of Delta Lake, Data Lakehouse architecture, and data governance.
• Experience with CI/CD, DevOps, and data integration tools.
• Strong stakeholder management and solution architecture skills.

Responsibilities

• Design and implement enterprise-scale data platforms using Databricks.
• Define data architecture, governance, security, and best practices.
• Build and optimize ETL/ELT pipelines using Spark, PySpark, and SQL.
• Collaborate with business and technical stakeholders to deliver data solutions.
• Lead migration of legacy data platforms to Databricks and cloud environments.
• Provide technical leadership, solution design, and architecture guidance.
• Optimize performance, scalability, and cost efficiency of data workloads.

Skills

Databricks

Apache Spark

PySpark

SQL

Delta Lake

Data Lakehouse

Cloud platforms

CI/CD

DevOps

Data governance

Stakeholder management

Solution architecture

Tools

Azure Databricks

Databricks Delta Lake

CI/CD tools

Job description

Job Summary: We are seeking an experienced Databricks Technical Architect to design, architect, and implement scalable data and analytics solutions on the Databricks platform. The ideal candidate will have strong expertise in data engineering, cloud technologies, big data frameworks, and modern data architectures.

Key Responsibilities:

• Design and implement enterprise-scale data platforms using Databricks.
• Define data architecture, governance, security, and best practices.
• Build and optimize ETL/ELT pipelines using Spark, PySpark, and SQL.
• Collaborate with business and technical stakeholders to deliver data solutions.
• Lead migration of legacy data platforms to Databricks and cloud environments.
• Provide technical leadership, solution design, and architecture guidance.
• Optimize performance, scalability, and cost efficiency of data workloads.

Required Skills:

• 8+ years of experience in Data Engineering/Data Architecture.
• Strong hands-on experience with Databricks, Apache Spark, PySpark, and SQL.
• Experience with Azure Databricks, AWS, or GCP cloud platforms.
• Knowledge of Delta Lake, Data Lakehouse architecture, and data governance.
• Experience with CI/CD, DevOps, and data integration tools.
• Strong stakeholder management and solution architecture skills.

Preferred Certifications:

• Databricks Certified Data Engineer/Architect
• Azure Solutions Architect or relevant Cloud Certifications