Senior Data Architect – Google Cloud Platform and Databricks

Jobtailor; Deutschland; Remote; EUR 120.000 - 180.000; Vollzeit

Zusammenfassung

Jobtailor is seeking a senior Data Architect to design scalable Lakehouse architectures on GCP and Databricks. You will lead data governance efforts, drive migrations, and define ingestion and processing standards.

You will mentor junior staff and partner with Engineering and Data Science teams to translate business needs into robust data solutions. The role emphasizes FinOps, data quality, and security, with LGPD compliance in focus.

Qualifikationen

• 5+ years of experience in scalable data governance.
• Ability to create and promote sustainable governance processes and policies.
• 5+ years of hands-on experience with Google Cloud Platform (GCP), including BigQuery, Cloud Storage, Dataflow, Cloud Composer, and Dataplex.
• Deep knowledge of data modeling and Data Mesh.
• Understanding of data catalog and cross-domain data-sharing platforms.
• Knowledge of Apache Iceberg integrated with Apache Spark and BigLake.
• Experience with Databricks, including Delta Lake, Unity Catalog, and cluster optimization.
• Proven experience migrating structured and unstructured data and designing new architectures from the ground up.
• Previous experience as a Data Architect or Lead/Principal Data Engineer.
• Proficiency in PySpark, Python, and advanced SQL for large-scale data processing.
• Experience with Lakehouse architecture and CI/CD applied to data (DataOps).
• Excellent communication skills, with the ability to translate technical concepts for business audiences and lead architecture discussions.
• Official GCP certifications are a plus
• Official Databricks certifications are a plus
• Experience with Infrastructure as Code (IaC), preferably Terraform, is a plus
• Experience in loyalty programs, e-commerce, payments, or financial services is a plus

Aufgaben

• Lead the design, documentation, and implementation of modern, scalable Lakehouse architectures using GCP and Databricks.
• Drive and ensure the success of complex data migration projects, from on-premises to the cloud or across cloud platforms.
• Define standards for data ingestion, processing, and consumption.
• Ensure high performance and cost optimization (FinOps).
• Define guidelines for data governance, quality, lineage, and security in compliance with LGPD.
• Serve as the primary technical reference for Engineering and Data Science teams.
• Support complex technical decisions and mentor junior professionals.
• Promote a data-driven culture and drive continuous improvement across the Data Chapter.
• Collaborate with Livelo stakeholders to translate business needs into robust technical solutions.

Kenntnisse

GCP

Databricks

Data Governance

Data Modeling

PySpark

SQL

Data Mesh

CI/CD

DataOps

Medallion Architecture

Ausbildung

GCP Certifications

Databricks Certifications

Tools

BigQuery

Cloud Storage

Dataflow

Cloud Composer

Dataplex

Delta Lake

Unity Catalog

Terraform

Apache Iceberg

Jobbeschreibung

• Lead the design, documentation, and implementation of modern, scalable Lakehouse architectures using GCP and Databricks


• Drive and ensure the success of complex data migration projects, from on-premises environments to the cloud or between cloud platforms


• Define standards for data ingestion, processing, and consumption


• Ensure high performance and infrastructure cost optimization (FinOps)


• Define best practices for dimensional, relational, and NoSQL data modeling


• Implement Bronze, Silver, and Gold medallion architecture


• Define guidelines for data governance, quality, lineage, and security in compliance with Brazil’s LGPD


• Serve as the primary technical reference for Engineering and Data Science teams


• Support complex technical decisions


• Promote a data-driven culture and mentor junior professionals


• Drive continuous improvement across the Data Chapter


• Collaborate with Livelo stakeholders and business leaders to translate business needs into robust technical solutions

Requirements

• More than 5 years of experience in scalable data governance


• Ability to create and promote sustainable governance processes and policies


• More than 5 years of hands‑on experience with Google Cloud Platform (GCP), including BigQuery, Cloud Storage, Dataflow, Cloud Composer, and Dataplex


• Deep knowledge of data modeling and Data Mesh


• Understanding of data catalog and cross-domain data‑sharing platforms


• Knowledge of Apache Iceberg integrated with Apache Spark and BigLake


• Experience with Databricks, including Delta Lake, Unity Catalog, and cluster optimization


• Proven experience migrating structured and unstructured data and designing new architectures from the ground up


• Previous experience as a Data Architect or Lead/Principal Data Engineer


• Proficiency in PySpark, Python, and advanced SQL for large‑scale data processing


• Experience with Lakehouse architecture and CI/CD applied to data (DataOps)


• Excellent communication skills, with the ability to translate technical concepts for business audiences and lead architecture discussions


• Official GCP certifications are a plus


• Official Databricks certifications are a plus


• Experience with Infrastructure as Code (IaC), preferably Terraform, is a plus


• Experience in loyalty programs, e‑commerce, payments, or financial services is a plus

Core Competencies

Demonstrates expertise in designing and implementing scalable Lakehouse architectures using GCP and Databricks, with a strong focus on data governance, migration, and optimization. Proficient in data modeling, data quality, and mentoring teams to foster a data-driven culture.

Highest-signal resume keywords

• GCP (Google Cloud Platform)


• Databricks


• Data Governance


• Data Modeling


• PySpark

Hard Skills

• Data Migration


• Data Processing


• SQL


• NoSQL


• Data Mesh


• Infrastructure as Code (IaC)


• CI/CD


• DataOps


• Bronze, Silver, Gold Medallion Architecture


• Apache Iceberg

Soft Skills

• Excellent Communication


• Mentoring


• Collaboration

Certifications & Qualifications

• GCP Certifications


• Databricks Certifications

Industry Keywords

• Loyalty Programs


• E-commerce


• Payments


• Financial Services


• LGPD Compliance

Tools & Technologies

• BigQuery


• Cloud Storage


• Dataflow


• Cloud Composer


• Dataplex


• Delta Lake


• Unity Catalog


• Terraform