GCP Data Platform Engineer

Centraprise, Corp.; Colombia; Remote; COP 283.224.000 - 472.040.000; Vollzeit

Zusammenfassung

Centraprise, Corp. seeks a hands-on GCP Data Platform Engineer to design, build, and optimize scalable data platforms on Google Cloud. You will craft pipelines using Dataflow and Data Fusion, manage BigQuery warehouses, and develop Looker semantic layers to enable BI across teams.

Ideal candidates will have 3–5+ years of experience, strong SQL, Python/Java/Scala, Airflow, Terraform, and a solid grasp of data governance, security, and metadata management. Remote-friendly with flexible time zones.

Qualifikationen

• 3-5+ years of hands-on experience building production-grade data solutions on GCP.
• Experience designing scalable data pipelines with Dataflow and Cloud Data Fusion.
• Strong SQL expertise, performance tuning, and cost management in BigQuery.
• Experience developing LookML models and Looker deployments for BI.
• Proficiency in Python, Java, or Scala for data processing.
• Knowledge of data modeling (Star/Snowflake/Data Vault 2.0) and data governance.
• Experience with DAGs/workflows using Airflow/Cloud Composer.
• Familiarity with IaC using Terraform and CI/CD in data platforms.

Aufgaben

• Design and implement scalable batch and real-time data pipelines on GCP.
• Build and optimize data warehouses in BigQuery with partitioning and clustering.
• Develop and manage data workflows using Cloud Composer (Airflow).
• Implement CI/CD pipelines and Infrastructure as Code using Terraform.
• Develop LookML models, explores, and semantic layers in Looker for BI.
• Optimize BigQuery costs and Looker performance via caching and materialized views.
• Apply data modeling: Star, Snowflake, and Data Vault 2.0 concepts.
• Support data governance, security, IAM, and metadata management.

Kenntnisse

GCP

BigQuery

Dataflow

LookML/Looker

Python/Java/Scala

SQL

Data Modeling

Airflow/Cloud Composer

Terraform

CI/CD

Tools

Cloud Data Fusion

Cloud Composer

Looker

BigQuery

Dataflow

Terraform

Jobbeschreibung

Job Description: GCP Data Platform Engineer

Experience: 3-5+ Years

Location: Remote - Open to candidates from any country

Time Zone: Must align with Brasilia Standard Time (BRT) or Mexico Standard Time

Language: Portuguese or Spanish, with English required

Job Overview

We are looking for an experienced GCP Data Platform Engineer to design, develop, and optimize scalable data platforms and pipelines on Google Cloud Platform (GCP). The ideal candidate will have strong hands-on experience with BigQuery, Dataflow, and Looker, along with expertise in data engineering, data warehousing, and pipeline orchestration.

Experience in data governance, data quality, and metadata management is preferred.

Key Responsibilities

• Design and develop scalable batch and real-time data pipelines using GCP Dataflow (Apache Beam) and Cloud Data Fusion.


• Build, manage, and optimize data warehouses in Google BigQuery, including partitioning, clustering, SQL optimization, and query performance.


• Develop and manage data workflows using Cloud Composer (Apache Airflow).


• Implement CI/CD pipelines and Infrastructure as Code (IaC) using Terraform.


• Develop LookML models, explores, and semantic layers in Looker to support business intelligence and analytics.


• Optimize BigQuery costs and Looker performance using caching, materialized views, and other performance-tuning techniques.


• Implement data modeling solutions using Star Schema, Snowflake Schema, and Data Vault 2.0 concepts.


• Support data governance, security, metadata management, and data lineage using GCP Dataplex, IAM, and related tools.


• Develop automated data quality checks and monitor pipeline performance, data anomalies, and reliability.


• Collaborate with engineering, analytics, and business teams to deliver reliable, secure, and high-performing data solutions.

Required Technical Skills

• GCP: 3-5+ years of hands-on experience developing production-grade data solutions on Google Cloud Platform.


• BigQuery: Strong expertise in SQL, query optimization, partitioning, clustering, and cost management.


• Dataflow: Practical experience with Apache Beam for batch and streaming data processing.


• Looker/LookML: Experience building LookML models, explores, and managing Looker deployments.


• Programming: Proficiency in Python, Java, or Scala.


• SQL: Strong SQL development and data transformation skills.


• Data Modeling: Knowledge of Star Schema, Snowflake Schema, and Data Vault 2.0.


• Workflow Orchestration: Experience with Cloud Composer or Apache Airflow.


• DevOps: Familiarity with Terraform, Infrastructure as Code, and CI/CD practices.

Preferred Skills

• Experience with data governance and cataloging tools such as GCP Dataplex or Apache Atlas.


• Knowledge of data security, IAM policies, data privacy, and Cloud Data Loss Prevention (DLP).


• Experience with data lineage, metadata management, and automated data quality frameworks.


• Familiarity with BigQuery materialized views, caching, and BI Engine.


• GCP Professional Data Engineer or Professional Cloud Architect certification.

Language and Time Zone Requirements

• Portuguese or Spanish proficiency is required.


• English communication skills are mandatory.


• Candidates must be available to work in alignment with Brasilia Standard Time (BRT) or Mexico Standard Time.


• Candidates may be based in any country, provided they can meet the language and time zone requirements.

Ideal Candidate

The ideal candidate is a hands-on data engineering professional with strong GCP expertise, capable of building and maintaining enterprise-scale data pipelines, optimizing BigQuery workloads, and enabling analytics through Looker. Strong problem-solving skills and the ability to communicate effectively with technical and business stakeholders are essential.