GCP Data Architect

Sibitalent Corp

Austin (TX)

On-site

USD 140,000 - 190,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sibitalent Corp in Austin, TX seeks a data engineering lead to design and implement scalable data lake architectures on Google Cloud Platform, spanning Bronze/Silver/Gold, and to oversee ingestion pipelines.

You'll optimize Parquet/ORC data formats, manage CDC/incremental ingestion, and build CI/CD for data workloads with Airflow/Cloud Composer, Dataflow, and BigQuery.

Qualifications

  • Experience designing data lake architectures (Bronze/Silver/Gold or layered models).
  • Strong knowledge of GCS design, bucket layouts, lifecycle policies and access controls.
  • Hands-on with columnar formats (Parquet/Avro/ORC) and compression techniques.

Skills

PySpark ETL
Distributed data processing
Data platforms on GCP
Data Lakes & warehousing
Batch and streaming ingestion
BigQuery SQL
Data governance & metadata
CI/CD for data workloads
Airflow / Cloud Composer
Partitioning & backfills

Tools

Cloud Composer / Airflow
Dataflow (Apache Beam)
Dataproc
BigQuery
GCS (Cloud Storage)
Parquet/Avro/ORC
Hadoop MapReduce
Python

Job description

  • Hands‑on experience with PySpark for ETL/ELT, data transformation, and performance optimization
  • Solid understanding of distributed data processing concepts
  • Strong experience designing data platforms on Google Cloud Platform (GCP)
  • Experience with Data Lakes, data warehousing, and large‑scale migration programs

Data Lake Architecture & Storage

  • Proven experience designing and implementing data lake architectures (e.g., Bronze/Silver/Gold or layered models).
  • Strong knowledge of Cloud Storage (GCS) design, including bucket layout, naming conventions, lifecycle policies, and access controls
  • Hands‑on experience with columnar data formats (Parquet, Avro, ORC) and compression techniques
  • Expertise in partitioning strategies, backfills, and large‑scale data organization

Data Ingestion & Orchestration

  • Experience building batch and streaming ingestion pipelines using GCP-native services
  • Knowledge of Pub/Sub-based streaming architectures, event schema design, and versioning
  • Strong understanding of incremental ingestion and CDC patterns, including idempotency and deduplication
  • Hands‑on experience with workflow orchestration tools (Cloud Composer / Airflow)
  • Ability to design robust error handling, replay, and backfill mechanisms

Data Processing & Transformation

  • Experience developing scalable batch and streaming pipelines using Dataflow (Apache Beam) and/or Spark (Dataproc)
  • Strong proficiency in BigQuery SQL, including query optimization, partitioning, clustering, and cost control.
  • Hands‑on experience with Hadoop MapReduce and ecosystem tools (Hive, Pig, Sqoop)
  • Advanced Python programming skills for data engineering, including testing and maintainable code design
  • Experience managing schema evolution while minimizing downstream impact
  • Experience implementing CI/CD pipelines for data and analytics workloads
  • Familiarity with Git‑based source control, build automation, and deployment strategies

Containers & Platform

  • Experience with OpenShift Container Platform (OCP) for deploying data workloads and services
  • Understanding of containerized architecture, scaling, and environment management
  • Proven ability to build CI/CD pipelines for data and infrastructure workloads
  • Experience managing secrets securely using GCP Secret Manager
  • Ownership of observability, SLOs, dashboards, alerts, and runbooks
  • Proficiency in logging, monitoring, and alerting for data pipelines and platform reliability

Data Governance, Quality & Metadata

  • Experience implementing data catalogs, metadata management, and ownership models
  • Understanding of data lineage for auditability and troubleshooting
  • Strong focus on data quality frameworks, including validation, freshness checks, and alerting
  • Experience defining and enforcing data contracts, schemas, and SLAs
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Architect
Senior Data Architect

Arkhya Tech. Inc. • Dallas (TX)

On-site
USD 120,000 - 150,000
GCP Data Engineer: Real-Time Pipelines & Kubernetes Lead
GCP Data Engineer: Real-Time Pipelines & Kubernetes Lead

TechDigital Group • Raleigh (NC)

On-site
USD 100,000 - 130,000
GCP Data Engineer
GCP Data Engineer

TechDigital Group • Seattle (WA)

On-site
USD 130,000 - 160,000
Senior GCP Data Engineer - Scalable Pipelines & Analytics
Senior GCP Data Engineer - Scalable Pipelines & Analytics

Compunnel Inc. • Phoenix (AZ)

Hybrid
USD 120,000 - 180,000
GCP Data Engineer
GCP Data Engineer

TechDigital Group • Raleigh (NC)

On-site
USD 100,000 - 130,000
GCP Data Engineer: Scalable Pipelines, IAM & Airflow
GCP Data Engineer: Scalable Pipelines, IAM & Airflow

TechDigital Group • Seattle (WA)

On-site
USD 130,000 - 160,000
GCP Data Engineer
GCP Data Engineer

Compunnel Inc. • Phoenix (AZ)

On-site
USD 120,000 - 180,000
Sr Data Engineer
Sr Data Engineer

TechDigital Group • St. Louis (MO)

On-site
USD 80,000 - 120,000
GCP Architect
GCP Architect

TechDigital Group • Secaucus (NJ)

On-site
USD 90,000 - 140,000
GCP Data Engineer
GCP Data Engineer

Arkhya Tech. Inc. • Concord (CA)

On-site
USD 140,000 - 190,000