GCP Data Architect: Modern Data Lake & BigQuery Lead

CloudBigD

Dallas (TX)

On-site

USD 140,000 - 210,000

Full time

15 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CloudBigD is seeking an experienced Data Architect to lead the IAM Data Modernization effort in a on-prem to GCP cloud migration. You will own end-to-end data architecture, define a metadata-driven ETL framework, and design scalable ingestion and data lake patterns across GCP services.

You will guide governance, schema drift detection, and operational resilience, while collaborating on CI/CD automation and secure data access. 8+ years of cloud data experience preferred.

Qualifications

  • Hands-on PySpark ETL/ELT development and optimization.
  • Experience with distributed data processing concepts.
  • Strong data platform design on GCP (BigQuery, Cloud Storage, Dataflow).
  • Experience with data lakes/warehousing and large-scale migrations.
  • Knowledge of metadata-driven architecture and governance.

Responsibilities

  • Own end-to-end data architecture for IAM Data Modernization across sources and GCP.
  • Define and guide a metadata-driven ETL framework for diverse sources (databases, APIs, files, MongoDB, Splunk, Active Directory).
  • Architect reusable metadata models for configuration, run tracking, and auditability.
  • Provide architecture direction for MVC-based orchestration and standardized contracts.
  • Design scalable ingestion patterns (full/incremental, CDC, batch, API, file-based).
  • Guide S3 data lake zones (Landing, Raw, Archive, Error) with promotion and replay patterns.
  • Define data quality, schema drift, checkpoint restartability, and resilience standards.
  • Lead GCP/BigQuery architecture including data lake integration and secure connectivity.
  • Review CI/CD automation for data/analytics workloads (GitHub Actions, Liquibase, Helm).
  • Provide guidance on Python, PySpark, SQL, BigQuery, PostgreSQL, data modeling, and performance tuning.

Skills

PySpark ETL/ELT
Distributed data processing
Google Cloud Platform (GCP)
Data lakes & warehousing
Data lake architectures
Cloud Storage (GCS)
Partitioning strategies
Dataflow / Dataproc
BigQuery SQL
CI/CD for data/analytics

Tools

Git
GitHub Actions
Jenkins
Liquibase
Helm

Job description

CloudBigD is seeking an experienced Data Architect to lead the IAM Data Modernization effort in a on-prem to GCP cloud migration. You will own end-to-end data architecture, define a metadata-driven ETL framework, and design scalable ingestion and data lake patterns across GCP services.

You will guide governance, schema drift detection, and operational resilience, while collaborating on CI/CD automation and secure data access. 8+ years of cloud data experience preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Architect: Data Lake & BigQuery Lead
GCP Data Architect: Data Lake & BigQuery Lead

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 150,000 - 190,000
GCP Data Architect: IAM & Data Lake Modernization
GCP Data Architect: IAM & Data Lake Modernization

Valiant Technologies LLC • Dallas (TX)

On-site
USD 140,000 - 200,000
GCP Data Architect: Data Lake & BigQuery Lead
GCP Data Architect: Data Lake & BigQuery Lead

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 170,000
GCP Data Architect for Modern Data Lake & BigQuery
GCP Data Architect for Modern Data Lake & BigQuery

Ethereum Technologies • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Lake Architect & BigQuery Expert
GCP Data Lake Architect & BigQuery Expert

Robotics Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Architect
GCP Data Architect

CloudBigD • Dallas (TX)

On-site
USD 140,000 - 210,000
GCP Data Architect
GCP Data Architect

Ethereum Technologies • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Architect
GCP Data Architect

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 170,000
GCP Data Architect
GCP Data Architect

Valiant Technologies LLC • Dallas (TX)

On-site
USD 140,000 - 200,000
GCP Data Architect
GCP Data Architect

Robotics Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 190,000