GCP Data Architect: IAM & Data Lake Modernization

Valiant Technologies LLC

Dallas (TX)

On-site

USD 140,000 - 200,000

Full time

16 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Valiant Technologies LLC seeks an experienced Data Architect to lead the IAM Data Modernization program. You will own the end-to-end data architecture for migrating on-premises data warehouses to a GCP-based Data Lake, establishing a single source of truth for enterprise analytics.

You will define metadata-driven ETL patterns, design scalable ingestion and data lake zones, and provide technical leadership across GCP services, BigQuery, and CI/CD pipelines.

Qualifications

  • Hands-on PySpark ETL/ELT with performance optimization.
  • Solid understanding of distributed data processing concepts.
  • Strong experience designing data platforms on Google Cloud Platform (GCP).
  • Experience with data lakes, data warehousing, and large-scale migrations.
  • Proven experience designing data lake architectures (Bronze/Silver/Gold).
  • Strong knowledge of Cloud Storage (GCS) design and access controls.
  • Expertise in partitioning, backfills, and large-scale data organization.
  • Experience building batch and streaming ingestion pipelines on GCP.
  • Knowledge of Pub/Sub-based streaming architectures and event versioning.
  • Experience using Dataflow (Beam) and Spark (Dataproc).
  • Strong BigQuery SQL proficiency and performance tuning.

Responsibilities

  • Own end-to-end data architecture for IAM Data Modernization across OCP, S3, PostgreSQL, and GCP/BigQuery.
  • Define and guide a metadata-driven ETL framework supporting databases, files, APIs, MongoDB, Splunk, and more.
  • Architect reusable MD_ and OPS_ metadata models for configuration, run tracking, and audits.
  • Provide architecture direction for MVC-based orchestration and standardized contracts.
  • Design scalable ingestion patterns: full/incremental load, watermark, CDC, batch, API, and file ingestion.
  • Guide S3 data lake zones (Landing, Raw, Archive, Error) with promotion, archival, replay, and error handling.
  • Define data quality, schema validation, drift detection, and checkpoint restartability standards.
  • Provide technical leadership for GCP/BigQuery, including mapping, partitioning, and optimization.
  • Review CI/CD automation for data and analytics workloads using GitHub Actions, Harness, Liquibase, Helm.

Skills

PySpark
Distributed data processing concepts
GCP data platforms
Data lakes / data warehousing
BigQuery SQL
CI/CD pipelines
Git

Tools

Dataflow (Apache Beam)
Spark (Dataproc)
BigQuery
GCS
Pub/Sub

Job description

Valiant Technologies LLC seeks an experienced Data Architect to lead the IAM Data Modernization program. You will own the end-to-end data architecture for migrating on-premises data warehouses to a GCP-based Data Lake, establishing a single source of truth for enterprise analytics.

You will define metadata-driven ETL patterns, design scalable ingestion and data lake zones, and provide technical leadership across GCP services, BigQuery, and CI/CD pipelines.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Architect: Modern Data Lake & BigQuery Lead
GCP Data Architect: Modern Data Lake & BigQuery Lead

CloudBigD • Dallas (TX)

On-site
USD 140,000 - 210,000
GCP Data Architect: Data Lake & BigQuery Lead
GCP Data Architect: Data Lake & BigQuery Lead

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 150,000 - 190,000
GCP Data Architect for Modern Data Lake & BigQuery
GCP Data Architect for Modern Data Lake & BigQuery

Ethereum Technologies • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Architect: Data Lake & BigQuery Lead
GCP Data Architect: Data Lake & BigQuery Lead

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 170,000
GCP Data Lake Architect & BigQuery Expert
GCP Data Lake Architect & BigQuery Expert

Robotics Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Architect
GCP Data Architect

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 150,000 - 190,000
GCP Data Architect
GCP Data Architect

CloudBigD • Dallas (TX)

On-site
USD 140,000 - 210,000
GCP Data Architect
GCP Data Architect

Ethereum Technologies • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Architect
GCP Data Architect

Robotics Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 190,000
GCP Data Architect
GCP Data Architect

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 170,000