GCP Data Architect: Metadata-Driven ETL & BigQuery

Pyramid Technology Solutions; Dallas (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Pyramid Technology Solutions in Dallas seeks an experienced data architecture lead to define and guide the implementation of a metadata-driven ETL framework supporting databases, files, APIs, and cloud sources. You will architect reusable metadata models, oversee MVC-based orchestration, and drive CI/CD automation with GitHub Actions, JFrog, Harness, and Liquibase while optimizing BigQuery performance.

You will collaborate with stakeholders to finalize architecture decisions, document standards,

Qualifications

• Experience designing metadata-driven ETL frameworks.
• Proven ability to architect scalable data pipelines.
• Strong knowledge of data lake architectures and governance.

Responsibilities

• Define and guide implementation of a metadata-driven ETL framework.
• Architect reusable metadata models for config, pipelines, and audits.
• Provide MVC-based orchestration direction and standardized contracts.
• Design scalable data ingestion patterns (full/incremental/CDC/batch).
• Oversee GCP/BigQuery architecture and secure connectivity.
• Review CI/CD automation using GitHub Actions, JFrog, Harness, Liquibase, Helm.
• Guide Python, PySpark, SQL, and performance tuning for production systems.
• Support UAT with validation scenarios and sign-off criteria.
• Collaborate with stakeholders to finalize architecture docs and roadmaps.

Skills

Python

PySpark

SQL

BigQuery

PostgreSQL

Data modeling

Performance tuning

Production-ready framework design

Tools

GitHub Actions

JFrog

Harness

Liquibase

Helm

Kubernetes (OCP)

Job description

Pyramid Technology Solutions in Dallas seeks an experienced data architecture lead to define and guide the implementation of a metadata-driven ETL framework supporting databases, files, APIs, and cloud sources. You will architect reusable metadata models, oversee MVC-based orchestration, and drive CI/CD automation with GitHub Actions, JFrog, Harness, and Liquibase while optimizing BigQuery performance.

You will collaborate with stakeholders to finalize architecture decisions, document standards,