GCP Data Lake Architect & BigQuery Expert

Robotics Technologies LLC

Dallas (TX)

On-site

USD 120,000 - 190,000

Full time

11 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotics Technologies LLC is seeking an experienced IAM Data Architect to lead the modernization of our data platform and migrate from on-prem warehouses to a Google Cloud data lake, establishing a single source of truth for enterprise analytics.

You will own end-to-end data architecture, define scalable ingestion patterns, and guide CI/CD automation and data governance across GCP, BigQuery, and related tools.

Qualifications

  • Hands-on PySpark for ETL/ELT and performance optimization.
  • Solid understanding of distributed data processing concepts.
  • Strong experience designing data platforms on GCP.
  • Experience with Data Lakes, data warehousing, and large migrations.
  • Proven ability to design data lake architectures (Bronze/Silver/Gold).
  • Knowledge of GCS design, lifecycle policies, and access controls.
  • Expertise in partitioning, backfills, and large-scale data organization.
  • Experience building batch and streaming ingestion pipelines using GCP-native services.
  • Familiarity with Pub/Sub-based streaming architectures and event design.
  • Experience with Dataflow or Spark (Dataproc) and BigQuery SQL optimization.
  • Experience implementing CI/CD pipelines for data workloads.
  • Familiarity with Git-based source control and deployment strategies.

Responsibilities

  • Own end-to-end data architecture for IAM Data Modernization across OCP, S3, PostgreSQL metadata, and GCP/BigQuery.
  • Define and guide a metadata-driven ETL framework supporting multiple sources (DBs, files, APIs, MongoDB, Splunk, VDS, AD).
  • Architect reusable metadata models for source configuration, pipelines, run tracking, auditing, and schema drift.
  • Provide architecture direction for MVC-based orchestration with standardized contracts.
  • Design scalable ingestion patterns: full, incremental, watermark, CDC, batch, API, file-based.
  • Guide S3 lake zones: Landing, Raw, Archive, Error with promotion, archival, replay, error handling.
  • Define data quality, schema validation, drift detection, and auditability standards.
  • Lead GCP/BigQuery architecture: S3-to-BigQuery integration, partitioning, clustering, security.
  • Review CI/CD automation using GitHub Actions, JFrog, Harness, Liquibase, Helm, and OCP deployments.
  • Provide guidance on Python, PySpark, SQL, BigQuery, PostgreSQL, data modeling, and performance tuning.

Skills

PySpark
Distributed processing
GCP BigQuery
Data lake design
Data warehousing
Partitioning
Ingestion pipelines
Pub/Sub
Data modeling
CI/CD
Python
Git

Tools

BigQuery
Dataflow
Dataproc
GCS
Pub/Sub
Git

Job description

Robotics Technologies LLC is seeking an experienced IAM Data Architect to lead the modernization of our data platform and migrate from on-prem warehouses to a Google Cloud data lake, establishing a single source of truth for enterprise analytics.

You will own end-to-end data architecture, define scalable ingestion patterns, and guide CI/CD automation and data governance across GCP, BigQuery, and related tools.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP Data Architect: Data Lake & BigQuery Lead
GCP Data Architect: Data Lake & BigQuery Lead

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 170,000
GCP Data Architect: Modern Data Lake & BigQuery Lead
GCP Data Architect: Modern Data Lake & BigQuery Lead

CloudBigD • Dallas (TX)

On-site
USD 140,000 - 210,000
GCP Data Architect: Data Lake & BigQuery Lead
GCP Data Architect: Data Lake & BigQuery Lead

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 150,000 - 190,000
GCP Data Architect: IAM & Data Lake Modernization
GCP Data Architect: IAM & Data Lake Modernization

Valiant Technologies LLC • Dallas (TX)

On-site
USD 140,000 - 200,000
GCP Data Architect for Modern Data Lake & BigQuery
GCP Data Architect for Modern Data Lake & BigQuery

Ethereum Technologies • Dallas (TX)

On-site
USD 120,000 - 190,000
Fully Remote Data Architect: GCP Lakehouse
Fully Remote Data Architect: GCP Lakehouse

Egen • United States

Remote
USD 150,000 - 230,000
Paid vacation
Holidays
Sick leave
+3
Senior Data Architect, GCP Lakehouse & Data Governance
Senior Data Architect, GCP Lakehouse & Data Governance

Egen • United States

Remote
USD 160,000 - 200,000
Comprehensive Health Insurance
401(k) Employer Match
Paid Vacation/Time Off
+3
GCP Data Engineering Architect: Cloud Data Solutions Lead
GCP Data Engineering Architect: Cloud Data Solutions Lead

Robotic Process Automation LLC • Bentonville (AR)

On-site
USD 94,000 - 134,000
Strategic Data Lakehouse Architect, GCP
Strategic Data Lakehouse Architect, GCP

Egen • United States

Remote
USD 195,000 - 270,000
Comprehensive Health Insurance
Paid Vacation/PTO
Paid Holidays
+5
Lead Data Platform Architect, GCP Lakehouse Expert
Lead Data Platform Architect, GCP Lakehouse Expert

Egen • Nashville (TN)

On-site
USD 150,000 - 210,000
Comprehensive Health Insurance
401(k) Employer Match
Paid Vacation/PTO
+3