Platform Architect (AI/ML Infrastructure, GCP-focused)

Wizdaa

United States

Remote

MXN 2,042,000 - 3,062,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Wizdaa is seeking a Platform Architect to set the standard for ML and AI systems at scale, focusing on Google Cloud. You will own the path from model and pipeline to a reliable production service and bring DevOps rigor to systems that are historically under-engineered.

This role tackles model serving reliability, latency and cost, reproducible pipelines, and agentic workload operations. You will have scope to drive multi-tenant Kubernetes (GKE), GPU scheduling, and cost-aware capacity planning

Qualifications

  • 5+ years in platform engineering, SRE, MLOps, or infrastructure with production-scale systems.
  • Hands-on experience deploying ML/AI workloads in production: serving, inference, or training infra.
  • Strong SRE/DevOps foundations, measurable reliability improvements and SLOs.
  • Deep Terraform expertise, multi-project configurations in production.
  • GitOps in production with ArgoCD or Flux.
  • Kubernetes production experience, including GKE Standard or Autopilot.
  • Strong GCP background: VPC, IAM, Compute, Storage, multi-project design.
  • Hands-on experience with BigQuery in production: partitioning, cost and performance tuning.
  • CI/CD pipelines for ML: GitHub Actions, Cloud Build, GitLab CI.
  • Automation-first thinking to reduce manual work.
  • Agentic coding tools to boost productivity.
  • Strong communication for incident summaries and trade-offs.

Responsibilities

  • Build and operate ML inference serving infrastructure with latency, throughput, autoscaling, and reliability across tenants.
  • Own ML deployment lifecycle: registry, versioning, promotion workflows, canary/shadow rollouts, safe rollback.
  • Operate agentic and LLM workloads in production: gateways, quotas, guardrails, prompt/version management.
  • Create reproducible ML pipelines as code with lineage and reproducibility.
  • Extend IaC for ML with Terraform patterns and multi-project design.
  • Manage ML workloads with GitOps, ArgoCD configuration and promotion across environments.
  • Run ML workloads on multi-tenant Kubernetes (GKE) with GPU scheduling and tenant isolation.
  • Own ML reliability and observability: SLOs, drift detection, runbooks, on-call culture.
  • Drive cost efficiency through right-sizing accelerators and cost attribution across tenants.

Skills

Platform engineering
SRE
MLOps
Terraform
GitOps
Kubernetes
GKE
CI/CD
Automation
Communication

Tools

Terraform
ArgoCD
GKE
BigQuery
Dataflow
Pub/Sub
Dataproc
Vertex AI
Kubeflow
GitHub Actions

Job description

We're looking for a Platform Architect who can set the standard for how we build, ship, and operate ML and AI systems at scale. You sit at the intersection of ML infrastructure and SRE. You'll own the path from model and pipeline to reliable production service, and you'll bring DevOps rigor to systems that are historically under-engineered. The immediate focus is AI/ML infrastructure on Google Cloud.

This is not a ticket-processing role, and it's not a research role. You'll tackle hard problems: model serving reliability, inference cost and latency, reproducible pipelines, and agentic workload operations. You'll have the scope to solve them properly. Senior professionals here identify problems before they're asked and raise the ceiling on what the platform can do.

WHAT YOU'LL WORK ON
  • Build and operate model and inference serving infrastructure, managing latency, throughput, autoscaling, and reliability for real-time and batch inference across multiple tenants.

  • Own the ML deployment lifecycle: model registry, versioning, promotion workflows, rollout strategies (canary, shadow, A/B), and safe rollback.

  • Operate agentic and LLM workloads in production, managing inference providers and gateways, quota and throttling behavior (TPS/TUPS limits), guardrails, prompt/version management, and graceful degradation under load.

  • Build reproducible, automated ML pipelines: training, evaluation, and deployment pipelines as code, with lineage and reproducibility built in.

  • Extend infrastructure-as-code to ML systems, using Terraform patterns and multi-project design that bring ML infrastructure under the same standards as the rest of the platform.

  • Operate GitOps for ML workloads, owning ArgoCD configuration and promotion workflows across environments and tenants.

  • Run ML and AI workloads on multi-tenant Kubernetes (GKE), managing GPU/accelerator scheduling, workload placement, tenant isolation, and cost-aware capacity.

  • Own ML reliability and observability: SLOs for inference services, model and data drift detection, performance regression monitoring, alert quality, on-call ergonomics, and runbook culture.

  • Drive ML cost efficiency by right-sizing accelerators, managing committed-use and Spot VM capacity, and attributing inference cost across tenants and workloads.

  • Use agentic coding tools for infrastructure and pipeline work: scaffolding environments, generating and reviewing IaC and pipeline code, and accelerating automation.

WHAT YOU WON'T FIND HERE

A platform team that maintains the status quo. We're actively building: new scale requirements, new architectural domains, and an ML/AI footprint that's growing fast. Senior engineers here shape how the platform evolves, and the tools available to do it are better than they've ever been.


MUST HAVE
  • 5+ years in platform engineering, SRE, MLOps, or infrastructure, with meaningful time operating production systems at scale.

  • Hands-on experience deploying and operating ML or AI workloads in production: serving, inference, or training infrastructure that real users depended on.

  • Strong SRE/DevOps foundation. You've owned reliability for production services, defined and measured SLOs, run post-mortems, and driven measurable improvements.

  • Deep Terraform expertise. You actively manage complex Terraform state, reusable modules, and multi-project configurations in production, with CI-driven plan/apply workflows.

  • Strong GitOps background (ArgoCD or Flux in production). You understand declarative infrastructure management at depth and have opinions on how to do it well.

  • Deep Kubernetes knowledge. You've operated clusters in production, dealt with real failure modes, and understand the system at the control plane level. Production GKE experience (Standard and/or Autopilot) is strongly preferred.

  • Strong GCP background: VPC networking, Compute Engine, IAM, Cloud Storage, and multi-project/organization design.

  • Hands-on experience with GCP data services, especially BigQuery in production: partitioning and clustering, query cost and performance tuning, and dataset-level IAM. Familiarity with at least one of Dataflow, Pub/Sub, or Dataproc.

  • Hands-on experience building and operating CI/CD pipelines (GitHub Actions, Cloud Build, GitLab CI, or equivalent), plus an understanding of how ML pipelines differ from standard application CI/CD.

  • Automation-first thinking at a senior level. You implement systems that eliminate entire categories of manual work.

  • Active user of agentic coding tools. You know how to direct them effectively, review their output critically, and use them to multiply your output.

  • Strong communicator. You can articulate operational decisions, model performance trade-offs, and incident summaries clearly to engineers and leadership alike.

NICE TO HAVE
  • Experience with GPU/accelerator scheduling and node lifecycle management in production (e.g., GKE node auto-provisioning, GPU time-sharing, or equivalent).

  • Experience operating LLM inference at scale, managing provider quotas/throttling (TPS/TUPS), gateways, caching, and guardrails (e.g., Vertex AI, Gemini API, or equivalent).

  • Experience with ML pipeline and orchestration tooling such as Argo Workflows, Kubeflow, Cloud Composer/Airflow, Vertex AI Pipelines, or equivalent.

  • Experience with model registries, feature stores, and experiment tracking (e.g., MLflow, Feast, or equivalent).

  • Familiarity with model and data drift monitoring and ML-specific observability.

  • Background in FinOps: inference cost attribution, committed use discount (CUD) and reservation planning, and accelerator capacity forecasting.

  • Familiarity with data infrastructure such as object storage, CDC pipelines, or lakehouse patterns.

  • Experience with multi-tenant infrastructure: isolation patterns, noisy neighbor mitigation, and tenant lifecycle management.

  • Prior experience scaling ML or platform infrastructure at a startup moving toward enterprise-grade requirements.

Location: Remote in LATAM

Payment in USD

Working hours: EST time zone

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Sr. Platform Engineer, ML Infrastructure
Sr. Platform Engineer, ML Infrastructure

Insilico Search Partners • Cambridge (MA)

On-site
USD 140,000 - 210,000
Platform Engineer - AI/ML Infrastructure (Kubernetes & Terraform)
Platform Engineer - AI/ML Infrastructure (Kubernetes & Terraform)

Madrona Venture Labs • United States

Hybrid
USD 180,000 - 260,000
ML Ops Engineer — Agentic AI Lab (Founding Team)
ML Ops Engineer — Agentic AI Lab (Founding Team)

Fabrion • San Francisco (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Meaningful equity
ML Infrastructure Engineer
ML Infrastructure Engineer

Clera • San Mateo (CA)

On-site
USD 180,000 - 240,000
Staff MLOps Engineer – ML Platform
Staff MLOps Engineer – ML Platform

BrightAI Corporation • Palo Alto (CA)

On-site
USD 150,000 - 190,000
Software Engineer, AI Infrastructure
Software Engineer, AI Infrastructure

Harell Data • Palo Alto (CA)

On-site
USD 180,000 - 260,000
AI Principal Engineer
AI Principal Engineer

Accellor • Mountain View (CA)

On-site
USD 180,000 - 280,000
ML Platform Engineer
ML Platform Engineer

synthesia • United States

On-site
USD 100,000 - 140,000
Senior Developer
Senior Developer

ICE Clear Europe Limited • Atlanta (GA)

On-site
USD 150,000 - 210,000
Platform Engineer
Platform Engineer

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000