GenAI Platform Engineer (GCP) | Vertex AI & Terraform

Arkhya Tech Inc.; Austin (TX); On-site; USD 150,000 - 210,000; Full time

Job summary

Arkhya Tech Inc. is seeking two GenAI Platform Engineers to build and operate a scalable platform on Google Cloud, enabling Gemini, Vertex AI, and Model Garden models for internal teams. You will manage endpoints, IAM, networking, and capacity using Terraform, and own the model lifecycle with production support.

Ideal candidates bring hands-on GCP AI experience, Terraform proficiency, and a strong focus on cost governance and security controls to ensure reliable, cost-efficient AI services.

Qualifications

• Experience with Google Cloud AI and LLM services (Vertex AI, Gemini, Model Garden)
• Proficient with Terraform and Infrastructure as Code, creating reusable modules
• Experience managing model endpoints, IAM, VPC networking, quotas, and GPU capacity on GCP
• Experience with production systems monitoring and incident response
• Understanding of cloud cost tracking, governance, and security controls

Responsibilities

• Enable and operate Gemini, Vertex AI, and Model Garden models for internal teams
• Enable open-weight and partner models through Vertex AI Model Garden, including quotas and GPU requests
• Build and maintain Terraform modules for model enablement, endpoints, IAM, and networking
• Manage the full model lifecycle: version upgrades, deprecations, and migrations with minimal disruption
• Provide production support for enabled models, including monitoring, incident triage, and escalation to Google support
• Track model usage and cost by consuming team
• Follow and enforce security, access, and governance controls

Skills

Vertex AI

Model Garden

Gemini

Terraform

IAM & Networking

GPU capacity on GCP

Monitoring & incident response

Cost governance

Tools

Terraform

Job description

Arkhya Tech Inc. is seeking two GenAI Platform Engineers to build and operate a scalable platform on Google Cloud, enabling Gemini, Vertex AI, and Model Garden models for internal teams. You will manage endpoints, IAM, networking, and capacity using Terraform, and own the model lifecycle with production support.

Ideal candidates bring hands-on GCP AI experience, Terraform proficiency, and a strong focus on cost governance and security controls to ensure reliable, cost-efficient AI services.