Gen AI & LLM Architect - Scalable MLOps on GCP

Cloud Analytics Technologies, LLC; Rosemead (CA); On-site; USD 180,000 - 230,000; Full time

Job summary

CLOUD ANALYTICS TECHNOLOGIES LLC in Rosemead, CA is seeking an experienced ML Engineer to design and deploy scalable Generative AI solutions in production. You will build APIs on GCP with Gemini models, implement RAG architectures, and manage vector databases to solve complex business problems.

You will develop automated MLOps pipelines using Vertex AI, Kubeflow, Cloud Build, and Terraform, while fine-tuning models, quantizing for efficiency, and ensuring security and compliance across projects.

Qualifications

• 5–8+ years of ML experience with 3+ years building Generative AI in production.
• Proven hands-on with GCP and Vertex AI, BigQuery and data pipelines.
• Strong Python skills and standard data science libraries.
• Hands-on with LangChain, LlamaIndex, or Hugging Face.
• Strong SQL and unstructured data management.
• Familiarity with Docker, Kubernetes (GKE), and CI/CD tooling.

Responsibilities

• Design, build, and maintain production-grade Generative AI apps and APIs on GCP with Gemini models, RAG, and vector DBs.
• Develop automated MLOps pipelines (training, eval, monitoring, deployment) using Vertex AI, Kubeflow, Cloud Build, and Terraform.
• Implement fine-tuning, quantization, and prompt engineering to improve accuracy and latency.
• Optimize GCP resources for high-performance computing, ensuring scalability, cost-efficiency, and security (IAM, VPC).
• Partner with Data Science, Data Engineering, and Product teams to translate business requirements into AI roadmaps.
• Ensure compliance with data privacy, security regulations (HIPAA, GDPR if applicable), and ethical AI standards.

Skills

Generative AI

GCP Vertex AI

Python

LangChain

LlamaIndex

Hugging Face

SQL

Docker

Kubernetes (GKE)

CI/CD tooling

Tools

Vertex AI

BigQuery

Dataflow

Cloud Run

Terraform

Kubeflow

GitHub Actions

Job description

CLOUD ANALYTICS TECHNOLOGIES LLC in Rosemead, CA is seeking an experienced ML Engineer to design and deploy scalable Generative AI solutions in production. You will build APIs on GCP with Gemini models, implement RAG architectures, and manage vector databases to solve complex business problems.

You will develop automated MLOps pipelines using Vertex AI, Kubeflow, Cloud Build, and Terraform, while fine-tuning models, quantizing for efficiency, and ensuring security and compliance across projects.