AI/ML Tech lead with Gen AI

Machine Learning Technologies, LLC; Rosemead (CA); On-site; USD 150,000 - 220,000; Full time

Job summary

Machine Learning Technologies, LLC is seeking a Senior ML Engineer to design and deploy scalable Generative AI applications on GCP, with emphasis on Gemini models, RAG, and vector databases. You will own end-to-end experiments and production pipelines, collaborating across data science, data engineering, and product teams.

You will lead fine-tuning, quantization, prompt engineering, and performance optimization to meet latency and security requirements, while upholding privacy and ethical AI

Qualifications

• 5-8+ years of ML industry experience with 3+ years deploying generative AI models in production.
• Strong hands-on experience with GCP and Vertex AI.
• Proficiency in Python and data science libraries (scikit-learn, TensorFlow, PyTorch).
• Experience with LangChain, LlamaIndex, or Hugging Face frameworks.
• Strong SQL and unstructured data management expertise.
• Familiarity with Docker, Kubernetes (GKE), and CI/CD tooling.

Responsibilities

• Design, build, and maintain production-grade Generative AI apps and APIs on GCP focusing on Gemini models, RAG, and vector databases.
• Develop automated MLOps pipelines (training, evaluation, monitoring, deployment) using Vertex AI, Kubeflow, Cloud Build, and Terraform.
• Implement fine-tuning, quantization, and prompt engineering to improve accuracy and reduce latency.
• Optimize GCP resources for HPC, ensuring scalability, cost-efficiency, and security (IAM, VPC).
• Partner with Data Science, Data Engineering, and Product teams to translate business requirements into AI roadmaps.
• Ensure compliance with data privacy, security regulations (HIPAA, GDPR) and ethical AI standards.

Skills

GCP

Vertex AI

Python

TensorFlow

PyTorch

scikit-learn

SQL

LangChain

LlamaIndex

Hugging Face

Kubernetes

Docker

CI/CD

Vector Databases

Tools

Docker

Kubernetes (GKE)

CI/CD tooling

Terraform

Vertex AI

BigQuery

Dataflow

Cloud Run

Job description

Healthcare,Banking & Finance,Insurance,Telecom,Education,IT/Software

Work Authorization:

Designing and deploying scalable, secure, and reliable LLM-based solution, implement Retrieval-Augmented Generation (RAG), model fine-tuning, and agentic workflows to solve complex business problems.

Key Responsibilities

• Design, build, and maintain production-grade Generative AI applications and APIs on GCP, focusing on Gemini models, RAG architectures, and vector databases.
• Develop automated MLOps pipelines (training, evaluation, monitoring, deployment) using Vertex AI, Kubeflow, Cloud Build, and Terraform.
• Implement techniques to enhance AI model performance, including fine-tuning, quantization (e.g., GPTQ, AWQ), and prompt engineering to improve accuracy and reduce latency.
• Optimize GCP resources for high-performance computing, ensuring scalability, cost-efficiency, and security (IAM, VPC).
• Partner with Data Science, Data Engineering, and Product teams to translate business requirements into technical AI/ML roadmaps.
• Ensure compliance with data privacy, security regulations (HIPAA, GDPR, if applicable), and ethical AI standards.

Required Qualifications

• 5-8+ years of industry experience in Machine Learning, with at least 3+ years of hands-on experience in building and deploying Generative AI models and LLMs in a production environment.
• Proven experience with Google Cloud Platform (GCP)and its AI suite (Vertex AI, BigQuery, Dataflow, Cloud Run).
• Strong expertise in Pythonand standard data science libraries (scikit-learn, TensorFlow, PyTorch).
• Hands-on experience with framework tooling such as LangChain, LlamaIndex, or Hugging Face.
• Strong understanding of SQL and unstructured data management.
• Familiarity with Docker, Kubernetes (GKE), and CI/CD tools.

Preferred Qualifications

• Experience with multi-agent systems and orchestration (e.g., LangGraph, AutoGen).
• Deep knowledge of Vector Databases (e.g., Vertex AI Vector Search, Pinecone, Chroma).
• Demonstrated experience leading team projects and mentoring junior engineers.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.