AI/ML Tech lead with Gen AI

Ethereum Technologies LLC; Rosemead (CA); On-site; USD 140,000 - 200,000; Full time

Job summary

Ethereum Technologies LLC is seeking a senior ML engineer to design and deploy scalable Generative AI solutions in production on Google Cloud Platform, emphasizing RAG architectures and vector databases.

You will lead MLOps pipelines (training, evaluation, monitoring, deployment) with Vertex AI, Kubeflow, Cloud Build, and Terraform, and collaborate with data science and product teams to align AI roadmaps with business needs.

Qualifications

• 5–8+ years in ML engineering and deployment.
• 3+ years deploying Generative AI in production.
• Experience with GCP AI suite and Vertex AI.
• Strong Python and ML libraries (scikit-learn, TensorFlow, PyTorch).

Responsibilities

• Design, build, and maintain production AI apps and APIs on GCP, focusing on Gemini models, RAG, and vector stores.
• Develop automated MLOps pipelines (training, evaluation, monitoring, deployment) using Vertex AI, Kubeflow, Cloud Build, Terraform.
• Implement fine-tuning, quantization (GPTQ, AWQ), and prompt engineering to boost accuracy and reduce latency.
• Optimize GCP resources for HPC, ensuring scalability, cost-efficiency, and security (IAM, VPC).
• Collaborate with Data Science, Data Engineering, and Product teams to translate business needs into AI roadmaps.
• Ensure compliance with data privacy, security regulations (HIPAA, GDPR) and ethical AI standards.

Skills

Generative AI

GCP Vertex AI

Python

LangChain

LlamaIndex

Hugging Face

SQL

Tools

Docker

Kubernetes (GKE)

CI/CD

BigQuery

TensorFlow

PyTorch

Job description

Designing and deploying scalable, secure, and reliable LLM-based solution, implement Retrieval-Augmented Generation (RAG), model fine-tuning, and agentic workflows to solve complex business problems.

Key Responsibilities

• Design, build, and maintain production-grade Generative AI applications and APIs on GCP, focusing on Gemini models, RAG architectures, and vector databases.
• Develop automated MLOps pipelines (training, evaluation, monitoring, deployment) using Vertex AI, Kubeflow, Cloud Build, and Terraform.
• Implement techniques to enhance AI model performance, including fine-tuning, quantization (e.g., GPTQ, AWQ), and prompt engineering to improve accuracy and reduce latency.
• Optimize GCP resources for high-performance computing, ensuring scalability, cost-efficiency, and security (IAM, VPC).
• Partner with Data Science, Data Engineering, and Product teams to translate business requirements into technical AI/ML roadmaps.
• Ensure compliance with data privacy, security regulations (HIPAA, GDPR, if applicable), and ethical AI standards.

Required Qualifications

• 5-8+ years of industry experience in Machine Learning, with at least 3+ years of hands-on experience in building and deploying Generative AI models and LLMs in a production environment.
• Proven experience with Google Cloud Platform (GCP) and its AI suite (Vertex AI, BigQuery, Dataflow, Cloud Run).
• Strong expertise in Python and standard data science libraries (scikit-learn, TensorFlow, PyTorch).
• Hands-on experience with framework tooling such as LangChain, LlamaIndex, or Hugging Face.
• Strong understanding of SQL and unstructured data management.
• Familiarity with Docker, Kubernetes (GKE), and CI/CD tools.

Preferred Qualifications

• Experience with multi-agent systems and orchestration (e.g., LangGraph, AutoGen).
• Deep knowledge of Vector Databases (e.g., Vertex AI Vector Search, Pinecone, Chroma).
• Demonstrated experience leading team projects and mentoring junior engineers.

ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract