AI Engineer: RAG/LLM Systems on Vertex AI

MHK TECH INC

United States

On-site

USD 150,000 - 210,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

MHK TECH INC is seeking a data science/ML software engineer to design and build LLM-powered applications with end-to-end integration across data processing, AI tooling, and cloud deployment. You will work with LangChain, vector databases, and cloud platforms to deploy scalable AI features.

The role emphasizes strong Python skills, experience with RAG patterns, and thoughtful evaluation of model outputs, with a leaning toward Vertex AI on Google Cloud.

Qualifications

  • MSc in Data Science, Computer Science, Bioinformatics, or related field (or equivalent practical experience).
  • Strong Python skills.
  • Hands-on experience building RAG systems or LLM-powered applications with LangChain, LlamaIndex, or similar frameworks.
  • Experience integrating LLM APIs via Google Vertex AI or similar.
  • Working knowledge of vector databases (ChromaDB, Weaviate, Qdrant, Pinecone, etc.).
  • Cloud platform experience (GCP preferred, Vertex AI).
  • Docker and containerized deployments.
  • Strong software engineering fundamentals — SOLID, clean code, design patterns, testing, version control (Git).
  • Comfortable with AI-assisted development tools (e.g., Gemini CLI, GitHub Copilot).
  • Strongly Preferred: experience with agentic AI patterns, document processing, LLM evaluation principles, data science fundamentals, prompt engineering, Streamlit app development.
  • Nice to Have: clinical trials domain familiarity, infrastructure as code, knowledge graphs basics, ML/DL frameworks like PyTorch or TensorFlow, Google ADK, MCP, etc.
  • Other: frontend (React, TS), FastAPI/Flask REST API development, PostgreSQL-like relational databases.

Skills

Python
RAG systems
LLM‑powered apps
LLM APIs
Vector databases
Vertex AI
Docker
Software engineering
AI tools
Agentic AI
Document processing
LLM evaluation
Pandas
NumPy
Scikit‑learn
Data visualization
Prompt engineering
Streamlit

Education

MSc in Data Science

Tools

LangChain
LlamaIndex
Vertex AI
GitHub Copilot
Google ADK
Terraform
Weaviate
Qdrant
Pinecone
Neo4j

Job description

MHK TECH INC is seeking a data science/ML software engineer to design and build LLM-powered applications with end-to-end integration across data processing, AI tooling, and cloud deployment. You will work with LangChain, vector databases, and cloud platforms to deploy scalable AI features.

The role emphasizes strong Python skills, experience with RAG patterns, and thoughtful evaluation of model outputs, with a leaning toward Vertex AI on Google Cloud.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

RAG/LLM AI Engineer — Onsite Sacramento, CA
RAG/LLM AI Engineer — Onsite Sacramento, CA

Ledgent Technology • Davis (CA)

On-site
USD 130,000 - 160,000
Competitive compensation
Benefits package
Production AI/ML Engineer: LLMs, RAG & Secure Cloud
Production AI/ML Engineer: LLMs, RAG & Secure Cloud

24-Mag Llc • Washington, Northern (KY)

Hybrid
USD 96,000 - 276,000
Hybrid work arrangement
Competitive hourly rate
AI/ML Engineer - RAG, LLMs & API Integration
AI/ML Engineer - RAG, LLMs & API Integration

grvty • Sterling (VA)

On-site
USD 175,000 - 225,000
Competitive benefits
Work-life balance
Paid time off
+2
Senior AI/ML Engineer: LLMs, RAG & Secure Cloud
Senior AI/ML Engineer: LLMs, RAG & Secure Cloud

24-MAG • Washington

Hybrid
USD 96,000 - 276,000
AI Software Engineer: LLMs, GraphRAG & Cloud
AI Software Engineer: LLMs, GraphRAG & Cloud

Insight Global • Tampa (FL)

On-site
USD 110,000 - 170,000
AI/ML Engineer: Build RAG-Driven LLM Prototypes
AI/ML Engineer: Build RAG-Driven LLM Prototypes

Insight Global • McLean (VA)

On-site
USD 120,000 - 160,000
None
AI Engineer (Agentic AI)
AI Engineer (Agentic AI)

ProwessIT Solutions LLC. • Shrewsbury (MA)

Remote
USD 108,000 - 132,000
Senior AI Engineer (Hybrid) - LLM & RAG Architect
Senior AI Engineer (Hybrid) - LLM & RAG Architect

ICONMA • Los Angeles (CA)

Hybrid
USD 140,000 - 190,000
Health benefits
Referral program
Growth opportunities
AI/ML Engineer: LLMs, RAG, & Multi-Agent Systems
AI/ML Engineer: LLMs, RAG, & Multi-Agent Systems

Crossing Hurdles • United States

On-site
USD 100,000 - 150,000
AI Systems Architect & LLM Engineer
AI Systems Architect & LLM Engineer

Sphere Software • United States

Remote
USD 120,000 - 170,000