AI Engineer: On-Prem LLMs & RAG Pipelines

Salvo Software LLC; Northern (KY); Hybrid; USD 120,000 - 190,000; Full time

Job summary

Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on.

You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped

Qualifications

• Strong Python experience for backend and ML workflows.
• Experience with large language models (LLMs) training, fine-tuning, and optimization.
• Familiarity with on-prem/offline deployments and air-gapped environments.

Responsibilities

• Design, train, and optimize LLM models for on-prem/offline deployment.
• Build end-to-end LLM pipelines including data preprocessing and tokenization.
• Develop RAG pipelines and vector stores for document grounding and retrieval.
• Implement MCP servers to connect LLMs with external tools and data sources.
• Maintain offline CI/CD pipelines and local model registries.

Skills

Python

Machine learning

PyTorch

TensorFlow

PostgreSQL

MySQL

Docker

Git

LLM training

Tools

Docker

Git

Azure DevOps

vLLM

Ollama

FAISS

Chroma

Weaviate

Ollama

Job description

Salvo Software LLC is seeking an experienced AI Developer with strong backend and ML engineering expertise to design, train, optimize, and deploy LLM models in on-prem and air-gapped environments. This role is deeply technical and hands-on.

You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped