On-Prem AI Platform Architect

ClearpointCo; Houston (TX); On-site; USD 120,000 - 125,000; Full time

Job summary

ClearpointCo in Houston, TX seeks an AI Engineer to architect and deploy an on-prem AI platform from scratch, including LLM infrastructure, RAG, and agentic search. This foundational role builds the core AI stack with no cloud dependency.

The position requires five days on-site in the office and collaboration with Data Engineering to ensure clean data pipelines. You will work with the VP of Software Development, implement governance practices, and lead efforts for secure, scalable AI systems in

Qualifications

• 3+ years of experience building and deploying ML/LLM-based applications.
• Strong Python skills with ML/AI frameworks (PyTorch, Transformers, LangChain).
• Experience with vector databases and embedding-based retrieval systems.
• Containerized deployment (Docker) on Linux servers.
• Ability to operate independently in greenfield environments with limited infrastructure.
• Excellent communication and confidentiality.

Responsibilities

• Architects and implements on-premises AI platform from the ground up using on-prem GPU hardware.
• Designs and builds LLM-based applications, including RAG pipelines, agentic search, and vector retrieval systems.
• Establishes foundational standards, patterns, and best practices for AI development with no prior infrastructure.
• Sets architectural precedent for secure, governed AI deployments with PII protections.
• Deploys, tunes, and monitors models on on-prem GPUs for throughput, latency, and shared workloads.
• Collaborates with Data Engineering to define data contracts and integration points with SQL data warehouse.
• Evaluates and prototypes emerging AI tooling for strict on-premise environments.
• Develops internal tools and APIs to expose AI capabilities across departments.
• Ensures compliance and governance across future projects.

Skills

Python

PyTorch

HuggingFace Transformers

LangChain

LlamaIndex

Haystack

Docker

Linux

GPU planning

Data governance

PII handling

On-prem LLMs

Vector DB

Retrieval

DevOps

Education

BS in Computer Science

Tools

Debian/Ubuntu Linux

Job description

ClearpointCo in Houston, TX seeks an AI Engineer to architect and deploy an on-prem AI platform from scratch, including LLM infrastructure, RAG, and agentic search. This foundational role builds the core AI stack with no cloud dependency.

The position requires five days on-site in the office and collaboration with Data Engineering to ensure clean data pipelines. You will work with the VP of Software Development, implement governance practices, and lead efforts for secure, scalable AI systems in