Remote AI DevOps Engineer — Compliance & Bare-Metal AI

TEORE, LLC; Lakeland (FL); On-site; USD 140,000 - 200,000; Full time

Job summary

Metrc in the United States is seeking an experienced AI DevOps Engineer focused on compliance to lead our internal AI ecosystem on private hardware. You will design, deploy, and secure enterprise-grade AI solutions with zero reliance on external clouds, building local pipelines and enforcing data isolation.

You will work with engineering leadership to translate regulatory requirements into production-ready models and tooling, optimize performance on bare-metal clusters, and ensure robust,

Qualifications

• Experience designing and deploying enterprise AI solutions in private, air-gapped environments.
• Strong background in LLMs, embeddings, and RAG workflows.
• Ability to translate regulatory requirements into production-ready AI systems.

Responsibilities

• Architect and deploy local AI infrastructure using open-source LLMs on private hardware.
• Build robust, low-latency inference pipelines with secure data handling.
• Implement Retrieval-Augmented Generation and embedding workflows.
• Ensure complete data isolation and compliance with privacy regulations.
• Collaborate with engineering leadership to translate requirements into tooling.

Skills

Local AI Infra

LLM Deployment

RAG Systems

Data Isolation

Bare Metal

Open-Source Tools

Security Compliance

Tools

Vector Databases

Model Serving

Open-source Frameworks

Orchestration Tools

Job description

Metrc in the United States is seeking an experienced AI DevOps Engineer focused on compliance to lead our internal AI ecosystem on private hardware. You will design, deploy, and secure enterprise-grade AI solutions with zero reliance on external clouds, building local pipelines and enforcing data isolation.

You will work with engineering leadership to translate regulatory requirements into production-ready models and tooling, optimize performance on bare-metal clusters, and ensure robust,