AI Integration Lead - Local/On-Prem Models

Peraton Labs; Red Bank (NJ); On-site; USD 112,000 - 179,000; Full time

Job summary

Peraton Labs is seeking a Senior AI Integration Developer to lead the design and implementation of an AI assistant within an existing web application used for RF spectrum monitoring in support of the DoD.

The role focuses on the context-aware AI assistant and MCP server, prioritizing locally-hosted models (e.g., Ollama) in air-gapped or connectivity-constrained settings, with cloud LLMs as secondary options.

Qualifications

• Minimum 8 years of experience with a Bachelor's degree; 6 years with a Master's; or 3+ years with a PhD in related fields.
• Experience deploying locally-hosted models (e.g., Ollama) in offline or restricted environments.
• Strong understanding of MCP - server design, tool schemas, and client-server communication.
• Experience with prompt engineering and system prompt design for local models.
• Experience with agentic AI patterns - multi-step reasoning, tool chaining, and error recovery.
• Familiarity with model selection tradeoffs and hardware requirements.
• Ability to design structured evaluation approaches for AI outputs and tool performance.
• Clear communicator across technical and non-technical audiences.
• Must be a U.S. Citizen with ability to obtain/maintain a Secret clearance.
• Candidate should be local to Red Bank, NJ; Basking Ridge, NJ; or Silver Spring, MD.

Responsibilities

• Design and implement MCP server and tool interfaces exposing application data to the AI assistant.
• Deploy and configure locally-hosted models for air-gapped environments; support cloud-based options as needed.
• Evaluate and select models for specific tasks, balancing capability and resource use.
• Integrate LLM inference endpoints into backend and frontend with local and cloud models.
• Develop and refine system prompts, tool definitions, and context management strategies.
• Define and execute evaluation frameworks to assess AI output quality and tool reliability.
• Identify high-value AI use cases with domain stakeholders and translate to tool designs.
• Maintain backend Python and TypeScript/Node.js services supporting AI functionality.
• Document AI architecture, tool schemas, and model configurations.
• Stay current with evolving MCP ecosystem and tooling.

Skills

Python

FastAPI

React

TypeScript/Node.js

Docker

Model Context Protocol (MCP)

Prompt engineering

Git / CI/CD

AI integration

U.S. Citizenship + Secret clearance

Education

Bachelor's degree

Tools

Ollama

llama.cpp

PostgreSQL

Job description

Peraton Labs is seeking a Senior AI Integration Developer to lead the design and implementation of an AI assistant within an existing web application used for RF spectrum monitoring in support of the DoD.

The role focuses on the context-aware AI assistant and MCP server, prioritizing locally-hosted models (e.g., Ollama) in air-gapped or connectivity-constrained settings, with cloud LLMs as secondary options.