On-Site AI Implementation Engineer: Edge/RAG Pipelines

Innovative Defense Technologies (IDT); Arlington (VA); On-site; USD 114,000 - 231,000; Full time

Benefits offered by this job

Generous benefits package

Competitive PTO

Paid holidays

401(k) with immediate vesting and 401k

9/80 optional schedule

Tuition Assistance Reimbursement

Professional Development Resources

Pre-Tax Commuter Benefits

Tech Connect Events

Annual Employee Recognition

Social Events and Catered Lunches

Job summary

Innovative Defense Technologies (IDT) seeks an AI Implementation Engineer to design and deliver end-to-end AI solutions for on-prem, air-gapped environments in Arlington, VA or Mt. Laurel, NJ. Role focuses on MCP integrations, RAG pipelines, tool-using agents, and production-grade workflows.

Ideal candidates have 5–10+ years in software/AI engineering, Python expertise, and hands-on experience with local inference engines and AI tooling. Active Secret clearance and in-office presence required.

Qualifications

• Bachelor's degree or equivalent professional experience in a technical field.
• 5-10+ years in software/AI engineering or related roles.
• Proficiency in Python with NumPy and Pandas.
• Hands-on experience with production local inference engines.
• Experience with Linux, security hardening, and containerization.
• Experience with hosting LLM servers and AI tooling.
• Ability to work independently and in a team.

Responsibilities

• Design and build AI solutions for on-prem systems in air-gapped environments.
• Integrate models and tools across LLMs and MCP interfaces.
• Develop Retrieval-Augmented Generation pipelines.
• Engineer conversational and agentic interfaces with memory and context awareness.
• Implement and evaluate AI workflows to improve reliability.
• Architect local infrastructure for CPU/GPU workloads and quantization.
• Orchestrate offline model update pipelines and local mirrors.
• Gather and define technical requirements from stakeholders.
• Collaborate with engineers and mission stakeholders.
• Support testing, debugging, and performance optimization.
• Stay current on advances in LLMs and AI engineering practices.
• Document architectures and decisions for maintainability.

Skills

Python

NumPy

Pandas

LLM Inference

Air-gapped AI

Linux Hardening

Containerization

Agent Frameworks

RAG

Vector Stores

Team Leadership

Education

Bachelor's Degree in IT/CS/Engineering or equivalent

Master's Degree in Engineering or technical field (desired)

Tools

vLLM

SGLang

Triton Inference Server

TensorRT-LLM

LangChain

LangGraph

Semantic Kernel

AutoGen

Job description

Innovative Defense Technologies (IDT) seeks an AI Implementation Engineer to design and deliver end-to-end AI solutions for on-prem, air-gapped environments in Arlington, VA or Mt. Laurel, NJ. Role focuses on MCP integrations, RAG pipelines, tool-using agents, and production-grade workflows.

Ideal candidates have 5–10+ years in software/AI engineering, Python expertise, and hands-on experience with local inference engines and AI tooling. Active Secret clearance and in-office presence required.