Senior AI Software Engineer - On-Prem Chatbot & RAG Expert

General Dynamics Information Technology (GDIT); Sterling (VA); On-site; USD 141,000 - 191,000; Full time

Job summary

GDIT seeks a Senior AI Software Engineer to design, develop, and sustain an on‑prem AI chatbot platform for the U.S. State Department in Sterling, VA. You will work across the AI stack, integrating LLMs, RAG and document processing, with a focus on secure, air‑gapped environments.

The role requires Python, API integration, containerization, and a strong background in software engineering. Collaboration with government stakeholders and cybersecurity teams is essential.

Qualifications

• Minimum Secret Clearance, no sponsorship.
• Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Computer Engineering, or a related technical field, or equivalent practical experience.
• 5+ years of professional software engineering experience, including backend development.
• Strong proficiency in Python and experience developing production‑quality software.
• Experience developing RESTful APIs and integrating distributed application services.
• Hands‑on experience integrating LLMs or generative AI capabilities into software applications.
• Understanding of transformer‑based models, inference APIs, prompt engineering, and LLM application development.
• Experience with RAG concepts, including document ingestion, embeddings, vector search, and retrieval pipelines.

Responsibilities

• Design, develop, test, and maintain Python-based applications, microservices, and APIs supporting an on‑prem chatbot.
• Extend, configure, and integrate OpenWebUI with enterprise AI services and backend systems.
• Develop reusable software components for AI model access, prompt management, response processing, and application workflows.
• Collaborate with AI/ML engineers to improve model inference performance, response quality, and application reliability.
• Support multimodal AI use cases, including document understanding and vision‑language model integration.
• Design software solutions for secure, on‑premises, air‑gapped government environments.
• Develop automated tests, CI/CD processes for disconnected environments, and deploy/runbook documentation.

Skills

Agile Software Development

Back-End Development

Microservices Architecture

Education

Bachelor's degree or equivalent in Computer Science/Software Engineering/AI/related field

Job description

GDIT seeks a Senior AI Software Engineer to design, develop, and sustain an on‑prem AI chatbot platform for the U.S. State Department in Sterling, VA. You will work across the AI stack, integrating LLMs, RAG and document processing, with a focus on secure, air‑gapped environments.

The role requires Python, API integration, containerization, and a strong background in software engineering. Collaboration with government stakeholders and cybersecurity teams is essential.