Principal AI Solutions Architect: Multi-Agent Systems

General Dynamics Information Technology, Inc.; Town of Colonie (NY); Hybrid; USD 145,000 - 196,000; Full time

Job summary

General Dynamics Information Technology, Inc. is seeking a Solutions Architect Principal to design and govern agentic AI systems for critical Medicaid/MMIS workflows in NY. Lead multi-agent architectures, ensure security, and mentor engineers in a high-stakes, compliant environment.

The role requires 8+ years in software or systems architecture, plus hands-on experience with production LLMs and agentic tooling. Hybrid work in Albany area with strong enterprise collaboration.

Qualifications

• Bachelor’s in CS, software engineering, math, or equivalent.
• 8+ years of software engineering or systems architecture experience.
• At least 1 year building/operating production LLM systems with agentic components.
• Experience with HIPAA/HITECH and FedRAMP is a plus.

Responsibilities

• Architect, build, and operate multi-agent systems inside a governed, auditable delivery pipeline.
• Design the tool/context layer: Model Context Protocol, schemas, retrieval pipelines, and standards.
• Create evaluation harness with eval sets, rubrics, and regression suites for non-deterministic systems.
• Own AI workloads’ performance, cost, reliability: tracing, budgets, routing, fallback, caching.
• Establish safety architecture: PHI gates, prompt-injection defenses, least-privilege, human-in-the-loop.
• Evaluate models/frameworks: bake-offs, publish results, flag lock-in and failure modes.
• Produce reference architectures and design docs; defend in architecture review boards.
• Mentor engineers and raise the team’s capability in AI for protected health information.

Skills

AI Agent Security

Solution Architecture

Systems Engineering

Education

Bachelor's degree in Computer Science, Software Engineering, Mathematics, or a related technical field

Advanced degree in Computer Science, Machine Learning, or Artificial Intelligence preferred

Tools

Python

TypeScript/Java/Go/Rust

AWS Bedrock/Claude tools

Terraform/Terragrunt

GitLab CI/CD

AI security tooling

Job description

General Dynamics Information Technology, Inc. is seeking a Solutions Architect Principal to design and govern agentic AI systems for critical Medicaid/MMIS workflows in NY. Lead multi-agent architectures, ensure security, and mentor engineers in a high-stakes, compliant environment.

The role requires 8+ years in software or systems architecture, plus hands-on experience with production LLMs and agentic tooling. Hybrid work in Albany area with strong enterprise collaboration.