Principal AI Solutions Architect

General Dynamics IT; United States; On-site; USD 150,000 - 210,000; Full time

Job summary

General Dynamics IT in Albany, NY, is seeking a Solutions Architect Principal to design and build agentic AI systems for the NY MMIS program, with strict response-time, availability, and HIPAA/HITECH compliance.

You will lead architectural direction for AI governance, tool interfaces, and reference implementations, mentor engineers, and ensure security, cost, and reliability of AI workloads within a regulated environment.

Qualifications

• Education: Bachelor's in Computer Science, Software Engineering, Mathematics, or a related technical field; an advanced degree in Computer Science, Machine Learning, or Artificial Intelligence preferred
• Experience: 8+ years of professional software engineering or systems architecture experience, including 1+ year building and operating production large language model systems, with at least one agentic system taken to production and supported afterward

Responsibilities

• Architect, build, and operate multi-agent systems - planning, tool use, memory, and reflection loops - that run as governed, auditable, and reproducible steps inside the delivery pipeline
• Design and implement the tool and context layer that agents depend on: Model Context Protocol servers, tool and output schemas, retrieval pipelines, and context engineering standards
• Build the evaluation harness before the feature - eval sets, scoring rubrics, and regression suites that prove a non-deterministic system improved rather than assert it
• Own performance, cost, and reliability for AI workloads: tracing, token and spend budgets, model selection and routing, fallback behavior, and caching
• Establish the guardrail and safety architecture - PHI stage gates, prompt injection and data exfiltration defenses, least-privilege tool scoping, and human-in-the-loop approval checkpoints
• Evaluate models, frameworks, and vendors on evidence: run bake-offs, publish results honestly, name lock-in and failure modes, and recommend against adoption when warranted
• Produce the architecture others build from - reference architectures, interface requirement documents, design patterns, and decision records - and defend it in architecture review boards
• Raise the engineering organization's ceiling through pairing, design review, and the standards governing how the program applies AI to protected health information

Skills

Python

TypeScript

Java

Go

Rust

System architecture

Education

Bachelor's in CS/Software Eng/Math

Advanced degree in CS/ML/AI preferred

Tools

Amazon Bedrock

Anthropic Claude

Claude Code

pgvector

OpenSearch

Terraform

Terragrunt

GitLab CI/CD

AWS

Job description

General Dynamics IT in Albany, NY, is seeking a Solutions Architect Principal to design and build agentic AI systems for the NY MMIS program, with strict response-time, availability, and HIPAA/HITECH compliance.

You will lead architectural direction for AI governance, tool interfaces, and reference implementations, mentor engineers, and ensure security, cost, and reliability of AI workloads within a regulated environment.