Solutions Architect Principal

General Dynamics Information Technology, Inc.; Town of Colonie (NY); Hybrid; USD 145,000 - 196,000; Full time

Job summary

General Dynamics Information Technology, Inc. is seeking a Solutions Architect Principal to design and govern agentic AI systems for critical Medicaid/MMIS workflows in NY. Lead multi-agent architectures, ensure security, and mentor engineers in a high-stakes, compliant environment.

The role requires 8+ years in software or systems architecture, plus hands-on experience with production LLMs and agentic tooling. Hybrid work in Albany area with strong enterprise collaboration.

Qualifications

• Bachelor’s in CS, software engineering, math, or equivalent.
• 8+ years of software engineering or systems architecture experience.
• At least 1 year building/operating production LLM systems with agentic components.
• Experience with HIPAA/HITECH and FedRAMP is a plus.

Responsibilities

• Architect, build, and operate multi-agent systems inside a governed, auditable delivery pipeline.
• Design the tool/context layer: Model Context Protocol, schemas, retrieval pipelines, and standards.
• Create evaluation harness with eval sets, rubrics, and regression suites for non-deterministic systems.
• Own AI workloads’ performance, cost, reliability: tracing, budgets, routing, fallback, caching.
• Establish safety architecture: PHI gates, prompt-injection defenses, least-privilege, human-in-the-loop.
• Evaluate models/frameworks: bake-offs, publish results, flag lock-in and failure modes.
• Produce reference architectures and design docs; defend in architecture review boards.
• Mentor engineers and raise the team’s capability in AI for protected health information.

Skills

AI Agent Security

Solution Architecture

Systems Engineering

Education

Bachelor's degree in Computer Science, Software Engineering, Mathematics, or a related technical field

Advanced degree in Computer Science, Machine Learning, or Artificial Intelligence preferred

Tools

Python

TypeScript/Java/Go/Rust

AWS Bedrock/Claude tools

Terraform/Terragrunt

GitLab CI/CD

AI security tooling

Job description

Type of Requisition: Regular Clearance Level Must Currently Possess: None Clearance Level Must Be Able to Obtain: None Public Trust/Other Required: None Job Family: Technical Solutions Job Qualifications: Skills: AI Agent Security, Solution Architecture, Systems Engineering Certifications: None Experience: 8 + years of related experience US Citizenship Required: No

SOLUTIONS ARCHITECT PRINCIPAL

Support mission-critical initiatives and enable the growth of our business as a Solutions Architect Principal at GDIT. Here, you’ll become an integral part of how GDIT is able to ensure the safety and security of our nation.

MEANINGFUL WORK AND PERSONAL IMPACT As a Solutions Architect Senior Advisor, the work you’ll do at GDIT will be impactful to the mission of the New York State Department of Health Medicaid Management Information System (MMIS) program. You will play a crucial role in designing and building the agentic AI systems that support the eMedNY enterprise at Corporate Woods in Albany, NY. As the individual contributor for artificial intelligence and agentic engineering, you will be trusted to set the technical direction for how AI is designed, built, and governed across one of the nation’s largest Medicaid claims processing environments, under extremely stringent response-time and continuous-availability service level agreements and HIPAA/HITECH and FedRAMP compliance obligations. Your influence will come from the architectures you design, the reference implementations you ship, and the engineers you mentor.

In this role, your responsibilities will be:

• Architect, build, and operate multi-agent systems — planning, tool use, memory, and reflection loops — that run as governed, auditable, and reproducible steps inside the delivery pipeline
• Design and implement the tool and context layer that agents depend on: Model Context Protocol servers, tool and output schemas, retrieval pipelines, and context engineering standards
• Build the evaluation harness before the feature — eval sets, scoring rubrics, and regression suites that prove a non-deterministic system improved rather than assert it
• Own performance, cost, and reliability for AI workloads: tracing, token and spend budgets, model selection and routing, fallback behavior, and caching
• Establish the guardrail and safety architecture — PHI stage gates, prompt injection and data exfiltration defenses, least-privilege tool scoping, and human-in-the-loop approval checkpoints
• Evaluate models, frameworks, and vendors on evidence: run bake-offs, publish results honestly, name lock-in and failure modes, and recommend against adoption when warranted
• Produce the architecture others build from — reference architectures, interface requirement documents, design patterns, and decision records — and defend it in architecture review boards
• Raise the engineering organization’s ceiling through pairing, design review, and the standards governing how the program applies AI to protected health information

WHAT YOU’LL NEED TO SUCCEED

Bring your initiative and drive for innovation to GDIT. The Solutions Architect Principal must have:

Education: Bachelor’s in Computer Science, Software Engineering, Mathematics, or a related technical field; an advanced degree in Computer Science, Machine Learning, or Artificial Intelligence preferred

Experience: 8+ years of professional software engineering or systems architecture experience, including 1+ year building and operating production large language model systems, with at least one agentic system taken to production and supported afterward

Technical Skills

• Python at expert level, plus working fluency in a second language such as TypeScript, Java, Go, or Rust
• Agentic patterns and runtimes: tool and function calling, Model Context Protocol, structured output, multi-agent orchestration, durable state, and human-in-the-loop control flow
• Amazon Bedrock, Anthropic Claude, and agentic coding harnesses such as Claude Code Retrieval-augmented generation: embeddings, hybrid retrieval, reranking, and vector stores such as pgvector or Amazon OpenSearch
• Evaluation and observability for non-deterministic systems; AWS cloud-native services, containers, Terraform / Terragrunt, and GitLab CI/CD
• AI security and compliance: prompt injection, insecure output handling, PHI leakage prevention, HIPAA/HITECH, NIST AI RMF, and the OWASP Top 10 for LLM Applications

Role Requirements

• A computer science foundation strong enough to transfer — proven ability to pick up a framework that did not exist six months ago, read its source, judge production-readiness, and put it to work
• A demonstrated record of rapid self-directed learning; be prepared to name a technology you took from unfamiliar to production within a year and explain how
• Engineering judgment and intellectual honesty about AI — able to tell a demo from a system, quantify where a model is unreliable, and tell leadership when the answer is “not yet”
• Comfort working without an established playbook, and willingness to create the standards, tooling, and documentation that do not yet exist
• Rigorous reasoning about determinism and blast radius: which decisions an agent may make autonomously, which require human approval, and which must never be delegated to a model at all
• Excellent technical writing, and the ability to work directly with non-technical program and client stakeholders
• Effectiveness as an individual contributor, influencing through architecture, reference implementations, and mentorship

Preferred Requirements

• Open-source contributions to AI or agent tooling, published evaluations, or technical writing in the agentic engineering space
• Healthcare or Medicaid/MMIS domain experience, including X12 EDI transaction sets and HL7 FHIR
• Certifications such as AWS Certified Machine Learning Engineer, AWS Certified Solutions Architect – Professional, or CISSP

Location: Hybrid if local to the Albany, NY area or 100% Remote GDIT IS YOUR PLACE

GDIT IS YOUR PLACE

At GDIT, the mission is our purpose, and our people are at the center of everything we do.

• Growth: AI-powered career tool that identifies career steps and learning opportunities
• Support: An internal mobility team focused on helping you achieve your career goals
• Rewards: Comprehensive benefits and wellness packages, 401K with company match, and competitive pay and paid time off
• Flexibility: Full-flex work week to own your priorities at work and at home
• Community: Award-winning culture of innovation and a military-friendly workplace

OWN YOUR OPPORTUNITY Explore a career at GDIT and you’ll find endless opportunities to grow alongside colleagues who share your sense of ownership and pride in the meaningful work we do.

The likely salary range for this position is $144,500 - $195,500. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

Scheduled Weekly Hours: 40

Travel Required: None

Telecommuting Options: Hybrid Work Location: USA NY Albany

Additional Work Locations: Total Rewards at GDIT: Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.

Our Identity Verification Process: As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work: We are GDIT. A global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50+ countries worldwide, offering leading mission-ready capabilities in AI, cloud, cyber and software development.

Join our Talent Community to stay up to date on our career opportunities and events at gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans Opportunity Owned From working with technologies like AI, cyber and cloud to careers in intelligence and health, we offer endless opportunities to apply your expertise to create a safer, smarter world.

For more information about GDIT's Privacy Policy, click here: Privacy Policy | GDIT