Solutions Architect Principal

General Dynamics Information Technology, Inc.; City of Albany (NY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

401K with company match

Comprehensive benefits

Paid time off

Job summary

General Dynamics Information Technology, Inc. seeks a Solutions Architect Principal to lead design and implementation of agentic AI systems within the NY MMIS program. You will define architecture, reference implementations, and governance for high-throughput, compliant AI workloads in Albany, NY.

You will drive engineering standards, mentor teams, and collaborate with stakeholders to ensure secure, scalable, and auditable AI solutions across protected health information environments.

Qualifications

• Bachelor's in Computer Science, Software Engineering, Mathematics, or a related technical field.
• Advanced degree in Computer Science, Machine Learning, or Artificial Intelligence preferred.
• 8+ years of professional software engineering or systems architecture experience.
• 1+ year building and operating production large language model systems; at least one agentic system in production.

Responsibilities

• Architect, build, and operate multi-agent systems with governance, auditable steps within the delivery pipeline.
• Design tool and context layer for agents: Model Context Protocol servers, tool schemas, retrieval pipelines, context engineering standards.
• Build the evaluation harness: eval sets, scoring rubrics, regression suites to prove improvements.
• Own performance, cost, and reliability for AI workloads: tracing, token budgets, model routing, caching.
• Establish guardrails and safety architecture for PHI, prompt injection defenses, least-privilege tool scoping, human-in-the-loop checkpoints.
• Evaluate models, frameworks, and vendors; run bake-offs and publish results.
• Produce reference architectures, interface docs, design patterns, and decision records for teams.
• Raise engineering standards through mentoring and code/architecture reviews.

Skills

Python

Agentic patterns

Model Context Protocol

AWS

Terraform

GitLab CI/CD

Education

Bachelor's in Computer Science or related field

Advanced degree in CS/ML/AI preferred

Tools

Bedrock/Claude

OpenSearch/ pgvector

AWS Cloud

Terraform

GitLab CI/CD

Job description

SOLUTIONS ARCHITECT PRINCIPAL

Support mission-critical initiatives and enable the growth of our business as a Solutions Architect Principal at GDIT. Here, you’ll become an integral part of how GDIT is able to ensure the safety and security of our nation.

MEANINGFUL WORK AND PERSONAL IMPACT

As a Solutions Architect Senior Advisor, the work you’ll do at GDIT will be impactful to the mission of the New York State Department of Health Medicaid Management Information System (MMIS) program. You will play a crucial role in designing and building the agentic AI systems that support the eMedNY enterprise at Corporate Woods in Albany, NY.

As the individual contributor for artificial intelligence and agentic engineering, you will be trusted to set the technical direction for how AI is designed, built, and governed across one of the nation’s largest Medicaid claims processing environments, under extremely stringent response-time and continuous-availability service level agreements and HIPAA/HITECH and FedRAMP compliance obligations. Your influence will come from the architectures you design, the reference implementations you ship, and the engineers you mentor. In this role, your responsibilities will be:

• Architect, build, and operate multi-agent systems — planning, tool use, memory, and reflection loops — that run as governed, auditable, and reproducible steps inside the delivery pipeline
• Design and implement the tool and context layer that agents depend on: Model Context Protocol servers, tool and output schemas, retrieval pipelines, and context engineering standards
• Build the evaluation harness before the feature — eval sets, scoring rubrics, and regression suites that prove a non-deterministic system improved rather than assert it
• Own performance, cost, and reliability for AI workloads: tracing, token and spend budgets, model selection and routing, fallback behavior, and caching
• Establish the guardrail and safety architecture — PHI stage gates, prompt injection and data exfiltration defenses, least-privilege tool scoping, and human-in-the-loop approval checkpoints
• Evaluate models, frameworks, and vendors on evidence: run bake-offs, publish results honestly, name lock-in and failure modes, and recommend against adoption when warranted
• Produce the architecture others build from — reference architectures, interface requirement documents, design patterns, and decision records — and defend it in architecture review boards
• Raise the engineering organization’s ceiling through pairing, design review, and the standards governing how the program applies AI to protected health information

WHAT YOU’LL NEED TO SUCCEED

Bring your initiative and drive for innovation to GDIT. The Solutions Architect Principal must have:

• Education: Bachelor’s in Computer Science, Software Engineering, Mathematics, or a related technical field; an advanced degree in Computer Science, Machine Learning, or Artificial Intelligence preferred
• Experience: 8+ years of professional software engineering or systems architecture experience, including 1+ year building and operating production large language model systems, with at least one agentic system taken to production and supported afterward
• Python at expert level, plus working fluency in a second language such as TypeScript, Java, Go, or Rust
• Agentic patterns and runtimes: tool and function calling, Model Context Protocol, structured output, multi-agent orchestration, durable state, and human-in-the-loop control flow
• Amazon Bedrock, Anthropic Claude, and agentic coding harnesses such as Claude Code
• Retrieval-augmented generation: embeddings, hybrid retrieval, reranking, and vector stores such as pgvector or Amazon OpenSearch
• Evaluation and observability for non-deterministic systems; AWS cloud-native services, containers, Terraform / Terragrunt, and GitLab CI/CD
• AI security and compliance: prompt injection, insecure output handling, PHI leakage prevention, HIPAA/HITECH, NIST AI RMF, and the OWASP Top 10 for LLM Applications
• A computer science foundation strong enough to transfer — proven ability to pick up a framework that did not exist six months ago, read its source, judge production-readiness, and put it to work
• A demonstrated record of rapid self-directed learning; be prepared to name a technology you took from unfamiliar to production within a year and explain how
• Engineering judgment and intellectual honesty about AI — able to tell a demo from a system, quantify where a model is unreliable, and tell leadership when the answer is “not yet”
• Comfort working without an established playbook, and willingness to create the standards, tooling, and documentation that do not yet exist
• Rigorous reasoning about determinism and blast radius: which decisions an agent may make autonomously, which require human approval, and which must never be delegated to a model at all
• Excellent technical writing, and the ability to work directly with non-technical program and client stakeholders
• Effectiveness as an individual contributor, influencing through architecture, reference implementations, and mentorship
• Open-source contributions to AI or agent tooling, published evaluations, or technical writing in the agentic engineering space
• Healthcare or Medicaid/MMIS domain experience, including X12 EDI transaction sets and HL7 FHIR
• Certifications such as AWS Certified Machine Learning Engineer, AWS Certified Solutions Architect – Professional, or CISSP

Location: Hybrid if local to the Albany, NY area or 100% Remote

GDIT IS YOUR PLACE At GDIT,

Growth: AI-powered career tool that identifies career steps and learning opportunities

Support: An internal mobility team focused on helping you achieve your career goals

Rewards: Comprehensive benefits and wellness packages, 401K with company match, and competitive pay and paid time off

Flexibility: Full-flex work week to own your priorities at work and at home

Community: Award-winning culture of innovation and a military-friendly workplace

OWN YOUR OPPORTUNITY

Explore a career at GDIT and you’ll find endless opportunities to grow alongside colleagues who share your sense of ownership and pride in the meaningful work we do.