Senior AI Software Engineer

General Dynamics Information Technology; United States; Remote; USD 130,000 - 173,000; Full time

Job summary

General Dynamics Information Technology, Inc. is hiring a Senior AI Software Engineer to build AI applications and agents for the operations team and end users of the cloud platform supporting the National Institute of Allergy and Infectious Diseases (NIAID).

You will design, develop, and integrate software solutions using LLMs, RAG, vector databases, document processing, and AI agents, delivering secure, reliable AI capabilities in a federal cloud environment.

Qualifications

• Bachelor’s degree or equivalent experience.
• 7+ years of professional software engineering, including 1+ year building LLM‑based applications.
• 5+ years of AI or ML application development, including 2+ years with LLMs.
• At least one LLM application built and supported in production beyond a simple chat interface (tool calling, RAG, agents, etc.).
• Experience with agent frameworks such as LangGraph, LangChain, Strands Agents, or CrewAI.
• Strong Python skills, APIs/back-end services, Git, automated testing, and code review.
• Experience with major model providers (OpenAI, Anthropic, Google, Azure AI, Amazon Bedrock).
• Experience deploying and debugging cloud-based apps with containers and CI/CD.
• Ability to obtain and maintain a Public Trust.

Responsibilities

• Build and deploy LLM-based applications and agents, including APIs, back-end services, tool calling, structured outputs, and multi-step workflows.
• Build RAG and document processing pipelines (ingestion, embeddings, vector search, reranking).
• Incorporate evaluation with test datasets, regression tests, metrics, and human review.
• Collaborate with platform and DevOps to run solutions in production with CI/CD, containers, monitoring, and cost controls.
• Coordinate with security engineers on access control, audit logging, PII handling, AI action approvals, and ATO docs.
• Produce technical documentation, architecture diagrams, deployment procedures, and runbooks.
• Advise stakeholders, communicate trade-offs, and mentor engineers.

Skills

AI Software

LLMs

Machine Learning Methods

Education

Bachelor’s degree or equivalent experience

Tools

LangGraph

LangChain

Strands Agents

CrewAI

Python

APIs

CI/CD

Job description

Type of Requisition

Regular

Clearance Level Must Currently Possess

None

Clearance Level Must Be Able to Obtain

None

Public Trust/Other Required

NACLC (T3)

Job Family

Data Science and Data Engineering

Job Qualifications

Skills

Artificial Intelligence Software, Large Language Models (LLMs), Machine Learning Methods

Certifications

None

Experience

8 + years of related experience

US Citizenship Required

No

Job Description

GDIT is hiring a Senior AI Software Engineer to build AI applications and agents for the operations team and end users of the cloud platform that supports the National Institute of Allergy and Infectious Diseases (NIAID). You will be the AI developer expert on a team of platform, DevOps, and security engineers, collaborating with other developers and government stakeholders to deliver secure, reliable AI capabilities in a federal cloud environment.

You will design, develop, and integrate software solutions that use large language models (LLMs), retrieval-augmented generation (RAG), vector databases, document processing, and AI agents. This includes an integrated AI assistant for end users and agents that automate platform operations and carry out approved tasks. You will build new AI capabilities and improve existing services for performance, reliability, security, and user experience.

The ideal candidate is a hands‑on software engineer who can work across the AI application stack, from backend development and model integration to data processing, automated testing, and deployment. This role requires a strong foundation in software engineering, Python development, API integration, containerization, and AI application architecture.

This role is fully remote!

_This role requires you to obtain and maintain a Public Trust and to provide onsite fingerprinting at a designated facility. This investigation may review personal and criminal behavior, financial conduct, foreign influence, as well as other adjudications._

Responsibilities

• Build and deploy LLM-based applications and agents, including APIs, backend services, tool calling, structured outputs, and multi‑step workflows.
• Build RAG and document processing pipelines covering ingestion, embeddings, vector search, and reranking.
• Build evaluation into every release with test datasets, regression tests, quality metrics, and human review.
• Work with platform and DevOps engineers to run solutions in production using CI/CD, containers, monitoring, and cost controls.
• Work with security engineers on access control, audit logging, PII handling, approval steps for AI actions, and federal authorization (ATO) documentation.
• Produce technical documentation, architecture diagrams, deployment procedures, and operational runbooks.
• Advise stakeholders, communicate technical tradeoffs and recommended approaches to technical and non‑technical audiences, and mentor other engineers.

Required Qualifications

• Bachelor’s degree or equivalent experience.
• One of the following:
  • 7+ years of professional software engineering, including 1+ year building LLM‑based applications.
  • 5+ years of AI or ML application development, including 2+ years with LLMs.
• At least one LLM application built and supported in production that goes beyond a simple chat interface, such as tool calling, RAG, agents, or multi‑step workflows.
• Experience with agent frameworks, such as LangGraph, LangChain, Strands Agents, or CrewAI.
• Strong Python skills, with experience building APIs and backend services, and with Git, automated testing, and code review.
• Experience with major model providers, such as OpenAI, Anthropic, Google, Azure AI, or Amazon Bedrock.
• Experience deploying and debugging applications in the cloud with containers and CI/CD.
• Ability to obtain and maintain a Public Trust.

Preferred Qualifications

• LLM evaluation, tracing, and prompt versioning tools (such as LangSmith, Langfuse, or Ragas).
• Model Context Protocol (MCP) server development and integration.
• AWS, including Amazon Bedrock or Bedrock AgentCore, or relevant AWS certifications (such as Solutions Architect Professional or Generative AI Developer Professional).
• Fine‑tuning or customizing foundation models; knowledge bases and vector stores.
• Infrastructure as code (Terraform).
• Containerized microservice architectures.
• Supporting scientific research, federal government, healthcare, or similarly regulated environments.

GDITFedHealthJobs

The likely salary range for this position is $129,813 - $172,500. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.

Scheduled Weekly Hours

40

Travel Required

None

Telecommuting Options

Remote

Work Location

Any Location / Remote

Total Rewards at GDIT

Our benefits package for all US‑based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post‑tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. GDIT typically provides new employees with 15 days of paid leave per calendar year to be used for vacations, personal business, and illness and an additional 10 paid holidays per year. Paid leave and paid holidays are prorated based on the employee’s date of hire. The GDIT Paid Family Leave program provides a total of up to 160 hours of paid leave in a rolling 12 month period for eligible employees. To ensure our employees are able to protect their income, other offerings such as short and long‑term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.

Our Identity Verification Process

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work

We are GDIT. A global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50+ countries worldwide, offering leading mission‑ready capabilities in AI, cloud, cyber and software development.

Join our Talent Community to stay up to date on our career opportunities and events at

gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans