Generative AI Applications Engineer (Agents & RAG)

Accenture Federal Services; Washington (District of Columbia); On-site; USD 103,000 - 203,000; Full time

Job summary

Accenture Federal Services seeks engineers to build secure GenAI applications across defense and federal programs. You will own end-to-end delivery from use-case eval to production, integrating with major cloud AI services and maintaining strict operational standards.

The role emphasizes hands-on GenAI development, RAG, and secure deployment in hybrid or restricted environments, with a focus on safety, latency, and cost efficiency.

Qualifications

• Built and deployed a production GenAI application (chatbot, copilot, assistant).
• Hands-on with LLMs GPT, Claude, Llama, Gemini, Mistral via APIs or self-hosted.
• Designed and implemented RAG solutions using embeddings, vector databases, and semantic search for enterprise or mission data.
• Shipped AI applications with frameworks like LangChain, LangGraph, LlamaIndex, Semantic Kernel, DSPy, or similar.
• Strong Python development for building and integrating AI/ML applications.
• Owned AI solutions through full production life cycle, deployment and operational support.
• Active U.S. citizenship.

Responsibilities

• Design & ship mission-grade GenAI: Build agentic workflows and RAG systems tailored to mission data and environments; target low hallucination, tight p95 latency, and predictable cost.
• Platform integration (no model training): Integrate with AWS Bedrock, Azure OpenAI, Google Vertex AI, and other managed services.
• LLM selection & evaluation: Compare models for quality, safety, latency, cost; deploy with observability and safe rollback/fallback.
• RAG pipelines & vector search: Build retrieval pipelines with Pinecone, Weaviate, OpenSearch, FAISS, or Chroma.
• Instrumentation & operations: Monitor metrics/logs/traces; run A/B experiments; maintain incident playbooks; implement guardrails.
• Zero Trust & airgapped environments: Deliver in restricted environments with audit-ready controls.

Skills

LLMs

Python

RAG

Frameworks

Cloud APIs

Containerization

Docker

Kubernetes

Communication

Security & Compliance

Tools

AWS Bedrock

Azure OpenAI

Google Vertex AI

Pinecone

Weaviate

OpenSearch

FAISS

Chroma

LangChain

Terraform

Job description

At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people.Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations.

Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more.

Join us to drive positive, lasting change that moves missions and the government forward!

Build AI that matters

We ship production GenAI apps for confidential federal programs across defense, national security, public safety, civilian, and military health where reliability, privacy, and safety aren’t optional. AFS is a technology company within global Accenture and a Glassdoor Top 100 Best Place to Work. You’ll join a collaborative, inclusive community with hands-on growth, certifications, and industry training. We ship in weeks, not quarters, and measure success with latency, reliability, safety, and cost.

Confidentiality matters:

Wedon’tdiscloseprogram details publicly. If you advance,we’llshare specifics during the process.

Role Overview

You’llturn mission needs into secure, reliable, and scalable GenAI applicationsno model trainingrequired. This is a hands-on role across agentic workflows, RAG, prompt/policy design, LLM evaluation, and platform integration.You’llown the end-to-end path from usecase evaluation → production deployment → operational excellence, partnering with product, security, data, and SRE to ship features safely and at scale.

WhatYou’llDo (Day to Day)

• Design & shipmissiongradeGenAI: Build agentic workflows and RAG systems tailored to mission data and environments; target low hallucination, tight p95 latency, and predictable cost.
• Agent frameworks & orchestration: Apply patterns fromLangChain/LlamaIndex/Semantic Kernel; design task decomposition,tooluse, guardrails, and recovery/fallback strategies.
• Platform integration (no model training): Implement with AWS Bedrock, Azure OpenAI, Google Vertex AI, Amazon Kendra, and managed services (e.g., Document AI, Gemini, Gemma).
• LLM selection & evaluation: Compare models for quality, safety, latency, cost; author/test prompts & policies; deploy with observability and safe rollback/fallback.
• RAG done right: Build retrieval pipelines & vector search (Pinecone,Weaviate, OpenSearch,pgvector, FAISS/Chroma); handle data prep, chunking, metadata, andIRstyleevals (e.g., NDCG) to maximize signaltonoise.
• Production rigor: Instrument metrics/logs/traces; run A/B experiments;maintainincident playbooks; and implement safety & compliance guardrails.
• SRE & FinOps for AI: Define SLIs/SLOs (quality/latency/safety/cost), runoncalland postmortems, reduce MTTR; meter usage andoptimizetoken/spend.
• Reusable platform components: Ship SDKs, CI/CD templates, Terraform/IaCmodules, evaluation harnesses that accelerate multiple mission team not one-off projects.
• Operate in realworld constraints: Deliver into hybrid, restricted, or airgapped environments with Zero Trust principles and auditready controls.

You’llThrive Here If youhave

• Built and deployed a production GenAI application (chatbot, copilot, assistant, or enterprise AI).
• Hands-on with LLMs GPT, Claude, Llama, Gemini, Mistral, via APIs or self-hosted.
• Designed and implemented RAG solutions using embeddings, vector databases, and semantic search for enterprise or mission data.
• Shipped AI applications with frameworks like LangChain, LangGraph, LlamaIndex, Semantic Kernel, DSPy, or similar.
• Strong Python development for building and integrating AI/ML applications.
• Owned AI solutions through full production life cycle, deployment and operational support.
• Active U.S. citizenship.

Nice to Have

• Integration with leading cloud AI servicesoronpreminference stacks
• Background in LLM evaluation, prompt authoring/testing, A/B experimentation, andLLMOps.
• Responsible AIexpertise(privacy, security, bias, transparency, humanintheloop) and data governance.
• Experience implementingtoolusingagents for API integration and external data access.
• Containerization & orchestration (Docker, Kubernetes, VMware) and scripting/automation (Linux Bash, PowerShell).
• Prior work in regulated/secure environments (e.g., ATO, STIGs, Zero Trust) with fast shipping.
• Familiarity with NVIDIA AI Foundations, OpenAI ChatGPT, andAIassisteddev tools (Cursor, Windsurf, Claude).
• Contributions to internal frameworks or opensource; mentorship of engineers.
• Clear communication with engineers, PMs, and security/compliance stakeholders.

As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of California, Colorado, Connecticut, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Ohio, Vermont, Virginia, Washington, and the District of Columbia. The base pay range for this position in these locations is shown below. Compensation for roles at Accenture Federal Services varies depending on a wide array of factors, including but not limited to office location, role, skill set, and level of experience. Accenture Federal Services offers a wide variety of benefits. You can find more information on benefits here. We accept applications on an on-going basis and there is no fixed deadline to apply.

$103,200—$203,400 USD

What We Believe

As a company wholly dedicated to serving the US federal government, we bring together the best talent to help reinvent how federal agencies operate and deliver greater value for their mission and the American people. We have an unwavering commitment to creating a culture in which all our people are respected, feel a sense of belonging, and have equal opportunity. As a business imperative, every person at Accenture Federal Services has the responsibility to create and sustain a culture where everyone feels welcomed and included. This is grounded in our core values and our experience that hiring and developing great people who reflect different perspectives, experiences, and backgrounds is key to driving innovation and delivering the results that our clients and the country count on.

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. For details, view a copy of the Accenture Federal Services Equal Opportunity Policy Statement.

Accenture Federal Services is an Equal Employment Opportunity employer. Additionally, as an Affirative Action Employer for Veterans and Individuals with Disabilities, Accenture Federal Services is committed to providing veteran employment opportunities to our service men and women.

Requesting An Accommodation

Accenture Federal Services is committed to providing equal employment opportunities for persons with disabilities or religious observances, including reasonable accommodation when needed. If you are hired by Accenture Federal Services and require accommodation to perform the essential functions of your role, you will be asked to participate in our reasonable accommodation process. Accommodations made to facilitate the recruiting process are not a guarantee of future or continued accommodations once hired.

If you **** are being considered for employment opportunities with Accenture Federal Services and need anaccommodation for a disability or religious observanceduring the interview process or for the job you are interviewing for, please speak with your recruiter.

Other Employment Statements

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States.

Candidates who are currently employed by a client of Accenture Federal Services or an affiliated Accenture business may not be eligible for consideration.

Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process.

The Company will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Additionally, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the Company’s legal duty to furnish information.

California requires additional notifications for applicants and employees. If you are a California resident, live in or plan to work from Los Angeles County upon being hired for this position, please click here for additional important information.