AI Engineer

CACI International Inc; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

CACI International Inc. is seeking an experienced AI/ML Engineer to build and support AI workflows and agents for government missions in a secure cloud.

You will collaborate with a platform architect and cloud teams to translate user needs into tested prototypes and production solutions, then monitor and improve them. You will develop LLM workflows, connect AI services with cloud-hosted models and data sources, and implement robust testing and evaluation.

Qualifications

• U.S. citizenship and ability to obtain/maintain Secret clearance.
• 15+ years of relevant experience (a relevant bachelor's degree may replace five years).
• Experience building LLM applications, including RAG, prompt engineering, and agent workflows; proficient in Python and LangChain or LlamaIndex.
• Experience with Azure services, containers, REST APIs, vector databases, and embedding approaches.
• Experience with testing and quality assurance, and ServiceNow integration or scripting.
• Ability to turn requirements into working solutions and explain technical results to nontechnical stakeholders.

Responsibilities

• Develop LLM workflows, agents, and RAG pipelines including document processing, embeddings, and vector search.
• Connect AI services with cloud-hosted models, APIs, and data sources; create reusable components and automate processes.
• Test workflows with unit, integration, acceptance, and regression checks; build evaluation data for accuracy and reliability.
• Investigate defects, hallucinations, and performance issues; track output quality and data/model changes in production.
• Collaborate with platform, cloud, and service management teams on designs, prototypes, integrations, deployment, and documentation.
• Follow government security and data handling controls; provide evidence for authorization and cybersecurity reviews.

Education

Bachelor's degree in a relevant field

Tools

LangChain

LlamaIndex

ServiceNow

REST APIs

PostgreSQL

Job description

Role overview

Build and support AI workflows and agents for a government mission in a secure cloud environment. Working with a platform architect and teams responsible for cloud and service management, you will turn user needs into tested prototypes and production solutions, then help monitor and improve them.

Responsibilities

• Develop LLM workflows, agents, and retrieval-augmented generation (RAG) pipelines, including document processing, embeddings, vector search, and retrieval tuning.
• Connect AI services with cloud-hosted models, service management APIs, and internal data sources; create reusable components and automate business processes.
• Test workflows with unit, integration, acceptance, and regression checks; build evaluation data and measures for accuracy, relevance, and reliability.
• Investigate defects, hallucinations, and performance issues, and track output quality, data quality, model changes, and usage costs in production.
• Collaborate with platform, cloud, and service management specialists on designs, prototypes, integrations, deployment, and technical documentation.
• Follow government security and data handling controls, and provide evidence needed for authorization and ongoing cybersecurity reviews.

Requirements

• U.S. citizenship and ability to obtain and maintain a Secret clearance.
• 15 or more years of relevant experience; a relevant bachelor's degree may replace five years of experience.
• Practical experience building LLM applications, including RAG, prompt engineering, and agent workflows; proficiency in Python and an AI framework such as LangChain or LlamaIndex.
• Experience with Azure services, containers, REST APIs, vector databases, and embedding approaches.
• Experience with software or AI testing and quality assurance, and ServiceNow integration or scripting.
• Ability to turn requirements into working solutions and explain technical results to nontechnical stakeholders.

Nice to have

• Active Secret clearance, with eligibility for Top Secret clearance; government cloud, Kubernetes, MLOps, PostgreSQL, or service management platform experience.
• Familiarity with defense security frameworks, authorization processes, or Security+ certification.

Benefits and work setup

Full-time role with up to 10% local travel. The listing describes flexible time off, learning resources, and health, wellness, financial, retirement, family support, education, and time-off benefits. A salary range was provided in the source but is omitted here to keep this brief anonymous.