Senior AI Software Engineer - LLM & RAG Systems

CACI International Inc

United States

Remote

USD 115,000 - 252,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CACI International Inc. seeks an Artificial Intelligence Software Engineer SME to design, implement and scale AI/ML in production environments for government-focused financial and logistics systems.

You will collaborate with cross-functional teams to integrate AI capabilities, deploy LLMs on Kubernetes, and enhance model performance while ensuring security and compliance across the project lifecycle.

Qualifications

  • Active Security clearance (Secret) required.
  • 5+ years in lead software development roles, with AI/ML focus.
  • Masters in CS/Engineering or related field.
  • Experience deploying AI in live production systems.
  • Strong programming proficiency in Python, Java, C++, and JavaScript.
  • Experience with data pipelines (Airflow, Spark, Iceberg, DBT).
  • Cloud expertise (Azure and AWS).
  • API development and management experience.
  • Proficiency with SQL and NoSQL databases.
  • Experience with SAP ERP systems.
  • Familiarity with TensorFlow, PyTorch, NLP, CV.
  • DevOps practices and Kubernetes infrastructure management.
  • Experience with CI/CD pipelines (GitLab).
  • Knowledge of RAG, MCP, and artifact repos like Nexus.

Responsibilities

  • Design, develop, and implement AI in production environments.
  • Collaborate to integrate AI capabilities into existing systems.
  • Provide technical guidance on AI technologies and best practices.
  • Contribute to full-stack development projects.
  • Optimize AI models for performance and scalability.
  • Architect greenfield LLM-enabled workflows for agentic operations.
  • Deploy, operate, and monitor LLMs on local Kubernetes clusters.
  • Build and maintain RAG pipelines for document processing.
  • Develop and maintain MCP servers and their integrations.
  • Support automated testing environments and CI/CD pipelines.
  • Instrument tracing and evaluation tools to improve product cycles.

Skills

Python
Java
C++
JavaScript
Airflow
Spark
Apache Iceberg
DBT
Azure
AWS
APIs
SQL
NoSQL
SAP
TensorFlow
PyTorch
NLP
Computer Vision
Kubernetes
Kserve
vLLM
LangFuse
Elasticsearch
Terraform
Gitlab CI/CD

Education

Master's Degree in Computer Science, Engineering, or related field

Tools

Kubernetes
Kserve
vLLM
LangFuse
Elasticsearch
Terraform
Gitlab CI/CD

Job description

CACI International Inc. seeks an Artificial Intelligence Software Engineer SME to design, implement and scale AI/ML in production environments for government-focused financial and logistics systems.

You will collaborate with cross-functional teams to integrate AI capabilities, deploy LLMs on Kubernetes, and enhance model performance while ensuring security and compliance across the project lifecycle.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Engineer (LLM, Kubernetes) - Secret
Senior AI/ML Engineer (LLM, Kubernetes) - Secret

CACI International Inc • United States

Remote
USD 115,000 - 252,000
AI Engineer: Secure Cloud LLMs, RAG & Gov Workflows
AI Engineer: Secure Cloud LLMs, RAG & Gov Workflows

CACI International Inc • United States

Remote
USD 140,000 - 210,000
Senior AI Software Engineer — LLM & RAG Pipelines (Remote)
Senior AI Software Engineer — LLM & RAG Pipelines (Remote)

CACI International • United States

Remote
USD 115,000 - 252,000
Flexible time off
Learning resources
Competitive benefits
AI/ML Platform Engineer – On-Prem LLM & DevOps
AI/ML Platform Engineer – On-Prem LLM & DevOps

CACI • Lisle (IL)

On-site
USD 90,000 - 190,000
Senior AI Engineer: LLM Systems & Agentic Workflows
Senior AI Engineer: LLM Systems & Agentic Workflows

Cccis • United States

Remote
USD 180,000 - 230,000
401K Match
Paid time off
Annual Incentive Plan
+7
Junior AI Solutions Engineer - LLM & RAG Pipelines
Junior AI Solutions Engineer - LLM & RAG Pipelines

Strategic Innovation Group LLC • Arlington (VA)

On-site
USD 110,000 - 140,000
Health insurance
Dental
Vision
+3
AI/ML Platform Engineer – LLM Infra & Pipelines
AI/ML Platform Engineer – LLM Infra & Pipelines

Aimlroles • Lisle (IL)

On-site
USD 90,000 - 190,000
Senior Enterprise AI Engineer - LLMs, RAG & Multimodal
Senior Enterprise AI Engineer - LLMs, RAG & Multimodal

Rite-Hite Company LLC • United States

On-site
USD 140,000 - 190,000
Health & Well-being benefits
Retirement savings plan with company
Paid holidays and vacation
Senior AI Engineer - LLM Orchestration & RAG
Senior AI Engineer - LLM Orchestration & RAG

BigBear • Maryland

On-site
USD 170,000 - 210,000
On-Site DC Senior AI Engineer - LLM, RAG & Security
On-Site DC Senior AI Engineer - LLM, RAG & Security

PRECISE SOFTWARE SOLUTIONS INCORPORATED • Washington

Hybrid
USD 150,000 - 190,000
Health benefits
Retirement plan with 4% match
PTO 15 days + holidays
+1