Senior Software Engineer, LLM/RAG, Kubernetes, CI/CD

2HB Incorporated; Maryland; On-site; USD 140,000 - 210,000; Full time

Job summary

2HB Incorporated is seeking a Senior Software Engineer to support a government customer in Annapolis Junction, MD. The role involves designing, developing, deploying, and supporting Retrieval-Augmented Generation (RAG) solutions in a high-performance Linux HPC environment.

The successful candidate will work hands-on with Large Language Models, LLM orchestration frameworks, and containerized applications, using Python, Kubernetes, Helm, CI/CD automation, and secure SI practices to deliver

Qualifications

• Experience in Linux CLI development and system administration.
• Hands-on Python development with modern software engineering practices.
• Experience with containerization technologies (Docker/Podman/containerd) for packaging and deployment.
• Experience designing and deploying Helm charts for Kubernetes apps.
• Experience deploying containerized apps in production environments.
• Experience managing Kubernetes resources (Deployments, Services, ConfigMaps, Secrets, Ingress).
• Familiarity with Generative AI technologies, including LLMs, RAG architectures, embeddings, and vector databases.
• Experience implementing CI/CD pipelines (GitLab CI/CD, Flux CD, GitLab Runners).
• Familiarity with observability tools (Prometheus, Grafana).
• Proficiency with Git-based workflows (branches, code reviews, PRs).
• Understanding of SDLC, automated testing, security scanning, code quality, and DevSecOps principles.

Responsibilities

• Design, develop, deploy, and support RAG solutions within a high-performance computing Linux environment.
• Work hands-on with LLMs, orchestration frameworks, knowledge retrieval systems, embeddings, and containers.
• Deliver scalable, production-ready SI solutions in mission-critical environments.

Skills

Linux CLI

Python

CI/CD

Git workflows

Observability

DevSecOps

Code reviews

SDLC best practices

Security scanning

LLMs & RAG concepts

Tools

Docker

Podman

containerd

Kubernetes

Helm

GitLab CI/CD

Flux CD

Git

Prometheus

Grafana

Job description

2HB Incorporated is seeking a Senior Software Engineer to support a government customer in Annapolis Junction, MD. The role involves designing, developing, deploying, and supporting Retrieval-Augmented Generation (RAG) solutions in a high-performance Linux HPC environment.

The successful candidate will work hands-on with Large Language Models, LLM orchestration frameworks, and containerized applications, using Python, Kubernetes, Helm, CI/CD automation, and secure SI practices to deliver