DevOps Engineer - FedRAMP, K8s, CI/CD, LLMs

ConductorAI; Washington (District of Columbia); On-site; USD 180,000 - 240,000; Full time

Job summary

ConductorAI is seeking a seasoned DevOps engineer to design and deploy configurations across environments, including air-gapped networks. You will shape system architecture, build CI/CD pipelines, and optimize Helm charts for on-site and hybrid deployments of large models and services.

You will influence strategy, work with partners and senior stakeholders, and help drive accreditation efforts (FedRAMP, IL5/IL6).

Qualifications

• US DoD security clearance - minimum Secret.
• 4+ years as an individual contributor DevOps engineer in high-stakes customer or company environment.
• Experience leading and collaborating with other engineers.
• On-site experience with senior customer stakeholders to outline infrastructure requirements and deploy software.
• Strong communication skills, both written and verbal.
• Proactive mindset, with a knack for identifying opportunities and taking initiative.
• Strong experience with Docker, Kubernetes, Helm, and CI/CD.
• Strong experience with system design and strategy, including multi-cloud software deployment.
• Knowledge of cybersecurity principles/best practices, especially FedRAMP and NIST 800-53.
• Experience with LLMs is a plus.

Responsibilities

• Design and maintain the architecture of a system with multiple AI models, a set of backend APIs, and a frontend web application.
• Work with partners to deploy our software to classified customer environments, including going on-site as needed.
• Docker: Help write and improve the Dockerfiles of the various pieces of our system, to build efficient and hardened docker images with minimal CVEs.
• Kubernetes: Help write and improve our Helm charts that define our deployments into a variety of different Kubernetes clusters, including those backed by cloud infrastructure as well as on-prem.
• CI/CD: Help improve our Github actions CI/CD processes to make updates to our application and its dependencies as painless and robust as possible.
• System Accreditation: Help us make technical decisions to enable continued compliance with a variety of standards, such as FedRAMP.
• Strategy and Culture: As a core member of our team, contribute to company strategy, nurture and shape our growing culture, and take on diverse responsibilities as we evolve.

Skills

DevOps engineering

Team leadership

Communication

On-site collaboration

Security architecture

System design

Tools

Docker

Kubernetes

Helm

CI/CD

GitHub Actions

FedRAMP knowledge

Job description

ConductorAI is seeking a seasoned DevOps engineer to design and deploy configurations across environments, including air-gapped networks. You will shape system architecture, build CI/CD pipelines, and optimize Helm charts for on-site and hybrid deployments of large models and services.

You will influence strategy, work with partners and senior stakeholders, and help drive accreditation efforts (FedRAMP, IL5/IL6).