Remote DevSecOps Engineer: LLM Security Scanning

Eliassen Group; United States; Remote; Confidential; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking a DevOps/SRE Engineer for an Information Security team to build, operate, and improve an LLM-based code vulnerability detection and reporting capability. The role involves designing the scanner, evaluation harness, and CI/CD pipelines, then transitioning to ongoing operations including patching and feature development.

The candidate will work on AWS Bedrock, Terraform-based deployments, and integrate with GitHub, Jenkins, and Splunk.

Qualifications

• 4+ years of related engineering experience, including hands-on information security or software development work.
• Hands-on experience with AWS Bedrock or equivalent hosted LLM platforms, including model selection, inference optimization, and guardrail configuration.
• Understanding of Infrastructure as Code best practices and strong experience building Terraform modules.
• Experience building and maintaining CI/CD pipelines, preferably Jenkins, integrated with GitHub.
• Working knowledge of application security concepts, common vulnerability classes, and SAST/SCA tooling behavior.
• Clear verbal and written communication skills for management, business sponsors, and technical stakeholders.
• Eligible to work in the US without the need for sponsorship now or in the future.

Responsibilities

• Serve as a security engineer and consultant on cloud projects.
• Build and operate an LLM-based code vulnerability detection capability on AWS Bedrock, including prompt and agent design, model invocation patterns, cost and token controls, and result normalization.
• Develop and maintain the evaluation harness to measure scanner quality, including regression corpora, repeatable test execution, and reporting on detection performance over time.
• Build and maintain scanning pipelines integrated with GitHub and Jenkins, deployed to ECS and provisioned through Terraform.
• Deliver findings and operational telemetry into Splunk, and build dashboards and alerting for scanner health, coverage, and throughput.
• Engineer and implement well-architected solutions while adhering to software development best practices.
• Advise Principal Engineers and Product Owners on operations and evolution of their product.
• Design, test, and implement solutions at the Feature level.
• Support operational information security responsibilities, including development and maintenance of standards, procedures, and guidelines.
• Provide ongoing operational support, patching, and defect resolution for the deployed scanner after go-live.
• Participate in a four-person rotating shift schedule providing 24/7 coverage, including nights, weekends, and holidays, averaging 40 hours per week.
• Maintain appropriate controls and documentation to ensure compliance with company and regulatory requirements.
• Understand virtualization and containerization technologies.
• Participate in operational on-call rotation within normal working hours.
• Perform other duties as assigned.

Skills

Engineering experience

Info security

Communication skills

Security tooling knowledge

CI/CD

Tools

Terraform

GitHub

Jenkins

Splunk

AWS Bedrock

ECS

Kubernetes

Docker

RESTful APIs

Job description

Eliassen Group is seeking a DevOps/SRE Engineer for an Information Security team to build, operate, and improve an LLM-based code vulnerability detection and reporting capability. The role involves designing the scanner, evaluation harness, and CI/CD pipelines, then transitioning to ongoing operations including patching and feature development.

The candidate will work on AWS Bedrock, Terraform-based deployments, and integrate with GitHub, Jenkins, and Splunk.