Secure AI Backend Engineer (LLM & Microservices)

Fortinet, Inc.; Sunnyvale (CA); On-site; USD 160,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) plan

Paid holidays

Vacation time

Sick time

Comprehensive leave program

Job summary

A leading cybersecurity firm is seeking a candidate to enhance LLM security by architecting monitoring and filtering systems. This role requires expertise in deploying AI systems, managing prompts, and safeguarding against emerging threats. The ideal candidate will have strong skills in application security and experience in microservices architecture. A competitive salary range is available, along with robust employee benefits including medical insurance and a 401(k) plan.

Qualifications

• Hands‑on experience with AI/ML systems, particularly LLMs and prompt handling.
• Solid knowledge of application security and building secure systems.
• Experience designing microservices and using containerization and orchestration.
• Ability to design clean and secure APIs with performance optimization.
• Familiarity with data protection best practices and responsible AI principles.
• Understanding of emerging AI security guidelines and implementation.
• Experience with RAG architectures, vector databases, and monitoring workflows.
• Strong programming skills in Python and C/C++.

Responsibilities

• Architect and implement functions to monitor LLM requests/responses.
• Build a scalable pipeline for high-volume LLM traffic.
• Develop monitoring systems to detect anomalies in LLM usage.
• Collaborate on security requirements and mentor junior engineers.
• Ensure timely delivery of high-quality software features.
• Communicate effectively with technical and non-technical stakeholders.

Skills

Large language models deployment

Application security principles

Microservices architecture design

API design

Data protection and privacy

AI security guidelines

Retrieval-augmented generation (RAG)

Programming skills in Python

Familiarity with PyTorch or TensorFlow

Tools

Docker

Kubernetes

AWS

GCP

Azure

Hugging Face Transformers

Job description

A leading cybersecurity firm is seeking a candidate to enhance LLM security by architecting monitoring and filtering systems. This role requires expertise in deploying AI systems, managing prompts, and safeguarding against emerging threats. The ideal candidate will have strong skills in application security and experience in microservices architecture. A competitive salary range is available, along with robust employee benefits including medical insurance and a 401(k) plan.