AI/ML Engineer - Cybersecurity

Scan Ninja Inc.; Houston (TX); On-site; USD 100,000 - 130,000; Full time

Job summary

Scan Ninja Inc. in Houston, Texas is seeking a role focused on applied AI systems for security. You will fine-tune and evaluate LLM workflows, build data pipelines, and work closely with security engineers. The ideal candidate should have strong experience in machine learning or AI systems, knowledge of NLP and cybersecurity concepts, along with proficient Python skills. This position emphasizes real-world impact rather than just benchmark scores.

Qualifications

• Experience building and shipping machine learning or AI systems.
• Strong knowledge of NLP, LLMs, and modern model workflows.
• Production experience with machine learning systems.

Responsibilities

• Fine-tune, evaluate, and improve LLM workflows for vulnerability triage.
• Build data pipelines for training, evaluation, and feedback collection.
• Work closely with security engineers to validate model outputs.

Skills

Machine learning or AI systems

Natural Language Processing (NLP)

Model evaluation

Python

Cybersecurity concepts

Job description

You will work on applied AI systems that drive real security outcomes, not just benchmark scores. This role focuses on model quality, reliability, observability, and measurable impact for enterprise customers.

Responsibilities

• Fine-tune, evaluate, and improve LLM workflows for vulnerability triage
• Build data pipelines for training, evaluation, and feedback collection
• Work closely with security engineers to validate model outputs in real-world scenarios
• Define and monitor model quality, reliability, and production metrics
• Ship AI features safely using staged rollouts and appropriate controls

Requirements

• Experience building and shipping machine learning or AI systems
• Strong knowledge of NLP, LLMs, and modern model workflows
• Working knowledge of cybersecurity concepts and use cases

Must Have

• Production experience with machine learning systems
• Strong Python skills and a solid foundation in model evaluation
• Experience with prompt design, retrieval workflows, and LLM application patterns
• Ability to make practical tradeoffs between quality, latency, and cost

Nice to Have

• Experience with adversarial machine learning or secure AI systems
• Background in vulnerability management or cybersecurity operations
• Hands-on experience with vector databases and retrieval systems