GenAI Prompt Architect — NLP & AI QA Specialist

TechDoQuest; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

TechDoQuest is seeking a skilled engineer to design and refine prompts for generative AI systems, ensuring high performance across use cases in a Toronto-based role. You will validate AI outputs, develop robust test cases, and iteratively improve model behavior in collaboration with cross-functional teams.

The ideal candidate brings 5-8 years in software development or automation testing and at least 1 year working with LLMs or GPT-based systems, with a strong NLP background and problem-solving

Qualifications

• Must have 5-8 years of professional software development or automation testing experience.
• At least 1 year hands-on with generative AI, LLMs, or GPT-based systems.
• Strong understanding of NLP principles.
• Experience with automation frameworks and test scripting.
• Familiarity with AI/ML workflows is a plus.
• Strong analytical and problem-solving skills.

Responsibilities

• Design and refine prompts for generative AI to maximize performance and accuracy.
• Analyze and validate AI-generated outputs for quality and contextual relevance.
• Create and run comprehensive test cases for AI responses.
• Provide structured feedback to improve model behavior and performance.
• Collaborate with data scientists, engineers, and product managers to implement improvements.

Skills

Prompt design

AI QA

Test case development

Iteration and feedback

Cross-functional collaboration

NLP principles

Analytical problem solving

Job description

TechDoQuest is seeking a skilled engineer to design and refine prompts for generative AI systems, ensuring high performance across use cases in a Toronto-based role. You will validate AI outputs, develop robust test cases, and iteratively improve model behavior in collaboration with cross-functional teams.

The ideal candidate brings 5-8 years in software development or automation testing and at least 1 year working with LLMs or GPT-based systems, with a strong NLP background and problem-solving