GenAI Prompt Engineer

TechDoQuest; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

TechDoQuest is seeking a skilled engineer to design and refine prompts for generative AI systems, ensuring high performance across use cases in a Toronto-based role. You will validate AI outputs, develop robust test cases, and iteratively improve model behavior in collaboration with cross-functional teams.

The ideal candidate brings 5-8 years in software development or automation testing and at least 1 year working with LLMs or GPT-based systems, with a strong NLP background and problem-solving

Qualifications

• Must have 5-8 years of professional software development or automation testing experience.
• At least 1 year hands-on with generative AI, LLMs, or GPT-based systems.
• Strong understanding of NLP principles.
• Experience with automation frameworks and test scripting.
• Familiarity with AI/ML workflows is a plus.
• Strong analytical and problem-solving skills.

Responsibilities

• Design and refine prompts for generative AI to maximize performance and accuracy.
• Analyze and validate AI-generated outputs for quality and contextual relevance.
• Create and run comprehensive test cases for AI responses.
• Provide structured feedback to improve model behavior and performance.
• Collaborate with data scientists, engineers, and product managers to implement improvements.

Skills

Prompt design

AI QA

Test case development

Iteration and feedback

Cross-functional collaboration

NLP principles

Analytical problem solving

Job description

-Prompt Writing: Design and refine creative, effective, and contextually relevant prompts for generative AI systems to maximize performance and accuracy across various use cases.

-AI Response Validation: Analyze and validate AI-generated outputs to ensure they meet quality standards, are contextually appropriate, and align with user needs.

-Test Case Development: Create and execute comprehensive test cases for AI generated responses, assessing robustness, accuracy, and user experience.

-Iteration and Feedback: Provide structured feedback to improve AI model behavior, performance, and overall functionality.

-Collaboration: Work closely with cross-functional teams including data scientists, engineers, and product managers to implement and test improvements.

Experience:

-5-8 years of professional experience in software development or automation testing.

-Minimum 1 year of hands‑on experience with generative AI technologies, large language models (LLMs), or GPT-based systems.

-Strong understanding of natural language processing (NLP) principles.

-Experience with automation frameworks and test scripting.

-Familiarity with AI and ML workflows is a plus.

-Strong analytical and problem‑solving skills.