Lead Gen AI Engineer — APIs & LLM Orchestration

Virtusa; Mississauga; On-site; CAD 120,000 - 170,000; Full time

Job summary

Virtusa in Mississauga seeks a Lead Software Engineer to lead design and development of scalable, API-driven solutions leveraging modern tech stacks and Generative AI capabilities.

You will collaborate with cross-functional teams to deliver innovative AI solutions, implement API integrations for Gen AI orchestration, and apply prompt engineering to drive advanced AI workflows. Strong Python and PySpark/Java are essential.

Qualifications

• 7+ years of experience in software engineering or data analytics.
• Strong Python (mandatory); PySpark or Java.
• Experience building API-based scalable solutions.
• Hands-on LLM integration and prompt engineering.
• Familiarity with AI frameworks and orchestration tools.

Responsibilities

• Lead design and development of scalable, API-driven solutions.
• Develop and integrate APIs for Gen AI orchestration and data analytics workflows.
• Integrate popular LLMs via API endpoints (e.g., OpenAI GPT, PaLM 2, Dolly, Claude 2, Cohere).
• Apply prompt engineering techniques and implement LLM agents (e.g., LangChain).
• Work with vector databases like Pinecone, Chroma, or FAISS for AI solutions.
• Conduct rapid experiments to evaluate new LLM versions and features.
• Collaborate with Gen AI leads to deliver high-quality solutions.
• Perform basic data engineering to load data from source systems to target stores.
• Debug and troubleshoot software or design issues.

Skills

Python

PySpark

Java

API design

Job description

Virtusa in Mississauga seeks a Lead Software Engineer to lead design and development of scalable, API-driven solutions leveraging modern tech stacks and Generative AI capabilities.

You will collaborate with cross-functional teams to deliver innovative AI solutions, implement API integrations for Gen AI orchestration, and apply prompt engineering to drive advanced AI workflows. Strong Python and PySpark/Java are essential.