Research Assistant – AI Agents & LLM Prototyping

US Tech Solutions; London; On-site; GBP 40,000 - 60,000; Full time

Job summary

A global staff augmentation firm is seeking a Research Assistant to design test prompts and prototype AI agents. The ideal candidate has a Bachelor's degree in Computer Science and 2+ years of relevant experience. Responsibilities include creating benchmarks and troubleshooting AI tools within a Python/PHP stack. This role offers a contract for 3 months, likely to extend, and is perfect for those passionate about AI and machine learning.

Qualifications

• 2+ years of experience in research or prototyping within machine learning, deep learning, or natural language processing.
• Familiarity with architectural patterns of large-scale software systems is required.
• Experience using source control systems is necessary.

Responsibilities

• Create and refine test prompts for AI agents.
• Implement and troubleshoot AI agent tool calls in Python/PHP.
• Analyze test outcomes and communicate findings.

Skills

Python programming

Generative AI knowledge

Understanding of MCP servers

LangChain frameworks

Data analysis

Education

Bachelor’s degree in Computer Science

Tools

Git

Job description

Research Assistant – AI Agents & LLM Prototyping

Overview

We are looking for a Research Assistant with 2+ years of experience in prototyping and testing AI agents or large language models (LLMs). You will design test prompts, experiment with prompt engineering, and debug AI agent tool calls within a Python/PHP software stack. You’ll also help create internal benchmarks to evaluate AI agent performance.

Duration: 03-month (Likely extension)

Key Responsibilities

• Create and refine test prompts to guide AI agents toward desired behavior.
• Implement and troubleshoot AI agent tool calls in a Python/PHP environment.
• Develop high-quality prompts to build internal evaluation benchmarks for AI agents.
• Test AI agents to assess their ability to perform tasks such as ordering, scheduling, or cancelling meetings.
• Analyze test outcomes, identify issues, and communicate findings for continuous improvement.
• Navigate and understand the Python codebase to correlate test results with underlying code.
• Improve and test existing AI agents.
• Identify where agents perform well and where they fail.
• Prompt testing and tuning to optimize agent responses.
• Flagging test results as pass/fail based on expected behavior.

Technical Skills & Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
• 2+ years of experience in research or prototyping within machine learning, deep learning, or natural language processing.
• Proficient in Python, with the ability to understand and work with a codebase containing multiple interrelated files.
• Experience with AI agent frameworks such as Model Context Protocol (MCP) and LangChain.
• Familiarity with architectural patterns of large-scale software systems.
• Basic knowledge of SQL and data analysis is a plus.
• Experience using source control systems (e.g., Git).
• Experience in generative AI and LLM research preferred.
• Python programming
• Generative AI knowledge
• Understanding of MCP servers and LangChain frameworks

About US Tech Solutions

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Recruiter Details

Email: [e-mail]

Job details

• Seniority level: Associate
• Employment type: Contract
• Job function: Research
• Industries: Software Development