Production ML Engineer for AI Agent Infrastructure

Jobright.ai; United Kingdom; On-site; GBP 30,000 - 42,000; Full time

Job summary

Jobright.ai seeks a design-minded ML Engineer to build and maintain scalable infrastructure for deploying AI agents. You will optimize LLM pipelines, reduce latency, and ensure reliable model monitoring and CI/CD practices.

As a recent graduate with Python expertise, you will work across data ingestion, RAG architectures, and backend APIs, contributing to a fast-growing AI-powered job search platform used by real users.

Qualifications

• Recent graduate or early-career professional (0–2 years) with a degree in Computer Science, Software Engineering, or a related technical field.
• Strong proficiency in Python and experience with backend frameworks (such as FastAPI, Flask, or Django).
• Practical experience with machine learning frameworks (PyTorch or TensorFlow) and a solid understanding of software engineering best practices (version control, CI/CD, unit testing).
• Familiarity with the deployment of LLMs and an understanding of the infrastructure required to support autonomous agents.

Responsibilities

• Design, build, and maintain the scalable infrastructure required to deploy and serve production-grade AI agents.
• Implement and optimize Large Language Model (LLM) pipelines, focusing on latency reduction, throughput, and efficient resource utilization.
• Develop automated systems for model monitoring, testing, and continuous integration to ensure the reliability of our AI agents.
• Optimize data ingestion and processing layers to support real-time agent responsiveness and complex RAG (Retrieval-Augmented Generation) architectures.
• Architect and refine APIs and backend services that bridge the gap between AI models and the user-facing product.

Skills

Python

Machine Learning basics

CI/CD

SQL/NoSQL basics

Education

Bachelor's degree in Computer Science / Software Engineering

Tools

FastAPI

Flask

Django

PyTorch

TensorFlow

Docker

Kubernetes

Git

Job description

Jobright.ai seeks a design-minded ML Engineer to build and maintain scalable infrastructure for deploying AI agents. You will optimize LLM pipelines, reduce latency, and ensure reliable model monitoring and CI/CD practices.

As a recent graduate with Python expertise, you will work across data ingestion, RAG architectures, and backend APIs, contributing to a fast-growing AI-powered job search platform used by real users.