Deep Learning Research Engineer

Plumerai; Greater London; On-site; GBP 90,000 - 140,000; Full time

Benefits offered by this job

Relocation assistance

Generous equity stake

Choose your own laptop

25 days paid vacation

Attend top research conferences

Job summary

Plumerai in London is seeking a Deep Learning Research Engineer to build state-of-the-art AI for embedded devices. You will develop training algorithms, multimodal LLMs, data pipelines, and novel model architectures for on-device and cloud deployments.

You will collaborate with a world-class team, leverage Kubernetes, GPUs on GCP, and prototype demos with Streamlit. Flexible hours with 2 fixed office days per week in London or Amsterdam.

Qualifications

• +5 years of professional software engineering experience with Python.
• Comfortable with frameworks such as PyTorch, TensorFlow, Keras, or JAX.
• Strong experience with computer vision and multimodal LLMs.
• Trained neural networks that moved into production.

Responsibilities

• Use and improve multimodal LLMs to deliver new features for customers, optimizing deployments (cloud and edge).
• Train and design accurate models for low-cost, low-power hardware; improve tiny CV models.
• Improve data pipelines, model architectures and training software; apply novel approaches.
• Deploy training jobs on Kubernetes; build datasets with Snowflake/Dataflow; prototype demos with Streamlit; train on GPUs on GCP.

Skills

Python

PyTorch

TensorFlow

Keras

JAX

Computer vision

Multimodal LLMs

Production deployment

Tools

Kubernetes

Snowflake

Dataflow

Streamlit

Job description

Location: London (UK)

At Plumerai, we make it easy and affordable for developers to add highly accurate AI to their camera devices, enabling them to create amazing new products. Major brands deploy our advanced computer vision models on millions of smart home cameras in the field and we’re rapidly expanding into other sectors, such as commercial security, elderly care and retail. We combine our on-device Tiny AI software with our cloud-based Vision Language Models, to provide our customers with powerful AI features, including People Detection, Video Search, Familiar Face Identification, AI Captions and more. We prioritize on-device inference, to enable low-power, super-efficient and private AI products. Plumerai leads on accuracy, even when compared to large players, such as Google Nest.

Our team is based in London and Amsterdam. We have recently raised funding to provide multiple years of runway, while our recurring revenue is growing rapidly. We are backed by world-class investors such as Tony Fadell (creator of iPod, iPhone; founder of Nest), Hermann Hauser (founder of Arm), Zoubin Ghahramani (Google DeepMind), and others. Our team is growing fast and it’s an exciting time to join!

Learn more here: Plumerai

Read more: TechCrunch, Series A funding announcement

Role description

We are looking for a Deep Learning Research Engineer that can help us develop state of the art AI products. This can involve anything from improving our training algorithms, training and integrating multimodal LLMs, building our data pipeline, designing new model architectures to using tried and tested ML approaches and coming up with clever algorithms. You will help us build new AI features that will be shipped to millions of camera devices in the field. Together we are building the most advanced AI for embedded devices.

What you will be doing

• We combine our Tiny AI with multimodal LLMs to enable our advanced AI features for our customers. You will use and improve multimodal LLMs to achieve new functionality for our customers and optimize their deployments (cloud and edge).
• Some of our deep learning models are truly tiny - the memory footprint of our smallest computer vision model is just 1MB. You will train and design more accurate models, while also enabling new and more complex AI applications on low-cost and low-power hardware.
• You will improve our data pipeline, model architectures and training software. Sometimes there is relevant literature available, but novel approaches and clever hacks are often required for the problems that we are working on.
• You will use our Kubernetes cluster to deploy PyTorch and TensorFlow training jobs, Snowflake and Dataflow to build datasets, tools like Streamlit to prototype new demos (try one of our live demos here) and lots of GPUs on GCP for training new models and auto-labeling data.

What You Need

• +5 years of professional software engineering experience with proficiency in Python.
• Comfortable with frameworks such as PyTorch, TensorFlow, Keras, or JAX.
• Strong experience with computer vision and multimodal LLMs.
• Trained neural networks that moved into production.

Nice To Have

• Industry experience with efficient inference deployments (cloud or edge).
• Experience with Deep Reinforcement Learning.

We only consider applicants who are currently based in, or willing to relocate to, London or Amsterdam. We have flexible working hours and work together from our offices on at least 2 fixed days per week.

What we offer

• Competitive salary.
• Generous equity stake in the company.
• Relocation assistance.
• Choose your own laptop and equipment.
• 25 days of paid vacation time in addition to bank holidays.
• Ability to attend top research conferences like NeurIPS, ICML and CVPR.

Process

Talent Screen

Technical Round I

Technical Round II

Cross Team & Executive Interview