Senior Software Engineer — Open-Source AI Inference & vLLM

CommonAI CIC; Cambridge; On-site; GBP 70,000 - 90,000; Full time

Benefits offered by this job

Collaborative work environment

Professional development opportunities

Competitive salary and pension

Job summary

CommonAI CIC is seeking a Senior Software Engineer in Cambridge to deploy and optimize AI infrastructure, particularly vLLM. The ideal candidate will have expertise in Python and low-level programming languages, along with hands-on experience in high-performance open-source projects. This role emphasizes collaboration with the open-source community and aims to enhance AI coding and deployment efficiency.

We offer a supportive work environment, competitive salary, and opportunities for professional development in a vibrant office located conveniently close to Cambridge train station.

Qualifications

• Proven experience as a Senior Software Engineer with expertise in Python and low-level programming.
• Direct contributions to vLLM or similar high-performance open-source projects.
• Strong understanding of LLM inference mechanics.

Responsibilities

• Deploy, instrument and monitor open weight models served using vLLM.
• Implement new features within vLLM for novel hardware architectures.
• Collaborate with the open-source vLLM community to enhance core functionalities.

Skills

Python

C/C++

Rust

CUDA

LLM inference mechanics

Tools

vLLM

PyTorch

TensorRT-LLM

Job description

CommonAI CIC is seeking a Senior Software Engineer in Cambridge to deploy and optimize AI infrastructure, particularly vLLM. The ideal candidate will have expertise in Python and low-level programming languages, along with hands-on experience in high-performance open-source projects. This role emphasizes collaboration with the open-source community and aims to enhance AI coding and deployment efficiency.

We offer a supportive work environment, competitive salary, and opportunities for professional development in a vibrant office located conveniently close to Cambridge train station.