Software Engineer - Large Language Models

Fastino Labs; San Francisco (CA); Remote; GBP 65,000 - 90,000; Full time

Job summary

A leading AI research company in the United Kingdom is looking for skilled individuals to join their innovative team. The role focuses on developing next-generation AI products, optimizing language models, and implementing cutting-edge research methodologies. The ideal candidate will have experience with large-scale AI training, a strong academic background in Computer Science or a related field, and proficiency in deep learning frameworks. This position offers a remote work option along with opportunities for travel to the Silicon Valley office.

Qualifications

• Great velocity for building and shipping AI products.
• Advanced degree in AI/ML or related field preferred.
• Experience in independent research is a plus.
• Industry experience in deep learning model training is advantageous.
• Proficiency in leading deep learning frameworks.

Responsibilities

• Experiment with novel language model architectures.
• Optimize multimodal models for performance metrics.
• Architect data processing pipelines to ensure training quality.
• Implement reinforcement learning techniques for alignment.
• Build evaluations based on real-world motivations.
• Partner with the engineering team to ship model updates.
• Establish best practices for coding and documentation.

Skills

Building and shipping AI products

Deep learning

Independent research

Experience with large-scale model training

Technical proficiency in AI frameworks

Education

Master's or PhD in Computer Science or related field

Tools

PyTorch

JAX

TensorFlow

Job description

Full-time | Remote with trips to Silicon Valley office | Reports to Founders

Introduction

• Join us at Fastino as we build the next generation of LLMs. Our team, boasting alumni from Google Research, Apple, Stanford, and Cambridge is on a mission to develop specialized, efficient AI.
• Fastino's GLiNER family of open source models has been downloaded more than 5 million times and is used by companies such as NVIDIA, Meta, and Airbnb
• Fastino has raised $25M (as featured in TechCrunch) through our seed round and is backed by leading investors including Microsoft, Khosla Ventures, Insight Partners, Github CEO Thomas Dohmke, Docker CEO Scott Johnston, and others.

What You’ll Work On

• Experiment with novel language model architectures, helping drive and execute Fastino's research roadmap
• Optimize Fastino’s multimodal models to improve response quality, instruction adherence, and overall performance metrics
• Architect data processing pipelines, implementing filtering, balancing, and captioning systems to ensure training data quality across diverse content categories
• Implement reinforcement learning techniques including Direct Preference Optimization and Generalized Reward Preference Optimization to align model outputs with human preferences and quality standards
• Build robust and real-world motivated evaluations
• Partner with Fastino engineering team to ship model updates directly to customers
• Establish best practices for code health and documentation on the team, to facilitate collaboration and reliable development

What We’re Looking For

• Required - Great velocity for building and shipping agents / AI products.
• Optional - Advanced degree (Master's or PhD) in Computer Science, Artificial Intelligence, Machine Learning, or related technical discipline with concentrated study in deep learning and computer vision methodologies
• Optional - Demonstrated ability to do independent research in Academic or Industry settings
• Optional - Substantial industry experience in large-scale deep learning model training, with demonstrated expertise in at least one of Large Language Models, Vision-Language Models, Diffusion Models, or comparable generative AI architectures
• Optional - Comprehensive technical proficiency and practical experience with leading deep learning frameworks, including advanced competency in one of PyTorch, JAX, TensorFlow, or equivalent platforms for model development and optimization