Machine Learning Operations Engineer - UK

DraftWise; United Kingdom; Remote; GBP 35,000 - 46,000; Full time

Job summary

Join a leading company as a Machine Learning Operations Engineer, contributing to innovative AI solutions for legal contract analysis. Collaborate with a talented team to enhance a state-of-the-art platform, ensuring high-quality outputs and operational excellence. Enjoy a remote-first work environment with competitive salary and equity options.

Benefits

Remote-first work style

Meaningful equity plan

Competitive salary

Private medical care

Work-from-home stipend

Unlimited PTO and sick leave

Qualifications

• At least 2 years of relevant experience in ML Ops.
• Experience with large language models (LLMs) and evaluation pipelines.

Responsibilities

• Improve and maintain the legal evaluation platform.
• Develop an automated system for monitoring LLM outputs.
• Design a load balancing framework for API calls.

Skills

Python

Flask

Analytical Skills

Job description

Machine Learning Operations Engineer - UK

Join to apply for the Machine Learning Operations Engineer - UK role at DraftWise

Machine Learning Operations Engineer - UK

1 hour ago Be among the first 25 applicants

Join to apply for the Machine Learning Operations Engineer - UK role at DraftWise

This range is provided by DraftWise. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

About DraftWise

DraftWise is revolutionizing the legal industry with an innovative knowledge platform that transforms how lawyers and legal professionals work. Our products unlock, for the first time, years of historic legal contracts negotiated by firms for their clients and seamlessly integrate generative AI into the workflows of transactional attorneys. By leveraging cutting-edge data management, machine learning, generative AI, and language analytics, we empower legal professionals to draft better, safer contracts with unprecedented efficiency.

Our founding team brings together former Palantir and Google engineers, alongside an experienced lawyer from a top global law firm. This diverse combination of expertise in engineering, product development, and customer success enables us to deliver industry-leading solutions. While DraftWise operates as a fully remote company, we also provide coworking opportunities in hubs across New York City and London, with plans to expand to additional cities as we grow density in new regions. We are committed to hiring the best talent globally, fostering a culture of respect, collaboration, and excellence.

Backed by Y Combinator and prominent venture capital funds, including a Series A funding round led by Index Ventures with participation from Earlybird Ventures (now Bek Ventures), DraftWise is already generating revenue from some of the most prestigious law firms in the world. Our clients include members of the Vault 10, Magic Circle, AMLAW 100, and other top-tier legal rankings. Our rapid growth spans multiple countries, with further expansions underway.

Following our recent fundraise, we are investing in critical functions and scaling our team to meet rising demand. Joining DraftWise means working alongside a highly talented team to deliver outstanding results for our customers and making a tangible impact on the world’s most influential law firms.

What we value

• Strong communication skills in an open environment.
• The ability to work independently and make informed decisions with minimal supervision.
• Interest in working in a dynamic environment with dynamic objectives.
• A commitment to autonomy, ownership, and delivering high-quality solutions.
• Openness to giving and receiving constructive feedback.
  
  

About This Role

We are seeking a Machine Learning Operations (ML Ops) Engineer to contribute to the development of cutting-edge AI solutions for legal contract analysis. You will be part of our growing ML team, working closely with our ML engineer, NLP engineer and Backend engineers.

Key Responsibilities

• Improving and maintaining our legal evaluation platform:
• Drive continuous enhancements to our state-of-the-art legal evaluation platform by developing innovative evaluation frameworks and ensuring its robust, scalable, and precise operation.
• Collaborate closely with cross-functional teams to create new methodologies that empower our legal experts to rigorously assess LLM output quality while ensuring the platform remains adaptive to evolving challenges and technological advances.
• Establishing a Continuous Auto-Evaluation Framework:
• Develop and deploy an automated system that continuously monitors and validates our LLM outputs against stringent quality thresholds.
• Incorporate real-time performance metrics, anomaly detection, and proactive remediation triggers—ensuring that any dip in response quality is promptly identified and corrected.
• Integrate feedback loops that sustain our commitment to excellence, thereby ensuring our platform maintains consistently high standards.
• Designing a Load Balancing Framework for LLM API Calls:
• Architect and deploy a dynamic load balancing system that intelligently distributes API calls across multiple LLM endpoints.
• Implement robust fallback mechanisms to automatically reroute traffic when an LLM instance is down or reaching usage quotas.
• Integrate real-time health monitoring and performance analytics to assess endpoint availability and adjust routing in real time.
• Deploying and Maintaining Proprietary LLM Models with Training and Fine-Tuning Support:
• Deploy and scale in-house LLM models to ensure reliable and high-performance operations tailored to our unique legal evaluation needs.
• Establish automated pipelines that streamline the training, fine-tuning, and deployment processes, ensuring continuous model improvement and adaptation.
• Collaborate closely with ML and NLP teams to integrate the latest techniques, rigorous evaluation metrics, and industry best practices into the training workflow.
• Implement proactive monitoring and maintenance protocols to quickly identify and address performance bottlenecks or operational issues.
  

About You

We're looking for teammates who possess:

• Proven expertise in Python with hands-on experience using Flask, along with a willingness to explore and adapt to new frameworks when necessary.
• A robust background in deploying, maintaining, and fine-tuning ML models, with a focus on developing automated evaluation and load balancing frameworks.
• Demonstrated experience in working with large language models (LLMs) and establishing continuous auto-evaluation pipelines. For example, you may have built systems that monitor key performance metrics (e.g., latency, quality scores) in real time, or used an open-source framework such as DeepEval or Phoenix.
• At least 2 years of relevant experience, ideally within startup environments, showcasing a resourceful and proactive approach to addressing evolving challenges.
• The ability to work closely with ML, NLP, and backend engineers to drive cutting-edge AI solutions tailored for legal contract analysis.
• While not a necessity, basic knowledge of HTML/JS is a plus, enhancing your contributions within a full-stack development context.
• A customer-centric approach coupled with strong analytical skills to ensure the platform's robust, scalable, and precise operation.
  
  

What We Offer

• Remote-first work style: Work anywhere in Europe.
• Meaningful equity plan, giving you a stake in our growth.
• Competitive salary to reward your expertise.
• Private medical care to support your well-being.
• A new laptop and a work-from-home stipend for necessary accessories.
• Unlimited PTO and sick leave to prioritize work-life balance.
• The opportunity to shape our company and disrupt the legal world.

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at DraftWise by 2x

Get notified about new Machine Learning Engineer jobs in United Kingdom.

London, England, United Kingdom 8 months ago

London, England, United Kingdom 2 days ago

London, England, United Kingdom 2 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 1 week ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 10 months ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 10 months ago

London, England, United Kingdom $35,000.00-$46,000.00 1 day ago

Manchester, England, United Kingdom 2 weeks ago

Bristol, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 week ago

Birmingham, England, United Kingdom 3 weeks ago

London, England, United Kingdom 1 month ago

London, England, United Kingdom 3 weeks ago

London, England, United Kingdom 10 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.