Production Support Engineer - LLM Platform

quberesearchandtechnologies

New York (NY)

On-site

USD 90,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Qube Research & Technologies in the United States is seeking a hands-on production support specialist for our platform that accesses internally hosted and external LLMs. You will provide first- and second-line support, investigate incidents, and coordinate with engineering and business users during US business hours.

Use dashboards, logs and alerts to monitor health, identify latency or error-rate problems, and perform approved recovery actions.

Qualifications

  • Experience in production or application/ platform operations with incident investigation ability.
  • Solid Linux troubleshooting skills and familiarity with Windows developer environments.
  • Proficiency in Python, Bash and/or PowerShell for checks and automation.
  • SQL experience to investigate issues and query operational records (PostgreSQL preferred).
  • Ability to interpret metrics, logs, traces and dashboards to distinguish incidents.
  • Experience troubleshooting API-driven services, including HTTP, auth, networking, timeouts and rate limits.
  • Hands-on experience with LLM-based platforms or services and LLM APIs.
  • Familiarity with AWS or other public clouds and inspecting containerised workloads.

Responsibilities

  • Provide first- and second-line production support for the LLM platform (internal and external), handling incident investigation and escalation.
  • Monitor health via dashboards, logs, and alerts; address latency, availability, and error-rate issues; execute approved recovery steps.
  • Troubleshoot gateway and model-provider issues, including auth failures, timeouts, and streaming problems.
  • Determine origin of incidents and coordinate escalation to the appropriate team or vendor.
  • Support coding assistants, API clients and developer workspaces connected to the platform.
  • Help users configure integrations and migrate API access between interfaces.
  • Perform operational checks for releases, including non-production validation and post-release testing.

Skills

Production support
Linux troubleshooting
Python
Bash/PowerShell
SQL (PostgreSQL)
Metrics/logs analysis
API troubleshooting
LLM platform experience
AWS familiarity
Effective communication
Cross-region handovers

Tools

Linux
Windows developer env
PostgreSQL
Cloud providers (AWS)

Job description

Qube Research & Technologies (QRT) is a global quantitative and systematic investment manager, operating in all liquid asset classes across the world. We are a technology and data driven group implementing a scientific approach to investing. Combining data, research, technology and trading expertise has shaped QRT's collaborative mindset which enables us to solve the most complex challenges. QRT's culture of innovation continuously drives our ambition to deliver high quality returns for our investors.

You will provide day-to-day production support for QRT's platform for accessing internally hosted and external LLMs. Based in the US, you will support users during US business hours and coordinate with colleagues in other regions to ensure effective incident handovers.

This is a hands-on support role, focused on incident resolution, user assistance and established operational procedures-not platform architecture, model development or infrastructure engineering.

Your future role within QRT:

Provide first- and second-line support for QRT's platform for accessing internally hosted and external LLMs, investigating issues raised by engineering and business users, maintaining support tickets and following issues through to resolution or engineering escalation.

Monitor platform health using existing dashboards, logs and alerts; identify availability, latency and error-rate problems and perform approved recovery actions using established runbooks.

Troubleshoot gateway and model-provider issues, including authentication failures, rate limits, timeouts, connection resets, streaming failures and regional performance differences.

Determine whether incidents originate in a user's client or configuration, the platform gateway, an internally hosted model or an external LLM provider; collect diagnostic evidence and coordinate escalation to the appropriate team or vendor.

Support coding assistants, API clients and developer workspaces connected to QRT's LLM platform, including Claude Code, Codex CLI, OpenCode, PI and Coder; investigate compatibility issues following client or vendor updates.

Help users configure supported integrations, select the appropriate regional endpoint and migrate API access from Open WebUI to the direct gateway.

Investigate access and model-availability queries, check user permissions and escalate provisioning or entitlement issues through established support and governance processes.

Carry out operational checks for releases and configuration changes, including non-production validation, post-release smoke testing and approved rollback procedures, in coordination with platform engineering.

Use existing observability tools to investigate time to first token, time per output token, percentile latency and failure rates; flag recurring issues and monitoring gaps to the platform team.

Maintain runbooks, troubleshooting guides and known-issue records; provide clear incident updates and reliable handovers between regional support teams.

Maintain small support scripts and diagnostic utilities to reduce repetitive checks and improve evidence collection.

Your present skillset:
  • Relevant experience in production support, application support or platform operations, with the ability to investigate routine incidents independently and recognise when specialist escalation is required.
  • Practical Linux troubleshooting skills and familiarity with Windows-based developer environments.
  • Working proficiency in Python, Bash and/or PowerShell for operational checks, log analysis and straightforward support automation.
  • Experience using SQL to investigate application issues and query operational records, ideally in PostgreSQL.
  • Practical experience interpreting metrics, logs, traces and dashboards to distinguish a platform-wide incident from a user-, client-, model- or region-specific issue.
  • Confidence troubleshooting API-driven services, including HTTP errors, authentication, networking, timeouts, retries, rate limiting and streaming connections.
  • Hands‑on experience supporting LLM‑based platforms or services, with a working understanding of LLM APIs, including prompts, context limits, token usage, model identifiers and streaming responses.
  • Familiarity with public‑cloud services, ideally AWS, and the ability to inspect containerised workloads using established tools and procedures.
  • Clear communication with technical and non-technical users, including concise incident updates, realistic expectations and well‑documented escalations.
  • Awareness of access controls, sensitive‑data handling and safe diagnostic practices, including avoiding exposure of prompts, credentials or confidential content in support records.
  • A methodical approach to troubleshooting, prioritisation and cross‑region handovers
Nice to have:
  • Experience supporting AWS Bedrock or other managed model APIs.
  • Experience supporting AI coding assistants, API clients or developer workspaces such as Claude Code, Codex CLI, OpenCode, PI or Coder.

F

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Platform Production Support Engineer
LLM Platform Production Support Engineer

quberesearchandtechnologies • New York (NY)

On-site
USD 90,000 - 150,000
Windows Infrastructure Operations Engineer
Windows Infrastructure Operations Engineer

quberesearchandtechnologies • New York (NY)

On-site
USD 150,000 - 200,000
Performance bonus
Benefits package
Production Support Engineer
Production Support Engineer

Luma Financial Technologies, LLC • Cincinnati (OH), New York (NY), Miami (FL)

On-site
USD 90,000 - 130,000
Customer Support Engineer - Solutions Management
Customer Support Engineer - Solutions Management

Phizenix • Livermore (CA)

On-site
USD 120,000 - 180,000
Scaled Support Specialist
Scaled Support Specialist

OpenRouter, Inc • United States

Remote
USD 120,000 - 170,000
Trading Systems Engineer
Trading Systems Engineer

quberesearchandtechnologies • New York (NY)

On-site
USD 180,000 - 300,000
Competitive benefits
Bonus potential
Senior Software Engineer - Dev Platform
Senior Software Engineer - Dev Platform

kraken.com • United States

Remote
USD 120,000 - 200,000
Customer Support Engineer - Solutions Management
Customer Support Engineer - Solutions Management

Phizenix • United States

Remote
USD 110,000 - 170,000
Senior Application Support Engineer
Senior Application Support Engineer

SkillSource • New York (NY)

On-site
USD 120,000 - 180,000
Sr. Customer Support Engineer
Sr. Customer Support Engineer

CIQ • United States

Remote
USD 120,000 - 180,000
Medical, dental, and vision insurance.
Remote work; no travel required for e{