Inference Engineer: Foundations for Market AI

Wehrtyou; New York (NY); On-site; USD 250,000 - 300,000; Full time

Job summary

Hudson River Trading is seeking an AI Research Engineer (Inference) to join the HAIL team, focused on building and deploying foundation models for markets. You will work on large-scale model inference across devices, GPUs, ASICs, FPGAs, and streaming data to meet diverse trading needs.

You will collaborate with researchers to co-design models, improve inference performance, and drive the research agenda in a fast-paced, globally distributed environment.

Qualifications

• Strong engineering skills with low-level DL systems experience.
• Two+ years building deep learning systems across domains.
• Experience translating methods between areas of application is valued.
• LLM experience is valuable but not required.
• Finance experience is not required.

Responsibilities

• Improve all aspects of large-scale model inference.
• Develop GPU kernels and novel inference devices (ASIC/FPGA).
• Collaborate with researchers to co-design and shape the research agenda.

Skills

CUDA kernel development

Triton

Pallas

CuTe DSL kernel

PyTorch

JAX

XLA

FPGA/ASIC experience

Tools

CUDA Toolkit

PyTorch

JAX

XLA

FPGA tooling

Job description

Hudson River Trading is seeking an AI Research Engineer (Inference) to join the HAIL team, focused on building and deploying foundation models for markets. You will work on large-scale model inference across devices, GPUs, ASICs, FPGAs, and streaming data to meet diverse trading needs.

You will collaborate with researchers to co-design models, improve inference performance, and drive the research agenda in a fast-paced, globally distributed environment.