High-Performance ML Inference Engineer for Markets

Fintal Partners; New York (NY); On-site; USD 140,000 - 220,000; Full time

Job summary

Fintal Partners in New York seeks a Machine Learning Engineer focused on inference to join a technically driven AI research team building and deploying large-scale models for financial markets. You will design high-performance inference systems, optimize GPU kernels with CUDA, Triton and related tools, and collaborate with researchers to deliver low-latency, reliable model serving for live trading.

This role blends ML, systems engineering and high-performance computing in a fast-paced, global

Qualifications

• 2+ years of professional experience building deep learning or machine learning systems.
• Strong software engineering and systems fundamentals.
• Experience building deep learning systems in computationally intensive domains.
• Ability to translate techniques and approaches across different machine learning domains.

Responsibilities

• Design and optimize high-performance inference systems for large-scale deep learning models.
• Develop and optimize GPU kernels using CUDA, Triton, Pallas, CuTe DSL, and related technologies
• Improve lower-level performance across PyTorch, JAX, XLA, and CUDA Graphs
• Explore and develop inference solutions across GPUs, ASICs, and FPGAs
• Optimize data streaming and model-serving infrastructure for demanding real-time environments
• Work closely with ML researchers to co-design efficient inference architectures
• Improve latency, throughput, hardware utilization, and overall inference efficiency
• Help shape the team’s broader machine learning and systems research agenda

Job description

Fintal Partners in New York seeks a Machine Learning Engineer focused on inference to join a technically driven AI research team building and deploying large-scale models for financial markets. You will design high-performance inference systems, optimize GPU kernels with CUDA, Triton and related tools, and collaborate with researchers to deliver low-latency, reliable model serving for live trading.

This role blends ML, systems engineering and high-performance computing in a fast-paced, global