ML Hardware Engineer: Custom Hardware Inference

Fintal Partners

New York (NY)

On-site

USD 140,000 - 190,000

Full time

4 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Fintal Partners in New York seeks an experienced Hardware Machine Learning Engineer to deploy ML directly on custom hardware, including FPGA/ASIC paths. You will architect ML models with latency budgets and work across traders, researchers, and software engineers.

You will shape hardware roadmaps, translate model requirements into architectural decisions, and implement inference solutions from proof-of-concept through production with hardware teams.

Qualifications

  • Advanced degree in EE/CS/Physics or related field.
  • Experience mapping ML models to hardware (FPGA/ASIC) for latency/throughput.
  • Proficient in Python and C++, with exposure to ML frameworks.
  • Familiar with ML compiler infrastructures and hardware-aware optimization.
  • Strong communication and cross-disciplinary collaboration skills.

Responsibilities

  • Architect and co-design ML models with traders and engineers, considering hardware constraints.
  • Translate ML requirements into concrete architectural decisions for custom hardware.
  • Deploy ML inference solutions from proof-of-concept to production with hardware teams.
  • Stay current with research in neural architecture search, ML systems, and quantization.

Skills

Hardware constraint mapping
VHDL/SystemVerilog
ML frameworks (PyTorch/TensorFlow)
Python
C++
Cross-functional collaboration

Education

MS or PhD in EE/CS/Physics

Tools

hls4ml
FINN
Vitis AI
MLIR
TVM/XLA

Job description

Fintal Partners in New York seeks an experienced Hardware Machine Learning Engineer to deploy ML directly on custom hardware, including FPGA/ASIC paths. You will architect ML models with latency budgets and work across traders, researchers, and software engineers.

You will shape hardware roadmaps, translate model requirements into architectural decisions, and implement inference solutions from proof-of-concept through production with hardware teams.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior ML Engineer: Hardware-Optimized Inference
Senior ML Engineer: Hardware-Optimized Inference

Fintal Partners • Chicago (IL)

On-site
USD 140,000 - 200,000
Machine Learning Hardware Engineer
Machine Learning Hardware Engineer

Fintal Partners • New York (NY)

On-site
USD 140,000 - 190,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Fintal Partners • Chicago (IL)

On-site
USD 140,000 - 200,000
Hardware Machine Learning Engineer
Hardware Machine Learning Engineer

IMC Trading • Chicago (IL)

On-site
USD 200,000 - 225,000
Discretionary bonus
Paid leave
Insurance benefits
Hardware Machine Learning Engineer
Hardware Machine Learning Engineer

IMC Trading • New York (NY)

On-site
USD 200,000 - 225,000
Discretionary bonus
Paid leave
Insurance benefits
ML Architect for Custom Hardware & Inference
ML Architect for Custom Hardware & Inference

IMC Trading • New York (NY)

On-site
USD 200,000 - 225,000
High-Performance ML Inference Engineer (Hybrid)
High-Performance ML Inference Engineer (Hybrid)

Long Ridge Partners • New York (NY)

On-site
USD 600,000 - 1,500,000
Hybrid working options
Free meals (breakfast, lunch)
Wellness reimbursement
+2
Hardware ML Architect for Custom AI Accelerators
Hardware ML Architect for Custom AI Accelerators

IMC Trading • Chicago (IL)

On-site
USD 200,000 - 225,000
Discretionary bonus
Paid leave
Insurance benefits
Senior ML Inference Engineer - Custom Hardware, LLMs
Senior ML Inference Engineer - Custom Hardware, LLMs

Socket.dev • Cupertino (CA)

On-site
USD 193,000 - 262,000
Low-Latency ML Inference Engineer
Low-Latency ML Inference Engineer

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000