Edge AI Inference Engineer — C++ & Production ML

ITRex Group; Town of Poland (NY); Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

Remote flexibility

Competitive salary and medical benefits

Career progression opportunities

Job summary

ITRex Group in the Town of Poland, NY, is seeking a C++ Engineer focused on deploying and optimizing AI models for production. The ideal candidate should have a solid background in Modern C++, along with experience in AI inference frameworks.

This role offers flexibility, competitive compensation, and opportunities for personal and professional growth in a supportive team environment.

Qualifications

• 4+ years of professional experience in Modern C++.
• Strong debugging skills for low-level issues.
• Experience integrating machine learning models into applications.

Responsibilities

• Deploy machine learning models to edge devices.
• Collaborate with researchers on coding and transitioning models.
• Integrate AI features into existing products.

Skills

Modern C++ (C++17/20)

Memory management

Multithreading

Profiling and performance optimization

Tools

llama.cpp

ggml

ONNX Runtime

TensorRT

OpenVINO

Job description

ITRex Group in the Town of Poland, NY, is seeking a C++ Engineer focused on deploying and optimizing AI models for production. The ideal candidate should have a solid background in Modern C++, along with experience in AI inference frameworks.

This role offers flexibility, competitive compensation, and opportunities for personal and professional growth in a supportive team environment.