Edge AI Inference Engineer (C++/Llama ggml)

ITRex Group; United States; Remoto; USD 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Remote flexibility

Medical benefits

Learning budget

Descrizione del lavoro

ITRex Group is seeking a hands-on C++ engineer to develop and optimize the on-device AI stack. You will port and enhance inference engines such as llama.cpp or ggml to run efficiently on edge devices and across different hardware, focusing on runtime, model loading, and performance.

This role suits engineers who enjoy low-level work and private, fast AI without cloud dependence. You’ll collaborate with researchers to translate research into production and enrich products with the latest ML

Competenze

• Proficiency in C++ with strong systems programming background.
• Experience with AI/ML concepts, transformers, and LLMs is preferred.
• Familiarity with edge devices and on-device inference frameworks.

Mansioni

• Deploy ML models to edge devices using llama.cpp and ggml frameworks.
• Collaborate with researchers to move models from research to production environments.
• Integrate AI features into existing products and optimize runtime performance.
• Ensure stability and performance of the inference layer across hardware platforms.
• Demonstrate ability to assimilate new technologies quickly.

Conoscenze

C++

JavaScript

Llama.cpp

ggml

Deep learning

Transformers/LLMs

Edge AI

Formazione

B.Sc. in Computer Science/AI/ML

Strumenti

llama.cpp

ggml

Descrizione del lavoro

ITRex Group is seeking a hands-on C++ engineer to develop and optimize the on-device AI stack. You will port and enhance inference engines such as llama.cpp or ggml to run efficiently on edge devices and across different hardware, focusing on runtime, model loading, and performance.

This role suits engineers who enjoy low-level work and private, fast AI without cloud dependence. You’ll collaborate with researchers to translate research into production and enrich products with the latest ML