AI Inference Engineer (100% Worldwide)

Tether.io; United States; Remote; USD 110,000 - 170,000; Full time

Job summary

Tether is hiring an AI engineer to work on the C++ layer powering local AI, porting and enhancing inference engines for edge devices. You will optimize loading, runtime efficiency, and cross-hardware performance to enable private on-device AI without cloud reliance.

Collaborate with researchers to move models from research to production, deploy ML models to edge devices, and integrate AI features into existing products with the latest ML advances.

Qualifications

• Experience with Llama.cpp and ggml inference engines.
• Understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Degree in Computer Science, AI, ML, or related field.

Responsibilities

• Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, ONNX
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning

Skills

Llama.cpp

ggml

Transformers

LLMs

Education

CS/AI degree or related field

Tools

llama.cpp

ggml

ONNX

Job description

Join Tether and Shape the Future of Digital Finance

At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from exchanges and wallets to payment processors and ATMs—to seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction.

Innovate with Tether

Tether Finance: Our innovative product suite features the world’s most trusted stablecoin, USDT, relied upon by hundreds of millions worldwide, alongside pioneering digital asset tokenization services.

But that’s just the beginning:

Tether Power: Driving sustainable growth, our energy solutions optimize excess power for Bitcoin mining using eco-friendly practices in state-of-the-art, geo-diverse facilities.

Tether Data: Fueling breakthroughs in AI and peer-to-peer technology, we reduce infrastructure costs and enhance global communications with cutting-edge solutions like KEET, our flagship app that redefines secure and private data sharing.

Tether Education: Democratizing access to top-tier digital learning, we empower individuals to thrive in the digital and gig economies, driving global growth and opportunity.

Tether Evolution: At the intersection of technology and human potential, we are pushing the boundaries of what is possible, crafting a future where innovation and human capabilities merge in powerful, unprecedented ways.

Why Join Us?

Our team is a global talent powerhouse, working remotely from every corner of the world. If you’re passionate about making a mark in the fintech space, this is your opportunity to collaborate with some of the brightest minds, pushing boundaries and setting new standards. We’ve grown fast, stayed lean, and secured our place as a leader in the industry.

If you have excellent English communication skills and are ready to contribute to the most innovative platform on the planet, Tether is the place for you.

Are you ready to be part of the future?

About the job

You'll work on the C++ layer that powers local AI, porting and enhancing inference engines like llama.cpp, ONNX and similar, to run efficiently on edge devices. Your focus is on the runtime: making models load faster, run leaner, and perform well across different hardware. You'll ensure that the inference layer is stable, optimized, and ready for integration with the rest of the stack.

This role is for engineers who want to work close to the metal, enabling private and fast on-device AI without relying on cloud infrastructure.

Responsibilities

Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, ONNX

Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments

Integrate AI features into existing products, enriching them with the latest advancements in machine learning

Job requirements

• Strong experience with Llama.cpp and ggml inference engines, which facilitates the deployment of models to specific GPU architectures
• Good understanding of deep learning concepts and model architectures
• Experience with transformers and LLMs
• Demonstrated ability to rapidly assimilate new technologies and techniquesA degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D

Important information for candidates

Recruitment scams have become increasingly common. To protect yourself, please keep the following in mind when applying for roles:

• Apply only through our official channels. We do not use third-party platforms or agencies for recruitment unless clearly stated. All open roles are listed on our official careers page: https://tether.recruitee.com/
• Verify the recruiter’s identity. All our recruiters have verified LinkedIn profiles. If you’re unsure, you can confirm their identity by checking their profile or contacting us through our website.
• Be cautious of unusual communication methods. We do not conduct interviews over WhatsApp, Telegram, or SMS. All communication is done through official company emails and platforms.
• Double-check email addresses. All communication from us will come from emails ending in @tether.to or @tether.io
• We will never request payment or financial details. If someone asks for personal financial information or payment at any point during the hiring process, it is a scam. Please report it immediately.

When in doubt, feel free to reach out through our official website.