Senior Software Engineer – Local AI

Jobtailor; California (MO); On-site; USD 140,000 - 210,000; Full time

Job summary

Jobtailor is seeking a seasoned AI software engineer to advance AI inference on RTX and DGX platforms, focusing on optimizing performance of AI models and inference runtimes on GPU architectures. You will collaborate with NVIDIA teams and industry partners, driving innovations in open and closed source technologies with emphasis on system-level support.

Required are 5+ years in AI inference pipelines, strong C++ skills, and expertise with ML/DL frameworks such as ONNX RT, PyTorch, TensorRT,

Qualifications

• Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field (or equivalent experience).
• Excellent C++ programming and debugging skills with a strong understanding of data structures and algorithms.
• 5+ years of experience with proficiency in AI inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch, Tensor RT, llama.cpp and vLLM.
• Strong analytical and problem-solving abilities, with the ability to multitask effectively in a dynamic environment.
• Outstanding written and oral communication skills enabling effective collaboration with management and engineering teams.

Responsibilities

• Partner with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for AI ecosystem on RTX and DGX PCs.
• Collaborate closely with industry partners to advance AI across critical domains by driving innovations in open and closed source technologies with emphasis on system-level support.
• Improve performance on current and next-generation GPU architectures by analyzing and optimizing AI models, data processing pipelines, and inference runtime features.
• Identify, evaluate, and implement compute and memory optimization techniques—quantization, distillation, and pruning—for large AI models; fine-tune and compress models for edge devices.

Skills

C++ Programming

AI Inference Pipelines

ML/DL Frameworks

Data Structures

Algorithms

Communication Skills

Analytical Thinking

Education

Bachelor/Master/PhD in CS/SE/Math

Tools

ONNX RT

PyTorch

TensorRT

llama.cpp

vLLM

Job description

• Partnering with NVIDIA software, research, architecture, and product teams to align strategies and technical needs for fostering the ecosystem of AI on RTX and DGX PCs.


• Collaborate closely with industry partners to advance AI across critical domains—including graphics, web browsers, and edge devices—by driving innovation in both open and closed source technologies with emphasis on system level support.


• Improving performance on current and next-generation GPU architectures by conducting in-depth analysis and end-to-end optimization of AI models, data processing pipelines, and inference runtime features.


• Identifying, evaluating, and implementing compute and memory optimization techniques—such as quantization, distillation, and pruning—for large AI models; fine-tuning and compressing models to fit edge devices.

Requirements

• Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field (or equivalent experience).


• Excellent C++ programming and debugging skills with a strong understanding of data structures and algorithms.


• 5+ years of experience with proficiency in AI inferencing pipelines and applications using ML/DL frameworks, including ONNX RT, PyTorch, Tensor RT, llama.cpp and vLLM.


• Strong analytical and problem-solving abilities, with the ability to multitask effectively in a dynamic environment.


• Outstanding written and oral communication skills enabling effective collaboration with management and engineering teams.

Core Competencies

Demonstrates expertise in AI model optimization and performance enhancement on GPU architectures, with strong proficiency in C++ programming and ML/DL frameworks. Capable of collaborating effectively with cross-functional teams to drive innovation in AI technologies.

Highest-signal resume keywords

• C++ Programming


• AI Inferencing Pipelines


• ML/DL Frameworks


• Performance Optimization


• Data Structures and Algorithms

ATS Optimization Keywords

Hard Skills

• C++ Programming


• Data Structures


• Algorithms


• AI Model Optimization


• Quantization


• Distillation


• Pruning


• End-to-End Optimization


• Inference Runtime Features


• Multitasking

Soft Skills

• Analytical Abilities


• Problem-Solving


• Written Communication


• Oral Communication


• Collaboration

Industry Keywords

• AI Ecosystem


• GPU Architectures


• Edge Devices


• Open Source Technologies


• Closed Source Technologies

Tools & Technologies

• ONNX RT


• PyTorch


• Tensor RT


• Llama.cpp


• VLLM