AI Inference Engineer — GPU-Optimized Rust/Python (Equity)

CVFine by Instrovate Technologies; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

CVFine by Instrovate Technologies in Greater London is seeking an AI Inference Engineer. The role involves supporting transformer-based models, migrating GPU kernels, and developing a Rust-based inference server.

Candidates should have extensive experience in GPU programming and ML systems. The position offers opportunities for performance optimization and reliability improvements. Additional work in ML compilers and frameworks is a plus, making this an ideal role for proficient software engineers.

Qualifications

• 3+ years of professional software engineering experience with meaningful work on ML inference or high-performance systems.
• Familiarity with at least one deep learning framework (PyTorch, JAX, TensorFlow).
• Understanding of GPU architectures (memory hierarchy, warp scheduling, tensor cores).
• Understanding of common LLM architectures and inference optimization techniques.

Responsibilities

• Support transformer-based retrieval, text-generation, and multimodal models.
• Port CUDA kernels to NVIDIA's CuTe DSL.
• Develop Rust-based inference server.
• Profile and fix bottlenecks from network ingress.
• Build dashboards, alerts, and automated remediation.

Job description

CVFine by Instrovate Technologies in Greater London is seeking an AI Inference Engineer. The role involves supporting transformer-based models, migrating GPU kernels, and developing a Rust-based inference server.

Candidates should have extensive experience in GPU programming and ML systems. The position offers opportunities for performance optimization and reliability improvements. Additional work in ML compilers and frameworks is a plus, making this an ideal role for proficient software engineers.