AI Inference Engineer — GPU-Optimized Rust/Python (Equity)

CVFine by Instrovate Technologies; Greater London; Sur place; GBP 70 000 - 90 000; Plein temps

Résumé du poste

CVFine by Instrovate Technologies in Greater London is seeking an AI Inference Engineer. The role involves supporting transformer-based models, migrating GPU kernels, and developing a Rust-based inference server.

Candidates should have extensive experience in GPU programming and ML systems. The position offers opportunities for performance optimization and reliability improvements. Additional work in ML compilers and frameworks is a plus, making this an ideal role for proficient software engineers.

Qualifications

• 3+ years of professional software engineering experience with meaningful work on ML inference or high-performance systems.
• Familiarity with at least one deep learning framework (PyTorch, JAX, TensorFlow).
• Understanding of GPU architectures (memory hierarchy, warp scheduling, tensor cores).
• Understanding of common LLM architectures and inference optimization techniques.

Responsabilités

• Support transformer-based retrieval, text-generation, and multimodal models.
• Port CUDA kernels to NVIDIA's CuTe DSL.
• Develop Rust-based inference server.
• Profile and fix bottlenecks from network ingress.
• Build dashboards, alerts, and automated remediation.

Description du poste

CVFine by Instrovate Technologies in Greater London is seeking an AI Inference Engineer. The role involves supporting transformer-based models, migrating GPU kernels, and developing a Rust-based inference server.

Candidates should have extensive experience in GPU programming and ML systems. The position offers opportunities for performance optimization and reliability improvements. Additional work in ML compilers and frameworks is a plus, making this an ideal role for proficient software engineers.