Remote Python Inference Engineer for Edge AI & GPUs

Gcore; Polska; Hybride; PLN 466 000 - 700 000; Plein temps

Avantages offerts par ce poste

Competitive compensation

Flexible working hours

Hybrid or remote options

Work from anywhere up to 45 days/yr

Private medical insurance for you and/

Extra paid vacation and sick leave

Language courses

Modern offices with snacks

Team sports and social activities

Résumé du poste

Gcore is seeking a Python Inference Engineer to join our Edge Cloud&AI Team. You’ll build and optimize the inference layer, integrate vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM, and bring new models into production across a global AI platform.

You’ll work on improving latency, throughput, memory usage, and GPU utilization while collaborating with platform, infra, and product teams. A strong interest in inference engineering and open to learning is essential.

Qualifications

• 5+ years of experience writing reliable, well-tested production code.
• Strong Python skills and experience designing production systems.
• Hands-on experience with PyTorch and deploying machine learning models.
• Experience with Linux, Docker, and Kubernetes.
• Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.

Responsabilités

• Build and improve the inference layer of the Gcore Inference platform.
• Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
• Bring new language and multimodal models into production.
• Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
• Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.
• Work with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.
• Contribute improvements to open-source inference projects when appropriate.

Connaissances

Python

5+ years

PyTorch

Linux

Docker

Kubernetes

Distributed systems

GPU computing

Model optimization

Debugging

Communication

Willing to learn inference engines

Outils

CUDA

Triton

TensorRT

vLLM

SGLang

NVIDIA Dynamo

Description du poste

Gcore is seeking a Python Inference Engineer to join our Edge Cloud&AI Team. You’ll build and optimize the inference layer, integrate vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM, and bring new models into production across a global AI platform.

You’ll work on improving latency, throughput, memory usage, and GPU utilization while collaborating with platform, infra, and product teams. A strong interest in inference engineering and open to learning is essential.