Python Inference Engineer Edge AI & Production ML

Gcore; Poland; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Competitive compensation

Flexible working hours and hybrid or 远

Work from anywhere in the world for up

Private medical insurance for you and”

Extra paid vacation and sick leave

Support for life’s important moments

Language courses

Modern offices with snacks

Team sports and social activities

Job summary

Gcore is seeking a Python Inference Engineer to join our Edge Cloud&AI Team. You will build and improve the inference layer of the Gcore Inference platform, integrate frameworks, and bring new models into production.

Join a global team of 550+ professionals and collaborate across platform, infrastructure, and product teams to turn inference improvements into reliable features, while exploring open-source contributions.

Qualifications

• 5+ years of experience writing reliable, well-tested production code.
• Strong Python skills and experience designing production systems.
• Hands‑on experience with PyTorch and deploying machine learning models.
• Experience with Linux, Docker, and Kubernetes.
• Experience in distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.
• Ability to debug complex problems across software, infrastructure, and hardware.
• Strong sense of developer experience and collaboration.
• Genuine interest in inference engineering and willingness to learn.

Responsibilities

• Build and improve the inference layer of the Gcore Inference platform.
• Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
• Bring new language and multimodal models into production.
• Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
• Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.
• Work with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.
• Contribute improvements to open-source inference projects when appropriate.

Skills

Python

PyTorch

Linux

Docker

Kubernetes

Distributed Systems

GPU Computing

Model Optimization

Troubleshooting

Collaboration

Tools

CUDA

TensorRT

Triton

vLLM

NVIDIA Dynamo

TensorRT-LLM

Job description

Gcore is seeking a Python Inference Engineer to join our Edge Cloud&AI Team. You will build and improve the inference layer of the Gcore Inference platform, integrate frameworks, and bring new models into production.

Join a global team of 550+ professionals and collaborate across platform, infrastructure, and product teams to turn inference improvements into reliable features, while exploring open-source contributions.