Python Inference Engineer

Gcore

Poland

Hybrid

PLN 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Flexible working hours and hybrid or 远
Work from anywhere in the world for up
Private medical insurance for you and”
Extra paid vacation and sick leave
Support for life’s important moments
Language courses
Modern offices with snacks
Team sports and social activities

Job summary

Gcore is seeking a Python Inference Engineer to join our Edge Cloud&AI Team. You will build and improve the inference layer of the Gcore Inference platform, integrate frameworks, and bring new models into production.

Join a global team of 550+ professionals and collaborate across platform, infrastructure, and product teams to turn inference improvements into reliable features, while exploring open-source contributions.

Qualifications

  • 5+ years of experience writing reliable, well-tested production code.
  • Strong Python skills and experience designing production systems.
  • Hands‑on experience with PyTorch and deploying machine learning models.
  • Experience with Linux, Docker, and Kubernetes.
  • Experience in distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.
  • Ability to debug complex problems across software, infrastructure, and hardware.
  • Strong sense of developer experience and collaboration.
  • Genuine interest in inference engineering and willingness to learn.

Responsibilities

  • Build and improve the inference layer of the Gcore Inference platform.
  • Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
  • Bring new language and multimodal models into production.
  • Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
  • Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.
  • Work with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.
  • Contribute improvements to open-source inference projects when appropriate.

Skills

Python
PyTorch
Linux
Docker
Kubernetes
Distributed Systems
GPU Computing
Model Optimization
Troubleshooting
Collaboration

Tools

CUDA
TensorRT
Triton
vLLM
NVIDIA Dynamo
TensorRT-LLM

Job description

This position is available only under an employment (labor) agreement.

The world’s digital experiences run on something invisible: the infrastructure and software that keep them fast, reliable, and secure. At Gcore, you’ll help design and deliver that foundation for an AI-driven world.

We’re a global provider of infrastructure and software solutions for AI, cloud, network, and security, powering everything from real-time communication and streaming to enterprise AI and secure web applications. With 210+ edge locations, 50+ cloud regions, and thousands of GPUs, your work here can reach users and businesses across the globe.

You’ll collaborate with leading technology partners such as Intel, NVIDIA, Dell, and Equinix, and work on platforms that power digital products used around the world. Our vision is simple: to connect the world to AI, anywhere, anytime.

Want to work on technology that goes beyond a single product or industry? Join a global team of 550+ professionals building infrastructure and software that supports the entire digital ecosystem.

We are currently looking for a Python Inference Engineer to join our Edge Cloud&AI Team.

Job Description

What You’ll Do

  • Build and improve the inference layer of the Gcore Inference platform.
  • Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
  • Bring new language and multimodal models into production.
  • Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
  • Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.
  • Work with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.
  • Contribute improvements to open-source inference projects when appropriate.
Qualifications

What We’re Looking For

  • 5+ years of experience writing reliable, well-tested production code.
  • Strong Python skills and experience designing production systems.
  • Hands‑on experience with PyTorch and deploying machine learning models.
  • Experience with Linux, Docker, and Kubernetes.
  • Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.
  • Ability to debug complex problems across software, infrastructure, and hardware.
  • Strong sense of developer experience: you think about how systems are used, not just how they work.
  • Genuine interest in inference engineering. You do not need direct experience with inference engines, but you should be motivated to learn.
  • Good communication and collaboration skills.

Nice to Have

  • Experience with vLLM, SGLang, NVIDIA Dynamo, TensorRT-LLM, or a similar inference framework.
  • Experience running GPU workloads in production.
  • Knowledge of inference techniques such as quantization, continuous batching, speculative decoding, prefix caching, chunked prefill, or LoRA serving.
  • Experience with CUDA, Triton, TensorRT, or other GPU programming tools.
  • Experience profiling and improving model latency, throughput, memory use, or GPU utilization.
  • Experience with distributed inference, multi‑GPU systems, scheduling, or autoscaling.
  • Contributions to open‑source ML, inference, or infrastructure projects.
Additional Information

At Gcore, we want you to do your best work and enjoy the journey. Our benefits are designed to support your growth, well‑being, and life beyond work:

  • Competitive compensation
  • Flexible working hours and hybrid or remote options, depending on your role
  • Competitive compensation
  • Work from anywhere in the world for up to 45 days per year
  • Private medical insurance for you and your family*
  • Extra paid vacation and sick leave days*
  • Support for life’s important moments and celebrations
  • Language courses to help you connect and grow
  • Modern, welcoming offices with snacks, drinks, and entertainment*
  • Team sports and social activities*

*Benefits may vary depending on your location.

Equal Opportunity Employer

We provide equal opportunity to all applicants without regard to race, color, religion, sex, sexual orientation, age, gender identity, gender expression, national origin, disability, or any other legally protected characteristics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Python Inference Engineer Edge AI & Production ML
Python Inference Engineer Edge AI & Production ML

Gcore • Poland

Hybrid
PLN 180,000 - 240,000
Competitive compensation
Flexible working hours and hybrid or 远
Work from anywhere in the world for up
+6
Software Python Engineer (GPU Cloud)
Software Python Engineer (GPU Cloud)

Gcore • Polska

Hybrid
PLN 180,000 - 240,000
Remote/hybrid/office options
Medical insurance
Paid sick leave
+4
Software Golang Engineer (Kubernetes)
Software Golang Engineer (Kubernetes)

Gcore • Polska

Hybrid
PLN 120,000 - 180,000
Competitive pay
Hybrid/Remote work
Private medical insurance
+3
DevOps/SRE Engineer (AI Inference)
DevOps/SRE Engineer (AI Inference)

Gcore • Polska

Hybrid
PLN 180,000 - 320,000
Flexible working hours
Hybrid or remote options depending on/
Work from anywhere up to 45 days per/
+5
Sr. Software Engineer, Inference
Sr. Software Engineer, Inference

Coreweave • Województwo mazowieckie

On-site
PLN 240,000 - 360,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+3
Secure CI/CD DevOps Engineer for AI Infra
Secure CI/CD DevOps Engineer for AI Infra

Gcore • Polska

Hybrid
PLN 180,000 - 320,000
Flexible working hours
Hybrid or remote options depending on/
Work from anywhere up to 45 days per/
+5
Engineering Manager
Engineering Manager

Gcore • Poland

Hybrid
PLN 400,000 - 700,000
Flexible working hours
Hybrid/remote options
Private medical insurance
+1
Staff Software Engineer, Inference
Staff Software Engineer, Inference

coreweaveu • Warszawa

On-site
PLN 369,000 - 542,000
Family-level Medical Insurance
Family-level Dental Insurance
Generous Pension Contribution
+6
Technical Support Engineer (Edge Cloud)
Technical Support Engineer (Edge Cloud)

Gcore • Polska

Hybrid
PLN 70,000 - 90,000
Remote work options
Worldwide remote mobility up to 45/yr
Private medical insurance
+5
DevOps Engineer/SRE (Cloud IaaS)
DevOps Engineer/SRE (Cloud IaaS)

Gcore • Polska

Hybrid
PLN 200,000 - 320,000
Remote work options
Hybrid work options
Modern office & snacks
Top locations