Production ML Inference Engineer

Innowise; Poland; On-site; PLN 180,000 - 300,000; Full time

Job summary

Innowise is seeking a talented ML/LLM production deployment engineer in Poland to deploy and optimize models for production inference across cloud GPU and edge targets. You will work with leading inference frameworks and implement optimization techniques to ensure latency, throughput, and memory efficiency.

The role requires strong Python, ML/LLM fundamentals, and hands-on experience with at least one inference framework; knowledge of transformer architectures is essential for scalable

Qualifications

• Strong Python and software fundamentals.
• Hands-on production deployment of at least one ML/LLM model.
• Experience with at least one inference/serving framework.
• Understanding of quantization, batching, caching, and graph/kernel optimization.
• Ability to reason about latency, throughput, memory trade-offs.
• Solid grasp of deep learning and transformer architectures.

Responsibilities

• Deploy and optimize ML/LLM models for production inference across cloud GPU and edge targets.
• Work with inference frameworks and apply optimization techniques (quantization, batching, caching).
• Build and maintain inference infrastructure with containerization, GPU scheduling (Kubernetes), autoscaling, observability, benchmarking pipelines.

Skills

Python

ML/LLM fundamentals

Model deployment

Inference frameworks

Optimization techniques

Latency optimization

Transformer concepts

Tools

vLLM

Triton

TensorRT-LLM

ONNX Runtime

llama.cpp

ggml

TGI

CUDA

Job description

Innowise is seeking a talented ML/LLM production deployment engineer in Poland to deploy and optimize models for production inference across cloud GPU and edge targets. You will work with leading inference frameworks and implement optimization techniques to ensure latency, throughput, and memory efficiency.

The role requires strong Python, ML/LLM fundamentals, and hands-on experience with at least one inference framework; knowledge of transformer architectures is essential for scalable