Senior Software Engineer - AI Inference & Runtime (Hybrid)

Akamai Career Site

Poland

Hybrid

PLN 180,000 - 280,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Akamai is seeking a Senior Software Engineer to join the Inference Cloud Team, focusing on prompt processing, tokenization, and optimized request handling for AI inference at scale.

You will collaborate with experienced engineers to convert user requests into efficient model inputs and contribute to the integration of diverse model architectures and serving backends. This role offers exposure to AI inference systems and growth within a cutting-edge infrastructure engineering field.

Qualifications

  • Bachelor's degree in Computer Science or related field.
  • Proficiency in Python and at least one systems language (C++, Go, or Rust).
  • Understanding of NLP concepts including tokenization and text processing pipelines.
  • Familiarity with AI inference, model serving, or LLM deployment and frameworks (TensorRT, vLLM, TorchServe, Triton).
  • Experience building high-throughput, low-latency data processing systems or services.
  • Familiarity with Linux, containers, and profiling/debugging tools.

Responsibilities

  • Developing and maintaining prompt processing and tokenization pipelines for inference requests.
  • Implementing routing, scheduling, and batching to optimize throughput and latency.
  • Integrating new model architectures and serving backends into the runtime framework.
  • Writing well-tested, well-documented code and participating in code reviews.
  • Supporting ops readiness through monitoring, debugging, and performance analysis.

Skills

Python
C++
Go
Rust
NLP concepts
Model serving
Linux
Containers

Education

Bachelor's degree in Computer Science or related field

Tools

TensorRT
vLLM
TorchServe
Triton

Job description

Akamai is seeking a Senior Software Engineer to join the Inference Cloud Team, focusing on prompt processing, tokenization, and optimized request handling for AI inference at scale.

You will collaborate with experienced engineers to convert user requests into efficient model inputs and contribute to the integration of diverse model architectures and serving backends. This role offers exposure to AI inference systems and growth within a cutting-edge infrastructure engineering field.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - Akamai Inference Cloud (Remote/Poland)
Senior Software Engineer - Akamai Inference Cloud (Remote/Poland)

Akamai Career Site • Poland

Hybrid
PLN 180,000 - 280,000
Senior SDET — AI Inference Cloud (Hybrid/Remote)
Senior SDET — AI Inference Cloud (Hybrid/Remote)

Akamai Career Site • Poland

Remote
PLN 180,000 - 350,000
FlexBase program
Benefits package
Principal Software Engineer, Inference Cloud (Hybrid/Remote)
Principal Software Engineer, Inference Cloud (Hybrid/Remote)

Akamai Career Site • Poland

Remote
PLN 180,000 - 260,000
Platform Engineer II — AI Inference Cloud (Remote)
Platform Engineer II — AI Inference Cloud (Remote)

Akamai Technologies, Inc. • Kraków

Remote
PLN 180,000 - 300,000
Remote work
Flexible schedule
Senior SDET for AI Inference Cloud: Quality & Performance
Senior SDET for AI Inference Cloud: Quality & Performance

Akamai Technologies • Kraków

On-site
PLN 180,000 - 260,000
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland

Akamai Technologies, Inc. • Kraków

Remote
PLN 320,000 - 520,000
Benefits
FlexBase adapts to job needs
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland

Akamai Career Site • Poland

Remote
PLN 180,000 - 260,000
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)

Akamai Career Site • Poland

Remote
PLN 180,000 - 350,000
FlexBase program
Benefits package
Platform Engineer II - Akamai Inference Cloud - Remote/Poland
Platform Engineer II - Akamai Inference Cloud - Remote/Poland

Akamai Technologies • Województwo małopolskie

On-site
PLN 40,000 - 65,000
Comprehensive health benefits
Financial planning assistance
Flexible work schedule
Engineering Manager - AI Inference Cloud (Remote/Poland)
Engineering Manager - AI Inference Cloud (Remote/Poland)

Akamai Technologies, Inc. • Kraków

Remote
PLN 300,000 - 500,000
Top locations