Senior Software Engineer - Akamai Inference Cloud (Remote/Poland)

Akamai Career Site

Poland

Hybrid

PLN 180,000 - 280,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Akamai is seeking a Senior Software Engineer to join the Inference Cloud Team, focusing on prompt processing, tokenization, and optimized request handling for AI inference at scale.

You will collaborate with experienced engineers to convert user requests into efficient model inputs and contribute to the integration of diverse model architectures and serving backends. This role offers exposure to AI inference systems and growth within a cutting-edge infrastructure engineering field.

Qualifications

  • Bachelor's degree in Computer Science or related field.
  • Proficiency in Python and at least one systems language (C++, Go, or Rust).
  • Understanding of NLP concepts including tokenization and text processing pipelines.
  • Familiarity with AI inference, model serving, or LLM deployment and frameworks (TensorRT, vLLM, TorchServe, Triton).
  • Experience building high-throughput, low-latency data processing systems or services.
  • Familiarity with Linux, containers, and profiling/debugging tools.

Responsibilities

  • Developing and maintaining prompt processing and tokenization pipelines for inference requests.
  • Implementing routing, scheduling, and batching to optimize throughput and latency.
  • Integrating new model architectures and serving backends into the runtime framework.
  • Writing well-tested, well-documented code and participating in code reviews.
  • Supporting ops readiness through monitoring, debugging, and performance analysis.

Skills

Python
C++
Go
Rust
NLP concepts
Model serving
Linux
Containers

Education

Bachelor's degree in Computer Science or related field

Tools

TensorRT
vLLM
TorchServe
Triton

Job description

Are you excited about building the systems that process and optimize AI inference requests at scale?
Do you want to work hands-on with cutting-edge AI serving technologies and large language models?
Join the Akamai Inference Cloud Team!

The Akamai Inference Cloud team develops AI platforms for inference models and applications within Akamai's Cloud Technology Group. The Inference Execution & Runtimes team manages the inference engine, AI runtime frameworks, model serving infrastructure, and execution environment. Their work impacts latency, throughput, and efficiency of AI workloads across Akamai's extensive global infrastructure.

Partner with the best

As a Senior Software Engineer on the Inference Execution & Runtimes team, contribute to prompt processing, tokenization, and request handling pipelines. Collaborate with experienced engineers to transform user requests into optimized model inputs. This role offers significant exposure to AI inference systems and opportunities to gain expertise in a rapidly evolving infrastructure engineering field.

As a Senior Software Engineer , you will be responsible for:

  • Developing and maintaining prompt processing and tokenization pipelines that prepare inference requests for efficient model execution.
  • Implementing request routing, scheduling, and batching logic that optimizes throughput and latency across concurrent inference workloads.
  • Contributing to the integration of new model architectures and serving backends into the runtime framework.
  • Writing well-tested, well-documented code and participating in code reviews to maintain high engineering standards across the inference stack.
  • Supporting operational readiness through monitoring, debugging, and performance analysis of runtime components.
Do what you love

To be successful in this role you will:

  • Have relevant experience and a Bachelor's degree or its equivalent in Computer Science or a related field.
  • Demonstrate proficiency in Python and at least one systems programming language such as C++, Go, or Rust.
  • Show understanding of natural language processing concepts including tokenization, encoding, and text processing pipelines.
  • Have familiarity with AI inference, model serving, or LLM deployment including inference frameworks (TensorRT, vLLM, TorchServe, Triton).
  • Demonstrate experience building high-throughput, low-latency data processing systems or services.
  • Show familiarity with Linux systems, containerized environments, and profiling or debugging tools.
  • Demonstrate a keen willingness to learn and grow within the AI inference and model serving field.
About us

At Akamai, we make life better for billions of people, trillions of times a day.
Whether you're streaming live events, scrolling social media, watching your favorite series, or managing your savings, we're the engine behind the scenes. We provide the world's most distributed platform from Cloud to Edge to help the giants of the digital world work faster and stay more secure, making the internet a better experience for everyone.
Our focus is simple:
Cloud and Edge: Running apps closer to users for instant performance.
Security: Neutralizing threats before they ever reach your data.
Content Delivery: Scaling the world's biggest moments without a glitch.
AI: Enabling our customers to build, secure, and scale AI apps on the world's most distributed cloud platform.
At Akamai, we don't just support the internet; we power and protect it, because behind every great digital experience is a massive hidden challenge. And we're the ones who solve it. When millions of people hit play or pay, Akamai ensures it just works.

Benefits at Akamai:

We support your health, well-being, finances, and life beyond work. See our benefits.

FlexBase adapts to your job's needs

Akamai's FlexBase program is yet another way we show our commitment to providing employees with an exceptional workplace experience. It's not about telling employees where to work; it's about supporting employees to do their best work.
We trust our incredible employees to work in ways that suit them best: at home, in an office, or a combination of both.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Software Engineer - Akamai Inference Cloud - Remote/Poland
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland

Akamai Career Site • Poland

Remote
PLN 180,000 - 260,000
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland

Akamai Technologies, Inc. • Kraków

Remote
PLN 320,000 - 520,000
Benefits
FlexBase adapts to job needs
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)

Akamai Career Site • Poland

Remote
PLN 180,000 - 350,000
FlexBase program
Benefits package
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)

Akamai Technologies • Kraków

On-site
PLN 180,000 - 260,000
Engineering Manager - Akamai Inference Cloud (Remote/Poland)
Engineering Manager - Akamai Inference Cloud (Remote/Poland)

Akamai Technologies • Kraków

Hybrid
PLN 400,000 - 640,000
Engineering Manager - Akamai Inference Cloud (Remote/Poland)
Engineering Manager - Akamai Inference Cloud (Remote/Poland)

Akamai Career Site • Poland

Remote
PLN 290,000 - 420,000
FlexBase program
Remote work options
Engineering Manager - Akamai Inference Cloud (Remote/Poland)
Engineering Manager - Akamai Inference Cloud (Remote/Poland)

Akamai Technologies, Inc. • Kraków

Remote
PLN 300,000 - 500,000
Manager Site Reliability Engineering
Manager Site Reliability Engineering

Akamai Technologies, Inc. • Poland

Hybrid
PLN 400,000 - 700,000
Platform Engineer II - Akamai Inference Cloud - Remote/Poland
Platform Engineer II - Akamai Inference Cloud - Remote/Poland

Akamai Technologies • Województwo małopolskie

On-site
PLN 40,000 - 65,000
Comprehensive health benefits
Financial planning assistance
Flexible work schedule
AI Inference Platform Lead Engineer (Remote)
AI Inference Platform Lead Engineer (Remote)

Akamai Career Site • Polska

Remote
PLN 180,000 - 260,000
Top locations