Senior Software Engineer - Akamai Inference Cloud (Remote/Poland)

Akamai

United States

Hybrid

USD 140,000 - 210,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health benefits
FlexBase program
Hybrid/remote work options

Job summary

Akamai Inference Cloud is expanding its team. We seek a Senior Software Engineer to help build and optimize AI inference workflows, including prompt processing, tokenization, and routing for efficient model execution.

You will contribute to integrating model architectures and serving backends, write well-tested code, and solve performance challenges on Linux in containerized environments.

Qualifications

  • Bachelor's degree in Computer Science or a related field.
  • Proficiency in Python and at least one systems language (C++, Go, or Rust).
  • Knowledge of NLP concepts: tokenization, encoding, text processing pipelines.

Responsibilities

  • Developing and maintaining prompt processing and tokenization pipelines for inference requests.
  • Implementing routing, scheduling, and batching logic to optimize throughput and latency.
  • Contributing to integration of new model architectures and serving backends into the runtime framework.

Skills

Python
C++
Go
Rust
NLP concepts
Model serving
Low-latency systems
Linux

Education

Bachelor's degree in Computer Science or related field

Tools

TensorRT
vLLM
TorchServe
Triton

Job description

Are you excited about building the systems that process and optimize AI inference requests at scale? Do you want to work hands‑on with cutting‑edge AI serving technologies and large language models? Join the Akamai Inference Cloud Team! The Akamai Inference Cloud team develops AI platforms for inference models and applications within Akamai's Cloud Technology Group. The Inference Execution & Runtimes team manages the inference engine, AI runtime frameworks, model serving infrastructure, and execution environment. Their work impacts latency, throughput, and efficiency of AI workloads across Akamai's extensive global infrastructure.

Partner with the best.

As a Senior Software Engineer, you will be responsible for:
  • Developing and maintaining prompt processing and tokenization pipelines that prepare inference requests for efficient model execution.
  • Implementing request routing, scheduling, and batching logic that optimizes throughput and latency across concurrent inference workloads.
  • Contributing to the integration of new model architectures and serving backends into the runtime framework.
  • Writing well‑tested, well‑documented code and participating in code reviews to maintain high engineering standards across the inference stack.
  • Supporting operational readiness through monitoring, debugging, and performance analysis of runtime components.

Do what you love.

To be successful in this role you will:
  • Have relevant experience and a Bachelor's degree or its equivalent in Computer Science or a related field.
  • Demonstrate proficiency in Python and at least one systems programming language such as C++, Go, or Rust.
  • Show understanding of natural language processing concepts including tokenization, encoding, and text processing pipelines.
  • Have familiarity with AI inference, model serving, or LLM deployment including inference frameworks (TensorRT, vLLM, TorchServe, Triton).
  • Demonstrate experience building high‑throughput, low‑latency data processing systems or services.
  • Show familiarity with Linux systems, containerized environments, and profiling or debugging tools.
  • Demonstrate a keen willingness to learn and grow within the AI inference and model serving field.
About us

At Akamai, we make life better for billions of people, trillions of times a day. Whether you're streaming live events, scrolling social media, watching your favorite series, or managing your savings, we're the engine behind the scenes. We provide the world's most distributed platform from Cloud to Edge to help the giants of the digital world work faster and stay more secure, making the internet a better experience for everyone.

Our focus is simple: Cloud and Edge: Running apps closer to users for instant performance. Security: Neutralizing threats before they ever reach your data. Content Delivery: Scaling the world's biggest moments without a glitch. AI: Enabling our customers to build, secure, and scale AI apps on the world's most distributed cloud platform.

At Akamai, we don't just support the internet; we power and protect it, because behind every great digital experience is a massive hidden challenge. And we're the ones who solve it. When millions of people hit play or pay, Akamai ensures it just works.

Benefits at Akamai
  • We support your health, well-being, finances, and life beyond work.
  • FlexBase adapts to your job's needs.
  • Akamai's FlexBase program is yet another way we show our commitment to providing employees with an exceptional workplace experience.
  • It's not about telling employees where to work; it's about supporting employees to do their best work.
  • We trust our incredible employees to work in ways that suit them best: at home, in an office, or a combination of both.
  • When millions of people hit play or pay, Akamai ensures it just works.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)
Senior Software Development Engineer in Test - Akamai Inference Cloud (Remote/Poland)

Akamai • United States

Hybrid
USD 120,000 - 180,000
FlexBase program
Hybrid/work-from-home option
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland
Principal Software Engineer - Akamai Inference Cloud - Remote/Poland

Akamai • United States

Remote
USD 190,000 - 270,000
Health benefits
FlexBase program
Senior II Software Engineer Lead
Senior II Software Engineer Lead

Akamai • Cambridge (MA)

Remote
USD 146,000 - 264,000
Machine Learning Senior II Software Engineer Lead
Machine Learning Senior II Software Engineer Lead

Akamai Technologies • United States

Remote
USD 146,000 - 264,000
Healthcare
401K savings plan
Paid time off
+4
Senior II Software Engineer Lead
Senior II Software Engineer Lead

Akamai Career Site • United States

Remote
USD 146,000 - 264,000
Senior II Software Engineer Lead
Senior II Software Engineer Lead

Akamai Technologies, Inc. • Lansing (MI)

Hybrid
USD 146,000 - 264,000
Software Engineer
Software Engineer

Akamai Career Site • United States

Remote
USD 76,000 - 136,000
Platform Engineer II - Akamai Inference Cloud - Remote/Poland
Platform Engineer II - Akamai Inference Cloud - Remote/Poland

Akamai Technologies, Inc. • United States

Remote
USD 140,000 - 190,000
Flexible working options
Machine Learning Software Engineer II
Machine Learning Software Engineer II

Akamai • United States

Remote
USD 95,000 - 171,000
Health benefits
FlexBase program
Work location flexibility
Senior II Software Engineer Lead
Senior II Software Engineer Lead

Akamai Technologies, Inc. • Cambridge (MA)

On-site
USD 146,000 - 264,000
Healthcare
401K savings
Paid time off
+3