Senior Software Engineer, Akamai Inference Cloud

New
A
AkamaiAI infrastructure
Remote/PolandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
Have relevant experience.
Required Skills
PythonC++GoRustLinuxNLP

Requirements

  • Have relevant experience.
  • Hold a Bachelor's degree or equivalent in Computer Science or a related field.
  • Demonstrate proficiency in Python.
  • Know at least one systems programming language: C++, Go, or Rust.
  • Understand natural language processing concepts, including tokenization, encoding, and text-processing pipelines.
  • Have familiarity with AI inference, model serving, or LLM deployment, including inference frameworks such as TensorRT, vLLM, TorchServe, or Triton.
  • Have experience building high-throughput, low-latency data-processing systems or services.
  • Be familiar with Linux systems, containerized environments, and profiling or debugging tools.

Responsibilities

  • Develop and maintain prompt-processing and tokenization pipelines for inference requests.
  • Implement request routing, scheduling, and batching logic for concurrent inference workloads.
  • Integrate new model architectures and serving backends into the runtime framework.
  • Write well-tested and well-documented code.
  • Participate in code reviews across the inference stack.
  • Monitor, debug, and analyze the performance of runtime components.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now