Senior Software Engineer, Akamai Inference Cloud
New
A
AkamaiAI infrastructure
Remote/PolandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- Have relevant experience.
- Required Skills
- PythonC++GoRustLinuxNLP
Requirements
- Have relevant experience.
- Hold a Bachelor's degree or equivalent in Computer Science or a related field.
- Demonstrate proficiency in Python.
- Know at least one systems programming language: C++, Go, or Rust.
- Understand natural language processing concepts, including tokenization, encoding, and text-processing pipelines.
- Have familiarity with AI inference, model serving, or LLM deployment, including inference frameworks such as TensorRT, vLLM, TorchServe, or Triton.
- Have experience building high-throughput, low-latency data-processing systems or services.
- Be familiar with Linux systems, containerized environments, and profiling or debugging tools.
Responsibilities
- Develop and maintain prompt-processing and tokenization pipelines for inference requests.
- Implement request routing, scheduling, and batching logic for concurrent inference workloads.
- Integrate new model architectures and serving backends into the runtime framework.
- Write well-tested and well-documented code.
- Participate in code reviews across the inference stack.
- Monitor, debug, and analyze the performance of runtime components.
View Full Description & ApplyYou'll be redirected to the employer's site