AI Inference Engineer QVAC
New
T
TetherFintech / AI
100% remote WorldwideFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Required Skills
- C++Deep Learning
Requirements
- Strong programming skills in C++.
- Strong experience with Llama.cpp and ggml inference engines.
- Experience with at least one GPU framework: Cuda, Vulkan, Metal, or OpenCL.
- Solid understanding of deep learning concepts and model architectures.
- Experience with transformers, LLMs, and Diffusion models.
- Demonstrated ability to rapidly assimilate new technologies and techniques.
- Degree in Computer Science, AI, Machine Learning, or a related field.
- Solid track record in AI R&D.
Responsibilities
- Own the inference backbone for the QVAC local AI stack.
- Develop and maintain the C++ systems layer for model execution on user hardware.
- Optimize startup behavior, memory usage, throughput, and latency.
- Port and enhance inference engines such as llama.cpp for edge devices.
- Collaborate with researchers to transition models from research to production.
- Integrate new AI features into existing products while maintaining performance.
View Full Description & ApplyYou'll be redirected to the employer's site
