AI Inference Engineer QVAC
New
T
TetherFintech AI
100% remote WorldwideFull-Time
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Required Skills
- JavascriptC++Deep Learning
Requirements
- Excellent programming skills in C++.
- Strong experience with Llama.cpp and ggml inference engines.
- Good understanding of deep learning concepts and model architectures.
- Experience with transformers, LLMs, and Diffusion models.
- Degree in Computer Science, AI, Machine Learning, or a related field.
- Solid track record in AI R&D.
- Ability to rapidly assimilate new technologies and techniques.
- Excellent English communication skills.
Responsibilities
- Own the inference backbone behind QVAC's local AI stack using C++.
- Optimize runtime performance, memory usage, throughput, and latency on user hardware.
- Port and enhance inference engines like llama.cpp and ggml for edge devices.
- Collaborate with researchers to code, train, and transition models from research to production.
- Integrate AI features into existing products to enhance functionality.
- Define and evolve core abstractions to support new inference capabilities.
View Full Description & ApplyYou'll be redirected to the employer's site
