UK · pounds · no account
Is it cheaper to run the model, or rent the API?
For people who use Ollama, LM Studio or llama.cpp, and for small firms deciding whether to buy a GPU or keep paying the API. The sums are in pounds, and every number has a source or is labelled an estimate.
Check the figures
Mistral: Mistral Small 4 will not fit on GeForce RTX 4080 SUPER. Even the smallest quant on the ladder, Q2_K, is about 44.8 GB against the card's 16 GB. Choose a bigger card or a smaller model. This site refuses the pairing rather than quote a speed it cannot run.