UK · pounds · no account
Is it cheaper to run the model, or rent the API?
For people who use Ollama, LM Studio or llama.cpp, and for small firms deciding whether to buy a GPU or keep paying the API. The sums are in pounds, and every number has a source or is labelled an estimate.
Check the figures
DeepSeek: DeepSeek V3's weights are larger than GeForce RTX 3060's 12 GB on the whole ladder — Q2_K alone is about 257 GB. As a MoE model it can run with its experts offloaded to system RAM, but far slower than a card that fits, and this site will not quote a speed for that setup. Choose a smaller model, or a card (or several) that holds the weights.