UK · pounds · no account
Is it cheaper to run the model, or rent the API?
For people who use Ollama, LM Studio or llama.cpp, and for small firms deciding whether to buy a GPU or keep paying the API. The sums are in pounds, and every number has a source or is labelled an estimate.
Check the figures
DeepSeek: R1 0528's weights are larger than GeForce RTX 5070's 12 GB on the whole ladder — Q2_K alone is about 256.7 GB. As a MoE model it can run with its experts offloaded to system RAM, but far slower than a card that fits, and this site will not quote a speed for that setup. Choose a smaller model, or a card (or several) that holds the weights.