Run or Rent

UK · pounds · no account

Is it cheaper to run the model, or rent the API?

For people who use Ollama, LM Studio or llama.cpp, and for small firms deciding whether to buy a GPU or keep paying the API. The sums are in pounds, and every number has a source or is labelled an estimate.

The job

1,000 documents, about 4,500 words each, and a half-page summary. A worked example of the job size, not a count of your files.

Model and card

No shop price on file for this card.

Ofgem price cap, average electricity unit rate for a Direct Debit customer in England, Scotland and Wales on a single-rate default tariff. No VAT on electricity in this period, per Ofgem. The daily standing charge is not included. Your region and payment method can differ. Ofgem, 1 October 2026 to 31 December 2026.

Speed and power

Filled when a sourced run exists. Otherwise type the speed you see in Ollama, LM Studio or llama.cpp.

Starts at the card's maximum rated power. Lower it if you measured the draw.

Check the figures

DeepSeek: DeepSeek V3's weights are larger than Radeon RX 7900 XTX's 24 GB on the whole ladder — Q2_K alone is about 257 GB. As a MoE model it can run with its experts offloaded to system RAM, but far slower than a card that fits, and this site will not quote a speed for that setup. Choose a smaller model, or a card (or several) that holds the weights.