Choose model size
A quantized 8B model is modest. 32B and 70B models need considerably more memory but can cover more demanding tasks.
Local AI. Your hardware. Your data.
Work out how much model memory you really need, then compare complete systems for your model size, speed, space and budget.
Three steps to the right class
For local language models, the crucial question is whether model weights, context cache and runtime headroom fit into fast memory together. An impressive NPU TOPS figure alone does not answer it.
A quantized 8B model is modest. 32B and 70B models need considerably more memory but can cover more demanding tasks.
A discrete high-end GPU delivers excellent speed. Large unified memory can hold bigger models, with a different performance profile.
Cooling, memory allocation, storage, upgradeability and the exact GPU configuration matter as much as the processor name.
Quick orientation
A practical starting point for 7B to 14B models in suitable quantization and normal context lengths.
Chat · summarization · first coding workflowsInteresting for quantized 20B to 32B models or several smaller components with useful headroom.
Coding · RAG · capable assistantsThe capacity class for 70B models and long contexts, depending on runtime and quantization.
70B · long context · agent stacksThese values are conservative guidance, not a guarantee. Architecture, quantization, context, KV cache and runtime all change memory use.
Current shortlist
Different routes to the same goal: maximum memory capacity in a small footprint or very high GPU performance in a desktop.
Capacity focus · compact
Ryzen AI Max+ 395 with 128 GB of unified memory and a 2 TB configuration: compelling when fitting a large quantized model matters more than maximum discrete-GPU speed.
Speed focus · desktop
A high-end tower configuration combining a GeForce RTX 5090 32 GB with 64 GB of system memory. Suited to fast local inference where the active workload fits in GPU memory.
Speed focus · desktop
This 64 GB / 2 TB tower configuration pairs a GeForce RTX 5090 with a large chassis. It targets fast 8B to 32B workflows while leaving room for system-side tools.
* Paid link. We may earn a commission if you buy; your price is unchanged. As an Amazon Associate I earn from qualifying purchases. Please verify the exact configuration and current availability with the retailer.
Your workload matters
The finder considers model class, context length, intended use and your main priority. It returns an explainable hardware class, not false precision.
Evidence over mystery
We prefer manufacturer and platform documentation for technical specifications.
One product name can cover different memory, storage and GPU variants. The linked configuration is what matters.
These pages provide buying guidance and editorial analysis. We only claim hands-on testing when it is documented.