BackendROCm
Decode58 tok/s
VRAM24 GB
Memory bandwidth960 GB/s
ModelQwen 27B
Parameters27B
QuantizationQ4
Context8K
KV quantQ4
OffloadFully on GPU
About this result
Estimated. Best VRAM-per-rupee on the AMD side.
This result is estimated from the GPU AI Performance Calculator – expect variation on real hardware.