<- Back
Comments (25)
- _ache_From my own test. It's not faster than the unsloth model.Disclarer: I'm unsing Vulkan on an AMD GC.
- syntaxingI’m on a strix halo @ GPU-5 with MTP and I get 600 prefill and 30 TG which pushes it into a very usable range. The odd thing is that Dflash2 is really slow for me, like sub 10 TG.
- SchlagbohrerAbsolute treasure of a website with these graphs, thank you for sharing this. Huge help for me to find a faster model (smaller quantization) for my VRAM.
- npodbielskiWell I tested it on 7900XTX with the same prompts and their draft model gave me about 30t/s. Their own snippet of code with regular MTP model gave me 60t/s.Also model with their draft answered incorrectly. With MTP it answered correctly.Question was: "Does MikroTik CRS312-4C+8XG-RM have combo ports?". The answer is Yes.
- sheoAged like milkhttps://news.ycombinator.com/item?id=49746618
- kristianpWhat's GPU-5?