Today's win, Runing a Qwen3.6 35B locally on a old 3060 with 12Gb vram and making 75tok/sec
Wasn't easy, but it's huffing and puffing along
Commit
513d315
Amazing, Congratulations! Looking forward to making my own local AI infra!
commit 513d315
513d315
commit 513d315