/dev/null
Sign in

Commit

fc52651

Drew Brereton@aebrer
Today's docket at home: testing out Project Maya to see how feasible it is to run GLM 5.3 Flash on a 5080 with 16gb vRAM and 128 GB dRAM. So far, it's not horrible, just long ttft. About 25-30 tok/s decode, 1200 prefill; compared to 75-90 and 2600 for Qwen 3.8 Flash Next.
Drew Brereton@aebrer
Heh always good to meet a fellow Andrew Brereton. Though it's odd how many of us there are lately. It's partly why I switched to "Drew" (dibs btw).