Today's docket at home: testing out Project Maya to see how feasible it is to run GLM 5.3 Flash on a 5080 with 16gb vRAM and 128 GB dRAM.
So far, it's not horrible, just long ttft. About 25-30 tok/s decode, 1200 prefill; compared to 75-90 and 2600 for Qwen 3.8 Flash Next.
commit bec385e