512GB of DDR5.
512GB of DDR5. That is the line nobody screenshotted from the FreeToken paper. Berkeley and MIT open-sourced it yesterday and the headline numbers are real: 753B GLM-5.2 on one workstation GPU at 14.9 tok/s, 35B on an 8GB laptop at 39.3. I installed it on my 3