Inference will never be the same: Etched invented two new ways to massively improve compute c...
Inference will never be the same: Etched invented two new ways to massively improve compute cost, speed, and per watt efficiency: low voltage inference (more FLOPs) and cluster scale memory (memory/bandwidth) The combination runs trillion-parameter models at o