xAI: The Grok-2-mini has been upgraded for speed
Elon Musk's xAI company announced that the Grok-2-mini has just been upgraded with speed. Our inference stack has been greatly improved in the past few days. These advancements come from the use of custom algorithms for compute and communication cores, as well as more efficient batch scheduling and quantization. (Golden Ten)