Follow the latest coverage, related explainers and connected technology stories.
A research paper from the Georgia Institute of Technology analyzes the impact of repeated thermal-tuning operations in wafer-scale optical interconnects used to train language models based on the Mixture of Experts architecture. According to the published abstract, eliminating stalls accelerated training of Mixtral 8x7B by 2.7 times in the scenario studied.