A community-run open benchmark has produced the first reproducible evidence that transformer language models can be pretrained without backpropagation and achieve validation loss lower than Adam, the ...