The GPU batch eigh was reported to not converge in the middle of training. I thought it was NaN, so I reproduced it with the same seed and everything was finite—it was caused by a rank-deficient Gram matrix. Dividing by the trace and adding ridge made it pass.
Translated from Japanese
commit b77c47d