Videocards with Compute Capability 3.0 are no longer supported.
CPUs without AVX are no longer supported.
SAEHD: added new option
Use AdaBelief optimizer?
Experimental AdaBelief optimizer. It requires more VRAM, but the accuracy of the model is higher, and lr_dropout is not needed.