A independent contribution was famous exactly where a user created a fused GEMM for int4, and that is powerful for schooling with fastened sequence lengths, offering the fastest solution.LORA overfitting concerns: One more user queried no matter if appreciably decreased training loss when compared to validation decline signals overfitting, even whe