cuda: out_prod dequantizes a 2D weight in row blocks — the output head's backward holds one block (dd109d3c, second cut) - #4

cuda: out_prod dequantizes a 2D weight in row blocks — the output head's backward holds one block (dd109d3c, second cut)#4

joelteply merged 1 commit into

feat/props-weight-residencyCambrianTech/llama.cpp:feat/props-weight-residencyfrom

continuum/cuda-out-prod-blockedCambrianTech/llama.cpp:continuum/cuda-out-prod-blockedCopy head branch name to clipboard