If not runtime-writeable weights, then we can still minimize the accumulator bit width according to the data types.