@WanderA to LocalLLaMA@sh.itjust.worksEnglish • 1 year agoWhat is better: higher quantiation or higher parameter count?message-square16fedilinkarrow-up120arrow-down10file-text
arrow-up120arrow-down1message-squareWhat is better: higher quantiation or higher parameter count?@WanderA to LocalLLaMA@sh.itjust.worksEnglish • 1 year agomessage-square16fedilinkfile-text
For example, does a 13B parameter model at 2_K quantiation perform worse than a 7B parameter model at 8bit or 16bit?
minus-square@WanderOPAlinkfedilinkEnglish6•1 year agoThat graph is great. Very easy to understand. Thank you!
That graph is great. Very easy to understand. Thank you!