@[email protected] to solarpunk [email protected] • 1 day agoone more shitty techbrofad downslrpnk.netimagemessage-square109arrow-up1401arrow-down143file-text
arrow-up1358arrow-down1imageone more shitty techbrofad downslrpnk.net@[email protected] to solarpunk [email protected] • 1 day agomessage-square109file-text
minus-square@[email protected]linkfedilink4•3 hours agoYou can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
minus-square@[email protected]linkfedilink3•2 hours agoYou can already run 3B llms on cheap phones using MLCChat, it’s just hella slow
You can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
You can already run 3B llms on cheap phones using MLCChat, it’s just hella slow