mobile

Running a model on-device is a memory decision first

Quantisation, mmap and the low-memory killer decide whether your 3B model ships.