Running a 120-billion-parameter language model locally is now achievable with the Tiiny AI Pocket Lab, as explored by Alex Ziskind. This device, weighing just 305 grams, features 80 GB of memory, a 1 TB SSD and a Neural Processing Unit designed for AI workloa…
Forget the Cloud: This Tiiny Pocket PC Packs 80GB RAM for Local AI