Advanced users • Re: PI5 and easy AI/CV/LLM

Great topic. i am installing gemma right now. Gonna play with it soon

After trying, it is too slow and ruins the CPU. Temperature went to out of the charts. We need AI accelerator in next gen PIs.

I agree, it stresses the cpu to its limits. It definitely doesn’t ruin the CPU. Eventually the cpu might throttle, but never be ruined.
Ollama with Tinydolphin LLM did run fine, and got my RPi 4 cpu (passively cooled) to ca. 82 deg C.

I tried various cases. My third case for the Pi 5 8G running Ollama is using the Vilros Wave Aluminum case with active and passive cooling. In my rigorous testing, the Pi never got above 70C and mostly stayed in the low 60s. This is significantly better than the other cases I tried. FYI it's not overclocked.

Statistics: Posted by wyovino — Mon Apr 15, 2024 12:04 am

---