Local 13B LLM “ChatGPT” running on M2 Max GPU
Yes, you can run a 13B LLM local “ChatGPT” on M2 Max’s GPU. Here’s how I get about 20+ tokens/s on My Mac Studio.
#blog #everything #tech
Yes, you can run a 13B LLM local “ChatGPT” on M2 Max’s GPU. Here’s how I get about 20+ tokens/s on My Mac Studio.
As my 2017 Intel-based MacBook continues to run even with the latest macOS Monterey, I find it really hard to justify an upgrade to the new M1 Ultra-based Mac Studio. TL;DR: I think an...
It’s been one year since I asked if you can play Windows games on Parallels Desktop effectively. Parallels has also just released an update to their popular Parallels Desktop virtualisation app for the macOS....
Disclaimer: This site serves ads from Google and Amazon. As an Amazon Associate I earn from qualifying purchases.