Local 13B LLM “ChatGPT” running on M2 Max GPU
Yes, you can run a 13B LLM local “ChatGPT” on M2 Max’s GPU. Here’s how I get about 20+ tokens/s on My Mac Studio.
#blog #everything #tech
Yes, you can run a 13B LLM local “ChatGPT” on M2 Max’s GPU. Here’s how I get about 20+ tokens/s on My Mac Studio.