Pylimitics

"Simplicity" rearranged


Your own LLM

The most powerful Macintosh available now is (I think) the Mac Studio. I think it’s more capable than the Mac Pro, although I could be wrong. In any event, the M2 Ultra Mac Studio is a system that would have been called a supercomputer not that long ago, and you can have one, or even three — they’re expensive, but not crazy money. Not venture-capital funds; just used-car money.

What would you do with three of those? How about running your own local large language model that’s in the same class as ChatGPT? That’s now within reach.

From Simon Willison: “$16,797 will buy you three 192GB Apple M2 Ultra Mac Studios at $5,599 each.”



About Me

I’m Pete Harbeson, a writer located near Boston, Massachusetts. In addition to writing my own content, I’ve learned to translate for my loquacious and opinionated pup Chocolate. I shouldn’t be surprised, but she mostly speaks in doggerel. You can find her contributions tagged with Chocolatiana.