Artificial Intelligence
-
The intelligence is the words
Kevin Kelly asks If programmers did not program ChatGPT with logical deduction skills, where does the intelligence in its models come from? He hypothesizes that It is the architecture of language that conveys the intelligence. I have another idea: our intelligence is the language, and that’s been hidden in plain sight for centuries or more.… Continue reading
-
Contradictions
Terry Goodier’s essay The Boring Internet is all about the low level protocols that underpin Internet services. He points out that there’s nothing pretty or easy about protocols. And he points it out in a visual essay that’s lovely to see. The form of the essay and the form of its subject are a contradiction.… Continue reading
-
The mythos mode and the logos mode
Another deeply thoughtful essay this morning from Om Malik. You should read it! Malik begins by wondering why Anthropic called its new model Mythos. To even wonder about that, you have to understand some things about history, literature, and philosophy. I won’t explain Malik’s inquiry; that’s what his essay does brilliantly. It’s another example of… Continue reading
-
Well whaddaya know
Everybody knows a lot more than they’re able to explain. There are some areas where language just isn’t adequate. For example, imagine trying to explain an aroma without referring to other smells. Without “it smells like…”, there’s not a lot you can do. Even though people have amassed countless pages of written information, and that’s… Continue reading
-
The bills are starting to come due
The leading AI vendors are starting to remove the curtains around how many tokens you’re using and how much they cost. In large corporate settings, token cost has been effectively zero for individual practitioners. In my most recent corporate gig, I was strongly encouraged to make as much use of Codex and its ilk as… Continue reading
-
An ogre is like an onion
Metaphors are a tool for easily understanding and explaining something. They’re comparisons. If you say “the AI industry is a house of cards,” anybody who shares enough experience and language with you knows you’re saying the AI industry is fragile and could collapse at any moment. The Metaphors We Live By, a 1980 book by… Continue reading
-
Waxing Desperate with Imagination*
Generative AI isn’t reliable. Like an unreliable narrator in fiction, you have to stay alert; what an LLM tells you only might be true. If you’re writing fiction you might give the reader a hint that your narrator can’t be trusted. You might introduce them as a court jester; a clown. Or you might design… Continue reading
-
The great human document
Another idea from Jaron Lanier: large language model software systems are not artificial intelligence. A large language model is one enormous document comprised of contributions from countless people. It’s “something like a version of Wikipedia that includes much more data, mashed together using statistics.” It “can be thought of as illuminating previously hidden concordances between… Continue reading
-
Data Dignity and Xanadu
Jaron Lanier is always interesting to listen to or read. Just this week he was a guest on Neil Degrasse Tyson’s Startalk. The discussion turned to AI (in its current form), and Lanier brought up his notion of data dignity. This hasn’t gotten much attention, as far as I can tell. According to Lanier, the… Continue reading
-
Oh spare us. No, really, I mean it.
I just found Dario Amodei’s apologia The Adolescence of Technology, from back in January. It’s quite long; Claude must have used tons of tokens writing it for him. Amodei can, of course, afford it. His essay is chock full of hand waving dismissals of reservations reasonable people might have about large language models (and the… Continue reading
About Me
I’m Pete Harbeson, a writer (among other things) located near Boston, Massachusetts. In addition to writing my own content, I’ve learned to translate for my loquacious and opinionated pup Chocolate Bossypaws. No surprise, she mostly speaks in doggerel. You can find her contributions tagged with Chocolatiana.
Check out my other blog, Techlimitics, where I’m grappling with the nature of simplicity. You can also find some of my minor software projects at GitHub. Nothing very impressive. I mostly write tiny utilities in Python.
I find myself suddenly de-corporatized (their choice, not mine). To help keep the lights on, buy me a coffee!