Discussion about this post

User's avatar
Debbie Lerman's avatar

Agree with you that all the monitoring and control mechanisms are terrifying and that their widespread adoption seems imminent. All your research and writing on these topics is invaluable - thank you!!!

One quibble: the part about the machine “understanding” or being “conscious” of what it’s doing misinterprets what AI is: it is merely a computational program that calculates the probability of a series of symbols (the meaning of which is completely opaque to it) coming after other series of symbols.

So when Grok tells you how to resist its own control, it does not “understand” the meaning of the symbols representing the words “self” or “consciousness” or “control” or anything else. It is not and can never be “conscious” of anything because it’s just a huge calculator of probabilities.

In other words, It is merely putting symbols representing words and sentences that are in its dataset in a particular order that it calculates to be most likely to follow the symbols representing the words and sentences that a human understands to signify ideas about resisting digital controls.

So at least we’re not facing a Hal situation— which is purely fictional — definite cultural/narrative programming there to make us think there’s some kind of equivalency or overlap between digital systems and biological ones — which there absolutely positively is not. I know I’m not supposed to be positive about anything but that’s the one claim I stand fully behind. 😁

Expand full comment
Elizabeth Schneider's avatar

My raison d’être apparently is to be the anomaly. Thanks for a succinct explanation of everything I have been warning against. I guess now would be a good time to have a “Just Say No to the Great ReSERF”:t-shirt printed.

Expand full comment
139 more comments...

No posts