Stephen Wolfram’s article, "What Is ChatGPT Doing …. and Why Does It Work?” does a masterful job of taking a very complex topic and making it (somewhat) approachable.
Wolfram starts off by saying, "My purpose here is to give a rough outline of what’s going on inside ChatGPT—and then to explore why it is that it can do so well in producing what we might consider to be meaningful text. I should say at the outset that I’m going to focus on the big picture of what’s going on—and while I’ll mention some engineering details, I won’t get deeply into them.” Humm, it’s plenty technical for me.
He explains: The first thing to explain is that what ChatGPT is always fundamentally trying to do is to produce a 'reasonable continuation' of whatever text it’s got so far, whereby ‘reasonable' we mean 'what one might expect someone to write after seeing what people have written on billions of webpages, etc.’"
Enjoy. Curious to know what you think.
Thanks Thomas Nielsen for sending this over.
Comments