Nothing says “Christmas cheer” like David Hume and empiricism. I am at EconLog this week with
Rediscovering David Hume’s Wisdom in the Age of AI
In our era of increasingly sophisticated artificial intelligence, what can an 18th-century Scottish philosopher teach us about its fundamental limitations? David Hume‘s analysis of how we acquire knowledge through experience, rather than through pure reason, offers an interesting parallel to how modern AI systems learn from data rather than explicit rules.
In his groundbreaking work A Treatise of Human Nature, Hume asserted that “All knowledge degenerates into probability.” …
Furthermore, I explain why this could have implications for the limits of AGI, if LLMs learn from experience and are limited in the number of datapoints they can observe. It is also a follow-up to my summer post: Is the Universe Legible to Intelligence?
Economist Writing Every Day 
I think this is a very important issue…”…It also suggests that we could soon approach the limits of AI, even as we invest more money and energy into the models. Intelligence, as we understand it, could have limits. The set of data we can provide LLMs, if it’s restricted to human-written text, will quickly be exhausted.” [from original article, linked above]
LikeLike