The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce plausible text, not true statements. ChatGPT is shockingly good at sounding convincing on any conceivable topic. But OpenAI is clear that there is no source of truth during training. That means that using ChatGPT in its current form would be a bad idea for applications like education or answering health questions. Even though the bot often gives excellent answers, sometimes it fails badly. And it’s always convincing, so it’s hard to tell the difference.Yet, there are three kinds of tasks for which ChatGPT and other LLMs can be extremely useful, despite their inability to discern truth in general:Tasks where it’s easy for the user to check if the bot’s answer is correct, such as debugging help.Tasks where truth is irrelevant, such as writing fiction.Tasks for which there does in fact exist a subset of the training data that acts as a source of truth, such as language translation.Let’s dive in. First the bad news, then the good.You’re reading AI Snake Oil, a blog about our upcoming book. Subscribe to get new posts.Accuracy is critical in many applications ChatGPT is the best chatbot released so far. It has delighted users over the last week by generating fantastically weird text, such as an explanation of how to remove a peanut butter sandwich from a VCR… in…ChatGPT is a bullshit generator. But it can still be amazingly useful