Amazon's AI Reportedly Suffering "Severe Hallucinations" and "Leaking Confidential Data"

QAmazon In a surprise announcement last week, Amazon’s cloud computing division announced a flashy new AI chatbot aimed at businesses called Amazon Q — not to be confused with OpenAI’s secretive Q*, pronounced Q star, which is rumored to be a separate and powerful new AI system. But according to leaked documents obtained by Platformer, Amazon’s launch is off to a rocky start. Q is reportedly suffering from “severe hallucinations” and is actively “leaking confidential data.” Things got so out of control that engineers had to work through the weekend to fix an incident marked “sev 2.” The tool even reportedly gave up the locations of Amazon’s Web Services data centers and leaked unreleased features. That doesn’t bode well for Amazon, considering the chatbot is explicitly aimed at businesses, which have historically been careful not to leak sensitive information to chatbots like OpenAI’s ChatGPT. Even Amazon’s own corporate lawyers have warned employees not to leak company to AI. Worse yet, to many, Q represents Amazon’s renewed efforts to establish itself in the ongoing AI race, which is largely being fought out by its competitors, most notably Microsoft and Google. Severe Hallucinations Of course, it’s not the first time we’ve heard of large language models “hallucinating” factual claims that aren’t true. OpenAI’s popular ChatGPT chatbot, which is built on the company’s GPT tech, still has plenty of trouble distinguishing between truth and fiction, and can easily be used to invent harmful narratives or spread misinformation. The stakes are also incredibly high…Amazon's AI Reportedly Suffering "Severe Hallucinations" and "Leaking Confidential Data"

Leave a Reply

Your email address will not be published. Required fields are marked *