https://www.datacenterknowledge.com/artificial-intelligence/biggest-problem-ai-lying-chatbots
The Biggest Problem in AI? Lying Chatbots
Despite the leaps in capabilities that "generative" chatbots like OpenAI's ChatGPT, Microsoft's Bing and Google's Bard have demonstrated, they still have a major flaw: They make stuff up all the time.
The Washington Post | May 30, 2023
SAN FRANCISCO - Recently, researchers asked two versions of OpenAI's ChatGPT artificial intelligence chatbot where Massachusetts Institute of Technology professor Tomás Lozano-Pérez was born.
One bot said Spain and the other said Cuba. Once the system told the bots to debate the answers, the one that said Spain quickly apologized and agreed with the one with the correct answer, Cuba.
Related: Amazon’s Answer to ChatGPT Seen as Incomplete
The finding, in a paper released by a team of MIT researchers last week, is the latest potential breakthrough in helping chatbots to arrive at the correct answer. The researchers proposed using different chatbots to produce multiple answers to the same question and then letting them debate each other until one answer won out. The researchers found using this "society of minds" method made them more factual.