b99977573610aea94800f2ed9fdf9cb2
Wasting Time With LLMs
Creative Commons Attribution-No Derivative Works 4.0
THE seemingly endless and paid-for hype in the media created a bubble; companies rebranded as "HEY HI" (AI) to attain imaginary valuations, based on products that did not exist or were falsely advertised. Now, months later, the hype is gone and the bubble is imploding (ChatGPT is losing users at a rapid rate).
Well, that simple observation, and combined with the fact that it is plagiarism as a service, should remind people not to bother with ChatGPT, both for practical and legal reasons. Remember the ongoing class action lawsuit. ⬆The Purdue team analyzed ChatGPT’s answers to 517 Stack Overflow questions to assess the correctness, consistency, comprehensiveness, and conciseness of ChatGPT’s answers. The US academics also conducted linguistic and sentiment analysis of the answers, and questioned a dozen volunteer participants on the results generated by the model.
"Our analysis shows that 52 percent of ChatGPT answers are incorrect and 77 percent are verbose," the team's paper concluded. "Nonetheless, ChatGPT answers are still preferred 39.34 percent of the time due to their comprehensiveness and well-articulated language style." Among the set of preferred ChatGPT answers, 77 percent were wrong.