Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong

United Kingdom News News

Study Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrong
United Kingdom Latest News,United Kingdom Headlines
  • 📰 futurism
  • ⏱ Reading Time:
  • 45 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 21%
  • Publisher: 68%

Science and Technology News and Videos

In recent years, computer programmers have flocked to chatbots like OpenAI's ChatGPT to help them code, dealing a blow to places like Stack Overflow,That's a staggeringly large proportion for a program that people are relying on to be accurate and precise, underlining what other end users like writers and teachers are experiencing: AI platforms like ChatGPT often hallucinate totally...

For the study, the researchers looked over 517 questions in Stack Overflow and analyzed ChatGPT's attempt to answer them. "We found that 52 percent of ChatGPT answers contain misinformation, 77 percent of the answers are more verbose than human answers, and 78 percent of the answers suffer from different degrees of inconsistency to human answers," they wrote.

What's especially troubling is that many human programmers seem to prefer the ChatGPT answers. The Purdue researchers polled 12 programmers — admittedly a small sample size — and found they preferred ChatGPT at a rate of 35 percent and didn't catch AI-generated mistakes at 39 percent.

The study demonstrates that ChatGPT still has major flaws — but that's cold comfort to people laid off from Stack Overflow or programmers who have to fix AI-generated mistakes in code.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

futurism /  🏆 85. in US

United Kingdom Latest News, United Kingdom Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Study: Only 25 percent of U.S. adults have used VR but retention is highStudy: Only 25 percent of U.S. adults have used VR but retention is highAbdullah is an ardent believer in the future of VR, and can't wait to see what more it brings to the table as technology improves. He enjoys covering new software releases in the XR industry, as well as major news about hardware and companies focused on VR.
Read more »

The spiciness of mustard may depend on soil microbesThe spiciness of mustard may depend on soil microbesNew study finds microbes may influence the taste of mustard seeds.
Read more »

AI transcription tools ‘hallucinate,’ tooAI transcription tools ‘hallucinate,’ tooStudy finds surprisingly harmful fabrications in OpenAI’s speech-to-text algorithm
Read more »

Our brains are growing. Will that help prevent dementia?Our brains are growing. Will that help prevent dementia?UC Davis study finds brain size has steadily increased for people born after the 1930s.
Read more »

To combat cow flu outbreak, scientists plan to infect cattle with influenza in high-security labsTo combat cow flu outbreak, scientists plan to infect cattle with influenza in high-security labsNovel effort comes as study finds key receptor for avian flu virus in udders
Read more »

Olive oil could lower risk of dementia-related death, study findsOlive oil could lower risk of dementia-related death, study findsChloe Nordquist is a national journalist for the E.W. Scripps Company. She has a passion for telling community stories and giving a voice to the voiceless. Chloe has had the opportunity to report across the world, as far as Milan and Berlin. Previously she worked at news stations in California’s Central Valley and Southwest Florida.
Read more »



Render Time: 2025-04-12 21:20:45