Wishing for my death or a World War. Either will do. Because FML or this world.

  • 0 Posts
  • 363 Comments
Joined 1 year ago
cake
Cake day: June 26th, 2023

help-circle
  • Does using authoritative sources is fool proof? For example, is everything written in Wikipedia factually correct? I don’t believe so unless I actually check it. Also, what about reddit or stack overflow? Can they be considered factually correct? To some extent, yes. But not completely. That is why most of these LLMs give such arbitrary answers. They extrapolate on information they have no way knowing or understanding.



  • This is something I already mentioned previously. LLMs have no way of fact checking, no measure of truth or falsity built into. In the training process, it probably accepts every piece of text as true. This is very different from how our minds work. When faced with a piece of text we have many ways to deal with it, which range from accepting it as it is to going on the internet to verify it to actually designing and conducting experiments to prove or disprove the claim. So, yeah what ChatGPT outputs is probably bullshit.

    Of course, the solution is that ChatGPT be trained by labelling text with some measure of truth. Of course, LLMs need so much data that labelling it all would be extremely slow and expensive and suddenly, the fast moving world of AI to screech to almost a halt, which would be unacceptable to the investors.


















  • fckreddit@lemmy.mltoScience Memes@mander.xyzMushroom ID
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    1 month ago

    Yeah, I have to agree with you. For example, I would have no problem using a decently tested LLMs for engineering simply because Engineering usually accounts for errors and uses appropriate factors to accommodate them. Sure LLMs could be get more accurate in future, but I believe the error will reduce asymptotically. Essentially, more accurate LLMs get, it will get that much harder to increase the accuracy. There is always a price to pay, IMO.