Google rolled out AI overviews across the United States this month, exposing its flagship product to the hallucinations of large language models.

  • OpenStars@discuss.online
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    7 months ago

    Now who is anthropomorphizing? It’s not about “blame” so much as needing words to describe the event. When the AI cannot be relied upon, bc it was insufficiently trained to be able to distinguish truth from reality, which btw many humans struggle with these days too, that is not its fault but it would be our fault if we in turn relied upon it as a source of authoritative knowledge, merely bc it was presented in a confident sounding manner.

    No, my example is literally telling the AI that socks are edible and then asking it for a recipe.

    Wait… while true that that sounds like not hallucination then, what does that have to do with this discussion? The OP wasn’t about running an AI model in this direct manner, it was about doing Google searches, where the results are already precomputed. It does not become a “hallucination” until whoever asked for the socks to be considered as edible tries to pass those results off in a wider context - where they are generally speaking considered inedible - as being applicable, when they would not be.

    • FaceDeer@fedia.io
      link
      fedilink
      arrow-up
      1
      arrow-down
      2
      ·
      edit-2
      7 months ago

      Wait… while true that that sounds like not hallucination then, what does that have to do with this discussion?

      Because that’s exactly what happened here. When someone Googles “how can I make my cheese stick to my pizza better?” Google does a web search that comes up with various relevant pages. One of the pages has some information in it that includes the suggestion to use glue in your pizza sauce. The Google Overview AI is then handed the text of that page and told “write a short summary of this information.” And the Overview AI does so, accurately and without hallucination.

      “Hallucination” is a technical term in LLM parliance. It means something specific, and the thing that’s happening here does not fit that definition. So the fact that my socks example is not a hallucination is exactly my point. This is the same thing that’s happening with Google Overview, which is also not a hallucination.

      • OpenStars@discuss.online
        link
        fedilink
        English
        arrow-up
        1
        ·
        7 months ago

        Culture constantly evolves - e.g. “the matrix” used to mean one thing, then after the film starring Keanu Reeves it now means something else.

        Also AI itself used to mean one thing, as in general intelligence like a robot slave that has never performed a task before, but you tell it to become a maid and it teaches itself and becomes one just like a human would, but now the term has been coopted to mean the product of a training procedure. The managers at Google, Apple, Microsoft, OpenAI, ChatGPT, etc. don’t seem to mind or care about this bastardization of the terminology, as they borrow its power (from the movies and books and other works that have used “AI” in the former sense) while only paying lip service to actually putting in the effort to construct it.

        And even with its greatly reduced formulation in the sense of an LLM, they still don’t bother to train even that all that well - e.g. feeding it Reddit data that was intentionally corrupted as a result of Huffman’s having greatly offended and stolen the communities from the same mods who originally built them. Yes they stole the terms, yes they are using it improperly - but what is anyone going to do about it? Words only have meaning by the consent of those who use them.

        And if you are interested, I think you are fighting a losing battle bc of the way you are approaching it. Instead of acknowledging that others “know” the subject differently, and gently offering a nice perspective that they perhaps had not considered before - who isn’t interested in historical tidbits about topics of interest, when presented in a captivating manner? - you instead came on strong, saying that everyone else is wrong except you, who has the secret knowledge. I know, it’s true, but who cares? If your goal was to inform people, then do you think you succeeded? At least, I think you could have succeeded with a much wider audience. Ofc your words, so your call to do whatever you want with them, but I thought I would offer this perspective at least.

        They’re not hallucinations. People are getting very sloppy with terminology.

        This sounds like a temper tantrum, you blaming everyone else for how you feel about the matter. Again, right or wrong, doesn’t it sound like that to you now that I’ve pointed that out? Well, again, it’s your choice to think about that or not, but I did want to offer in case it may help:-).