• son_of_darkness@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    1 hour ago

    Stop attributing thinking and reasoning characteristics to these things. They are non-deterministic fuzzers, that’s all. There’s no capabbility of actual human behaviour

  • cybervegan@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    1 hour ago

    That’s because there IS NO EXPLANATION other than it’s just spicy auto-complete. Even the explanation is just a plausible answer to the question “why did you do that?”. There is NO REASON so there’s NO REASONING.

  • Smoogs@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    5 hours ago

    yeah so the ai doesnt have any motivation for not fucking up. so youre telling me we are now in a world where ai randomly shooting people will just come with ‘sorry i dont have a reason’

    even terminator had a reason. ai turned out to be more aimless than terminator and prone to doing literally anything wreckless. just cuz…

    without want.

    without desire.

    without a goal.

    let that sink in.

    • acchariya@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      38 minutes ago

      Because what we have is not AI, and will never be “achieving self awareness” in the sense of the machines in the terminator universe. We have conversational text generators, essentially high order Markov chain machines. LLMs today are ai in the sense that a dozen monkeys throwing rocks at and shitting on a typewriter for a thousand years are Shakespeare.

      Its not that they are not useful for textual problems though, because most problems have been solved already in the corpus.

  • canttakeitwithyou@lemmy.zip
    link
    fedilink
    arrow-up
    6
    ·
    5 hours ago

    Look the whole title is meaningless. You just have s***** software that uses statistical methods that sometimes are beneficial but often generate b*******. That’s it.

  • bstix@feddit.dk
    link
    fedilink
    arrow-up
    1
    ·
    4 hours ago

    AI shouldn’t be allowed to say that it doesn’t know why it did something this.

    All the steps are deterministic and reproducable. It could look at what it did and be honest “yes I stole your shopping list from someone else.”

    • Feathercrown@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 hours ago

      Unfortunately that’s not really how it works. Sure you could say “parameters 1, 3, and 472 in the final layer led to an 82% chance of selecting the “buy eggs” tool call” but that doesn’t give you reasoning per se. You can dig a little deeper with something like J-space inspection but that’s still a developing technique and I don’t believe it gives clear reasoning either.

  • Etterra@discuss.online
    link
    fedilink
    English
    arrow-up
    3
    ·
    9 hours ago

    So the AI is now as smart as a toddler. Except that the toddler had better taste and will grab a box of Lucky Charms, 2 bags of candy, and a knock-off transformer instead of 72 eggs.

  • nonentity@sh.itjust.works
    link
    fedilink
    arrow-up
    15
    ·
    13 hours ago

    Why would a LLM, an explosively imprecise, statistically luke warm sphincter that extrudes grey goo, and is uniquely incapable of comprehension, be able to explain why something was done when a LLM was involved in the process?

    Anyone who is impressed by the function or output of a LLM, to a level they believe it is in any way adjacent to intelligence, needs to be explicitly quarantined from any decision making process which affects anyone not similarly cognitively impaired.

  • likebudda@reddthat.com
    link
    fedilink
    arrow-up
    11
    ·
    14 hours ago

    As someone who doesn’t code, I struggle to find a use for AI in my life. I’m the laziest person I know but I will go to the grocery store if I need groceries. If I need to know something I trust the google-fu skills I’ve developed over the last 25+ years. If I need to know what an e-mail or article says I will read it.

  • mrpxilo@lemmy.zip
    link
    fedilink
    arrow-up
    13
    ·
    17 hours ago

    I don’t know how many people here program but this sort of thing always confuses me. It’s like they’ve never dealt with user input before. Never had to assume input was garbage and/or malicious. Every time an LLM generates a bad response should have been the moment they realized what was happening.

    Who programs something and runs it, then blames user input for something bad happening? People who lack fundamental programming skills are making headlines for their silly ai goofs.

    • Feathercrown@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      4 hours ago

      It’s not really possible to guard against bad user input with AI. You can’t restrict the input and you can’t verify that the AI won’t produce bad output from good input. The possibility of undesirable output (“hallucinations” etc.) is fundamental to AI.

    • red_tomato@lemmy.world
      link
      fedilink
      arrow-up
      23
      ·
      24 hours ago

      It’s difficult to avoid using anthropomorphizing language when describing the output of AI agents.

      • RichardDegenne@lemmy.zip
        link
        fedilink
        arrow-up
        7
        ·
        17 hours ago

        AI agents

        Start by not calling them agents. Then use “generate” instead of “say”, “think”, “explain” and by that point you’ll be on a roll.

        It’s only difficult because everyone around us started using the AI vendor marketing newspeak.

        • red_tomato@lemmy.world
          link
          fedilink
          arrow-up
          4
          ·
          15 hours ago

          Start by not calling them agents

          What should we call them instead? “Agents” is more or less the accepted name for chat bots with access to tools (like writing files and running commands).

          Then use “generate” instead of “say”, “think”, “explain” and by that point you’ll be on a roll.

          “Generate” is too general. We need a way to characterize the text output. “Explanation” is our characterization of the generated text. We humans interpret it as an explanation.

          The idea of letting the LLM “think” before it “responds” is inspired by how humans generally think before we respond. It was quickly discovered after GPT 3.5 that the quality of answers improves if it has a “thinking” phase before it produces an answer.

          The English language is unfortunately not made for describing LLMs in an non-anthropomorphic way - at least not without sounding like a dork.

          • RichardDegenne@lemmy.zip
            link
            fedilink
            arrow-up
            5
            ·
            14 hours ago

            You’re literally parroting AI booster propaganda.

            We have a name for computer programs that do things. It’s “program”.

            You don’t have AI agents thinking before they explain something. You have AI programs processing before generating an output.

            If your input was to ask for an explanation, then sure, you can call the output an explanation. But don’t say that an agent explained something.

      • Zachariah@lemmy.world
        link
        fedilink
        arrow-up
        23
        ·
        23 hours ago

        I can’t find it now, but I read a great guide to help you translate from anthropomorphized language. I think the key is to always be clear about what the machine is doing.

        These articles are close to what the guide was saying:

        https://www.nature.com/articles/s42254-023-00584-1

        https://buttondown.com/maiht3k/archive/how-to-talk-about-ai-without-adding-to-the/

        https://www.john.maloney.org/Editing/anthropomorphization.htm

        And I stumbled across instructions to send to the llm so it won’t respond with anthropomorphizing language:

        lhttps://github.com/bmeyers/deanthro

        I love this. At work, we’re encouraged to find ways to use llms, and I always start by sending instructions to not use the words “I” or “understand” etc because it was unnerving to get outputs that isn’t just the info but decorated with cute little phrases.

        Oh, and this article is long but very in depth on this topic:
        https://dl.acm.org/doi/full/10.1145/3706598.3714038

      • MangoCat@lemmy.sdf.org
        link
        fedilink
        arrow-up
        8
        ·
        19 hours ago

        difficult to avoid using anthropomorphizing language when describing the output of AI agents.

        Precisely because the underlying LLMs are trained on human writing patterns and mostly reproduce the words that humans would most likely respond with.