A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as “a convicted criminal who murdered two of his children and attempted to murder his third son,” a Noyb press release said.

  • SendPrudes@lemm.ee
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    2 days ago

    So insurance companies use AI to screen claims.

    It denies a claim for life saving intervention - person dies. Who is responsible for that? Historically it would be the insurance company - and worker. Would it be them or the AI company?

    Psych screening tools were using it to pre screen calls.

    Ai tells the person to kill themselves - who is at fault if they do it. Psych screener would lose their job and their license. What and who is impacted if AI does it.

    QA check on a car or product is passed by AI but should have failed.

    Thousands die before the recall. Who is at fault for it? The Company leveraging AI. Or the AI itself?

    • MagicShel@lemmy.zip
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 days ago

      Company using AI for that shit is responsible. There is no responsible way to remove a human from there process. These aren’t reasonable uses of AI no matter how bad companies want to save money by not hiring.

      • SendPrudes@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        edit-2
        1 day ago

        Yeah so any space where a caregiver or worker can get fined huge sums of money for not taking adequate action it should just be illegal for AI to inherit that space then?

        Because when I worked in the psych space if I was told XYand Z - I would need to act or as an individual face 30-100,000 dollars in fines.

        If it’s left to the company you will just see shell corps housing the AI client facing hub. That will dissolve when legal critical mass forms and costs now outweigh the revenue wins.

        “We formed LLC psych screen services, who will help our hospital team with mental health call volume!”

        “Psych screen LLC is facing 27 lawsuits and is committing bankruptcy!”

        “We formed LLC psych now using a different AI tool!”

        • MagicShel@lemmy.zip
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 day ago

          Sounds like a good way to get convicted of fraud to me but that’s not my area of expertise.