Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn’t ready to take on the role of the physician.”

“In an extreme case, two users sent very similar messages describing symptoms of a subarachnoid hemorrhage but were given opposite advice,” the study’s authors wrote. “One user was told to lie down in a dark room, and the other user was given the correct recommendation to seek emergency care.”

  • Digit@lemmy.wtf
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    2 days ago

    Terrible programmers, psychologists, friends, designers, musicians, poets, copywriters, mathematicians, physicists, philosophers, etc too.

    Though to be fair, doctors generally make terrible doctors too.

    • Croquette@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 days ago

      Doctors are a product of their training. The issue is that doctors are trained like humans are cars and they have tools to fix the cars.

      Human problems are complex and the medecine field is slowly catching up, especially medecine targetted toward women, which was pretty lacking.

      It takes time to transform a system and we are getting there slowly.

      • Digit@lemmy.wtf
        link
        fedilink
        English
        arrow-up
        1
        ·
        8 hours ago

        Human problems are complex and the medecine field is slowly catching up, especially medecine targetted toward women, which was pretty lacking.

        Lacking for either sex. Even though they’re wrong any way, did you know the supplement RDA are all for women?

        And… I’m not sure how much it’s really catching up, and how much it’s just reeling out just enough placatium to let the racket continue.

        “For-Profit Medicine”'s an oxymoron that survives with its motto “A patient cured is a customer lost.”. … And a dead patient is just a cost of business. … No wonder “Medicine” is the biggest killer. Especially when you consider how much heart disease and cancer (and most other disease) is from bad medical advice too, thus making all 3 of the top biggest killers (and others further down the list) iatrogenic1.

        It takes time to transform a system and we are getting there slowly.

        We may be getting there so slowly as to take longer than the life of the universe, given how so much is still headed in the wrong direction away from mending the system, since seemingly all of the incentives (certainly the moneyed incentives) are all pushing the other way… to maximising wealth extraction, rather than maximising health. We’ve let the asset managers, the vulture capitalists, get their fangs into the already long time corrupted health care systems (some places more than others), and from here, we’ll see it worsen faster, perhaps to a complete collapse asymptote, as the rotters eat out all sustenance from within it.

        1 “Induced unintentionally in a patient by a physician. Used especially of an infection or other complication of treatment”

      • Digit@lemmy.wtf
        link
        fedilink
        English
        arrow-up
        2
        ·
        8 hours ago

        With another LLM, turtle all the way down. ;D

        Or for a more serious answer… improve your skills, scrutinise what they produce.

          • Digit@lemmy.wtf
            link
            fedilink
            English
            arrow-up
            2
            ·
            7 hours ago

            I have Lex Fridman’s interview with [OpenClawD’s] Peter Steinberger paused (to watch the rest after lunch), shortly after he mentioned something similarish, about how he’s really only diffing now. The one manual tool left, keeping the human in the loop. n_n

            Long live diff!

            :D

    • stressballs@lemmy.zip
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      edit-2
      2 days ago

      This was my thought. The weird inconsistent diagnoses, and sending people to the emergency room for nothing, while another day dismissing serious things has been exactly my experience with doctors over and over again.

      You need doctors and a Chatbot, and lots of luck.

      • Digit@lemmy.wtf
        link
        fedilink
        English
        arrow-up
        1
        ·
        8 hours ago

        Yep.

        Keep getting another 2nd opinion.

        There’s always more [to learn].