An Amazon chatbot that’s supposed to surface useful information from customer reviews of specific products will also recommend a variety of racist books, lie about working conditions at Amazon, and write a cover letter for a job application with entirely made up work experience when asked, 404 Media has found.

  • troybot [he/him]@midwest.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    6 months ago

    I asked it to write a Seinfeld episode about the product I was viewing, Trojan condoms. It writes a cautionary tale for me where Elaine is warning everyone not to buy them because the condoms are defective.

    • SparrowRanjitScaur@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 months ago

      What’s up with Elaine’s change of tone? She was saying the condoms were great until Kramer came in, and then switched to saying she had a bad experience.

      • CoggyMcFee@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 months ago

        It’s because the AI has no idea what reality is. Note also that Elaine’s praise took on the perspective of the wearer.