xAI’s new Grok feature is creating a flood of deepfakes.

“Subscribers to X Premium, which grants access to Grok, have been posting everything from Barack Obama doing cocaine to Donald Trump with a pregnant woman who (vaguely) resembles Kamala Harris to Trump and Harris pointing guns. With US elections approaching and X already under scrutiny from regulators in Europe, it’s a recipe for a new fight over the risks of generative AI.”

    • roofuskit@lemmy.worldEnglish
      34·
      3 months ago

      A lot of the commercially available image generators will block certain terms, like copyrighted characters or presidential candidates, or celebrities in their underwear. You can of course do this all without limits on your own hosted versions of stable diffusion and whatnot. But a commercially available option without any limits is actually news.

      • Todd Bonzalez@lemm.eeEnglish
        16·
        3 months ago

        The reason commercial image generators put those limits in place isn’t because they want to uphold an ethical use of their technology, but because they will get sued if they create a platform for making harmful images.

        Musk seems to be a big fan of getting sued lately, so best of luck to him on getting even more lawsuits against him.

      • codenul@lemmy.mlEnglish
        1·
        3 months ago

        Interesting. Just tested this on the publicly o one I use and typed in “President Biden, White house”. Sure enough it produced pictures of him standing within the White House but none of them had his face being displaying correctly. Either messed up, blurred out or just looked horrifying.