• Margot Robbie@lemmy.world
    1286·
    10 months ago

    Due to having so many people trying to impersonate me on the internet, I’ve become somewhat of a expert on verification pictures.

    You can still easily tell that this is fake because if you look closely, the details, especially the background clutter, is utterly nonsensical.

    1. The object over her right shoulder (your left), for example, looks like if someone blended a webcam with a TV with a nightstand.
    2. Over her left shoulder (your right), her chair is only on that one side and it blends into the counter in the background.
    3. Is it a table lamp or a wall mounted light?
    4. The doorframe in background behind her head is not even aligned.
    5. Her clavicles are asymmetrical, never seen that on a real person.
    6. Her wispy hairstrands. Real hair don’t appear out of thin air in loops.
    • Honytawk@lemmy.zip
      451·
      10 months ago

      The point isn’t that you can spot it.

      The point is that the automated system can’t spot it.

      Or are you telling me there is a person looking at every verification photo, and if they did they would thoroughly scan the photo for imperfections?

      • Margot Robbie@lemmy.world
        255·
        10 months ago

        The idea of using a picture upload for automated verification is completely unviable. A much more commonly used system would be something like telling you to perform a random gesture on camera on the spot, like “turn your head slowly” or “open your mouth slowly” which would be trivial for a human to perform but near impossible for AI generators.

        • curiousPJ@lemmy.worldEnglish
          23·
          10 months ago

          but near impossible for AI generators.

          …I feel like this isn’t the first time I heard that statement before.

          • Margot Robbie@lemmy.world
            2·
            10 months ago

            It’s not that difficult to identify if you have a good understanding of photography principles. The lighting on this image is the biggest tell for me personally, since I can’t visualize any lighting setup that can cast shadows in the directions that’s shown on this picture, it just instinctually looks wrong to me on first sight because of the impossible light sources.

            That’s the reason the picture looks WRONG, even if you can’t identify the reason why it looks wrong.

            I only focused on the nonsense background clutters because I think it’s easier for people who don’t work around cameras all day.

            • ObsidianBlk@lemmy.world
              10·
              10 months ago

              This is what makes this technology anxiety inducing at best…

              So, for yourself, you have no issues seeing the artificiality of the image due to your extensive exposure to and knowledge of photographic principles. This is fair… that said, I have read your earlier comment about the various issues with the photo as well as this one about light sources, and I keep going back to scrutinize those elements, and… for the life of me… I cannot pick out anything in the image that, to me, absolutely screams artificial.

              I’m fairly sure most people who look at these verification photos would be in a similar boat to me. Unless there’s something glaringly obvious (malformed hands, eyes in the wrong place, a sudden cthulhu-esk eldritch thing unnaturally prowling the background holding a stuffed teddy bear) I feel most people would accept an image like this at face value. Alternatively, you’ll get those same people so paranoid about AI generated fakes they’ll falsely flag a real image as fake because of one or two elements they can’t see clearly or have never seen before.

              And this is only the infancy of AI generated art. Every year it gets better. In a decade, unless there are some heavy limitations on how the AI is trained (of which, only public models would ever really have these limitations as private models would train be trained on whatever their developers saw fit… to shreds with what artists and copyright said), there would probably be no real way to tell a real image from a fake out apart at all… photographic principals and all.

              Interesting times :D

        • iegod@lemm.ee
          12·
          10 months ago

          near impossible for AI generators

          That’s not really the case but moreoever the gap is closing at a blistering pace. Approximately two years ago this stuff was in the distant future. One year ago the lid was blown open. Today we’re seeing real-time frame generation. This rallying against the tech is misguided. It needs to be embraced and understood. Trying to do otherwise is great folly as everything will fall even further behind and lead to even larger misunderstandings. This isn’t theoretical. It’s already here. We can’t bury our heads in the sand.

        • EmergMemeHologram@startrek.website
          6·
          10 months ago

          If you look at gaussian splatting and diffusion morphs/videos, this is merely in the space of “not broadly on hugging face yet” and not impossible, or even difficult depending on the gesture.

          We’re months away from fully posable and animatable 3d models of these AI images. It already exists in demos and on arxiv, it runs on consumer hardware but not in realtime, so a video upload would work but a live stream would require renting a cloud GPU ($$$).

        • smooth_tea@lemmy.world
          5·
          10 months ago

          Having an AI act out random gestures is really not that different from generating an image based on a prompt if you think about it. The temporal element has already been done, the biggest factor right now is probably that it’s too computationally heavy to do in real time, but I can’t see that being a problem for more than a year.

      • nova_ad_vitum@lemmy.ca
        6·
        10 months ago

        More than that - these systems will eventually figure out how to not bitch the background so obviously. Then what? As others have said, we could switch to verification videos. That will be an extra year or two.

      • oce 🐆@jlai.lu
        5·
        10 months ago

        I think so. I don’t think there would be more than a few dozens of verification to do every day, with a dozen of mods, it seems doable in this context. It’s not like millions of users are asking for verification every day.

    • Smoogs@lemmy.world
      39·
      10 months ago

      Margot Robbie

      Due to having so many people trying to impersonate me on the internet

      Uh huh.

    • Aganim@lemmy.world
      252·
      10 months ago

      Her clavicles are asymmetrical, never seen that on a real person.

      Shit, are you telling me that every time I see myself in the mirror I’m actually looking at a string of AI generated images, generated in real-time? The matrix is real. 😱

      It’s either that, or my clavicles are actually very asymmetric. ☹️

      • Margot Robbie@lemmy.world
        91·
        10 months ago

        What I meant is that her right clavicle (your left) is about an inch higher than her left.

        I could be wrong, of course, but I imagine if that condition actually exists, then it would be extremely painful.

        • Gutless2615@ttrpg.networkEnglish
          191·
          10 months ago

          You’re reaching. I don’t think this is “easy” to tell as you’re making it at all. You’re benefiting enormously from knowing the results before you begin extrapolating.

        • UrPartnerInCrime@sh.itjust.works
          91·
          10 months ago

          I was agreeing with everything you’ve said, but I was in a pretty nasty bike accident years back which dislocated my clavical. Which now makes it sit about half an inch higher; mainly on the neck side. I was freaked out at first but the doctor said to just live with it so it can happen.

        • Aganim@lemmy.world
          2·
          10 months ago

          Yeah, I see what you mean, but my shoulders look almost exactly like that. Doesn’t hurt at all, just very annoying when carrying a backpack as the straps will always tend to slide off from my ‘drooping’ shoulder.

          But I agree with your comments about the background, that looks like a fever dream. And of course my situation isn’t the norm, so the shoulders/clavicles can be treated as a red flag, it’s just not definite proof and care should be taken to realise some people might actually just be built weird.

    • Phoenixz@lemmy.ca
      191·
      10 months ago

      Due to so many people trying to impersonate me on the Internet

      Yeah see, now I am not really sure if you’re the real Margot Robbie.

      Could you send me a verification picture?

      • Margot Robbie@lemmy.world
        15·
        10 months ago

        But then how will I astroturf (I mean, organically market) my current and future movies, like Golden Globe winning summer blockbuster, Barbie, now available on Blu-Ray and select streaming services, here if I get verified?

      • MystikIncarnate@lemmy.caEnglish
        3·
        10 months ago

        Me neither. There’s clearly more pictures that aren’t included here, so maybe on one of those?

        The odd thing about the hair in that picture to me is that on the left side of the photo, there’s one piece that seems to go on a nearly 90 degree bend for seemingly no reason, mid air. I don’t generally see hair get… Kinked like that. I suppose it’s not outside the realm of possibility, but it’s odd at least.

        The rest of the hair seems fine to me, but I’m no expert.

        I will note however that the object(s) in the background on the left side of the photo look like a gigantic (novelty sized) point and shoot camera from the 90’s. The box on top is the viewfinder and there’s the impression of a circle below that which would be the lens.

        Just makes me giggle at the thought of such a large disposable camera.

        • TheHarpyEagle@lemmy.world
          4·
          10 months ago

          Curly hair can look like that when it’s curling tightly towards/away from you. It looks fairly natural to me.

    • problematicPanther@lemmy.world
      181·
      10 months ago

      every time I’d seen this photo, I only focused on the subject in the foreground, if I were the one verifying that the person in the photo is real, I’d have fallen for it. To me, the subject is entirely convincing. the issues you mentioned about the clavicles and hair, i think kind of make it a bit more convincing. Nobody is completely symmetrical for one, so seeing something like that, while not common, wouldn’t be necessarily uncommon. The hair, to me, just looks like normal person hair. sometimes hair do be like that.

      • Riven@lemmy.dbzer0.com
        5·
        10 months ago

        Dude same, before I even read anything I was thinking ‘that’s a cute girl I didn’t know they started doing verifications on lemmy’ then I read and saw the whole hullabaloo.

    • lad@programming.dev
      11·
      10 months ago

      Didn’t get the 5^th point, there’s only one clavicle visible, am I missing something?

      • Bohurt@lemm.ee
        11·
        10 months ago

        Even so clavicles can be asymmetrical due to previous injury. We are pretty asymmetrical overall if you look closely enough.

        • TheFinn@discuss.tchncs.de
          2·
          10 months ago

          Well she’s Margot Robbie, so her clavicles are symmetrical af. She probably just assumes the rest of us are like that too 😓

    • Riven@lemmy.dbzer0.com
      6·
      10 months ago

      An easy ‘solution’ to fix the background is to just use a mild blurring tool. They’re verifying you not your house, it wouldn’t be sus to just have a mild messy blur around you.

      • Margot Robbie@lemmy.world
        6·
        10 months ago

        The bokeh effect is surprisingly hard to fake, actually, because it has to do with the physical properties of the camera lens. I think with a light Gaussian blur it would be even less convincing.

    • ManOMorphos@lemmy.world
      41·
      10 months ago

      The “holes” on her cheeks are easy to miss but seriously unsettling close up. They’re not like freckles or blackheads but more like what termite tunnels look like in wood.

      • cheesepotatoes@lemmy.world
        7·
        10 months ago

        Nah. They just look like big pores. There are a few giveaways here that it’s AI generated, but the pores aren’t one of them.

        Source: have big pores. Also, google images.

    • /home/pineapplelover@lemm.ee
      5·
      10 months ago

      I think ai can already do videos with people in them. Not without it looking completely natural though so there will be some discrepancies.

      • dustyData@lemmy.worldEnglish
        91·
        10 months ago

        AI video still looks like fever dreams. The AI can’t keep consistent details, specially in the background, from frame to frame. There’s always parts that morph and look like conjured up by Van Gogh during a maniacal delirium. Maybe in a couple of years and with some human grooming in the middle.

      • Coasting0942@reddthat.com
        1·
        10 months ago

        It’s purpose is also to reduce the chances.

        If somebody is going to go to all the trouble of fooling a human, they probably aren’t going to just start spamming random pictures on the community for an instant moderator ban.

  • HiddenLayer5@lemmy.mlEnglish
    50·
    10 months ago

    At some point the only way to verify someone will be to do what the Klingons did to rule out changelings: Cut them and see if they bleed.

        • BehindTheBarrier@programming.dev
          11·
          10 months ago

          I remember it being used at the “roast me” sub so the person verified they were actually the person in the image asking to be roasted.

        • Riskable@programming.devEnglish
          8·
          10 months ago

          Example: When famous people do an AMA. E.g. Obama did an AMA on Reddit and he was verified with a photo that would be very easy to fake today using AI.

        • EnderMB@lemmy.world
          3·
          10 months ago

          There are plenty of people making Instagram and OF accounts of fully AI girls. They are hilariously fake, but looking at some of the thirsty comments their posts get, I’m inclined to say that subreddits like /r/AmIUgly and /r/rateme are likely to end up with lots of verification posts that result in lots of scams.

          Although, as already pointed out, verification posts have always been easy for people to scam with Photoshop.

  • wick@lemm.ee
    39·
    10 months ago

    I can finally realise my dream of commenting on r/blackpeopletwitter

  • Striker@lemmy.world
    374·
    10 months ago

    Isn’t there a trick where you can ask someone to do a specific hand gesture to get photos verified. That’ll still work especially because AI makes fingers look wonky

    • fidodo@lemmy.world
      705·
      10 months ago

      AI has been able to do fingers for months now. It’s moving very rapidly so it’s hard to keep up. It doesn’t do them perfectly 100% of the time, but that doesn’t matter since you can just regenerate it until it gets it right.

      • YoorWeb@lemmy.world
        15·
        10 months ago

        “For your verification please close left eye and run two fingers through your hair while eating a cauliflower with whipped cream. Attach a paperclip to your left ear and write your username on your forehead using an orange marker.”

      • Paradachshund@lemmy.today
        13·
        10 months ago

        You could probably just set up a time for the person to send a photo, and then give them a keyword to write on the paper, and they must send it within a very short time. Combine that with a weird gesture and it’s going to be hard to get a convincing AI replica. Add another layer of difficulty and require photos from multiple angles doing the same things.

        • Vampiric_Luma@lemmy.ca
          101·
          10 months ago

          Lornas can be supplied to the AI. These are data sets of specific ideas like certain hand gestures, lighting levels, whatever style you need you can fine-tune the general data set with lornas.

          I have the minimum requirements to produce art and HQ output takes 2 minutes. Low-quality only takes seconds. I can fine-tune my art on a LQ level, then use the AI to upscale it back to HQ. This is me being desperate, too, using only local software and my own hardware.

          Do this through a service or a gpu farm and you can spit it out much quicker. The services I’ve used are easy to figure out and do great work for free* in a lot of cases.

          I think these suggestions will certainly be barriers and I can think of some more stop-gaps, but they won’t stop everyone from slipping through the cracks especially as passionate individuals hyper-focus on technology we think in passing continue working on it.

        • fidodo@lemmy.world
          6·
          10 months ago

          Simpler thing is to just have the user take a video. I’ve already seen that in practice.

        • ExperimentalGuy@programming.dev
          2·
          10 months ago

          I feel like there’s a way to get around that… Like if you really wanted, some sort of system to Photoshop the keyword onto the piece of paper. This would allow you to generate the image but also not have to worry ab the AI generating that.

          Edit: also does anyone remember that one paper that had to do with a new AI architecture where you could put in some sort of negative image to additionally prompt an AI for a specific shape, output, or position.

          • Unkn8wn69@monero.town
            2·
            10 months ago

            Just write on paper and overlay via Photoshop. Photopea has a literal one button click function for that very easy to do. Just blank paper and picture with enough light. Very easy

      • psud@lemmy.world
        12·
        10 months ago

        And it’ll get better if loads of verification posts are doing hand signs

    • Pasta Dental@sh.itjust.works
      830·
      10 months ago

      Some AI models have already nailed the fingers, this won’t do anything. We need something that we can verify without having to trust the other person. I hate to say it but the block chain might be one of the best ways to authenticate users to avoid bots

  • Willer@lemmy.world
    231·
    10 months ago

    AI pictures are like reverse uncanny-valley: They feel right, but you will shit brix upon further inspection.

  • CheeseNoodle@lemmy.worldEnglish
    13·
    10 months ago

    Thank goodness we can now use AI to do something that could already easily be done by taking a picture off someones social media.

    • Zoolander@lemmy.worldEnglish
      61·
      10 months ago

      I’m confused. How would that help? The whole point of a verification post is that the username in the image matches the username posting the image. If you’re just talking about Photoshop, then let’s be clear about that. Otherwise, taking photos off social media is no different than someone just Photoshopping any other verification image, even of themselves.

  • nifty@lemmy.world
    11·
    10 months ago

    Maybe it should just be a default policy to purposely alter the people in NSFW content that’s not associated with a professional who actively claims credit for that content. It’s all the same for the NSFW punters if the people in the material are unknown, but at least this way nonconsensual content is altered to protect someone’s privacy.