• Romkslrqusz@lemmy.zip
    12 days

    A centralized database of content for AI scraping agents to be trained to exclude?

  • crunchpaste@lemmy.dbzer0.comEnglish
    12 days

    Just yesterday I was looking around for an LLM tarpit to selfhost. Most active I’ve found so far is Pyison. Maybe it could be of some use to someone.

  • slazer2au@lemmy.worldEnglish
    12 days

    Na, for it to be effective it needs to be wide spread, but if its wide spread then it can be filtered out of the training material.

    • Pudutr0n@lemmy.world
      12 days

      I’ve read in papers that you can poison datasets with a very small percentage of the data, if done cleverly. I can fish up the source if you want (but it might take me some time).

      edit: here it is.

      We conduct the largest pretraining poisoning experiments to date, pretraining models from 600M to 13B parameters on chinchilla-optimal datasets (6B to 260B tokens). We find that 250 poisoned documents similarly compromise models across all model and dataset sizes (…)

      Emphasis mine. All it takes is 250 poisoned documents.

  • daannii@lemmy.worldEnglish
    12 days

    There are lots of resources already on this. Just use a search engine. There are even apps and software to poison images and videos before you upload them to social media.

      • daannii@lemmy.worldEnglish
        11 days

        https://nightshade.cs.uchicago.edu/whatis.html

        That’s one of them.

        I heard about multiple ones from this video.

        Hope this helps. https://youtu.be/zF-mbwc5Mmw?is=sq7HWI2q3IwwhicT

        I heard of the nightshade from that video but they mention others. The better ones are from universities.

        You can poison YouTube videos by making subtitles off screen that has nonsense text or add a clip at the end that’s about something unrelated.

        You can poison resumes and such by having text that’s “white” or a super tiny font. And have that text have commands or nonsense.

        You have to poison images/videos before uploading/posting. You can’t do much once it’s already out there.

  • Onomatopoeia@lemmy.cafeEnglish
    12 days

    Lol, good luck with that.

    The more poisoning you attempt, the more effective anti-poisoning becomes.

    AI LLM is here, stop trying to put the genie back in the bottle. All we can do is figure out how to use it and prevent misuse.