Moderation is work. Trolls traumatize. Humans powertrip. All this could be resolved via AI.

    • Well giving that power to a human isn’t so great either, clearly.

      We already use text filters as a moderation bot. So we’re just looking at improving the bot.

      Maybe we’re just looking for a way for the bot to recognize more complex patterns.

  • Elaine Cortez ( Corno@lemm.ee ) 
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 years ago

    I’ve read about people being automatically banned by AI for saying something along the lines of “I hate burritos” because it had the word “hate” in it, so the AI judged their comment as hate speech and auto-banned them even though they were talking about food or a videogame character. AI is not very good at reading context and the “A” in “AI” is an important detail here.

  • More “accurate” or otherwise, moderating is community engagement. We cultivate our communities by posting relevant content and removing what we find unacceptable. What are we doing if we are not doing both? Allowing a computer to sort the former and the latter? No thank you.

  • orcrist ( orcrist@lemm.ee ) 
    link
    fedilink
    arrow-up
    3
    ·
    2 years ago

    The moderation impossibility theorem says that your idea will fail. Also, what do you think AI is? People are keen to say “AI”, but they’re incredibly tentative about providing any details.

    More importantly, what problem do you think you’re solving? We all agree that trolling and power tripping occur, but what specifically are you trying to address? I’m not sure you know, and this is really important.

  • Zelaf ( Zelaf@sopuli.xyz ) 
    link
    fedilink
    arrow-up
    2
    ·
    2 years ago

    I could see it function very well as an aid in moderation but not any type of solution like most things with AI is today.

    In the case of Lemmy and other defederated social media platforms there’s going to be the usual cost hindrance and then the ethical side of it with excessive electricity usage and training data.

    Disregarding that, as most know and everyone should know, AIs are not to be considered reliable or accurate ever. They will falsely flag and give false positives to potential comments and posts and images.

    However, having an AI aggregate a list of potential bad comments and posts, then have a user manually checking the results, could help with moderation efficiency. Because how many users actually report comments and posts? How many do mods actually miss out on? There’s a lot of content and limited time.

  • Vanth ( Vanth@reddthat.com ) 
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 years ago

    Aren’t there already some automated mod tools working to delete CSAM and shit? That’s a form of AI.

    But all moderation problems you identify (work, biases) would not fully go away with AI moderation. Someone has to build and manage those tools (work) and train them on how to moderate (incorporating their biases as they do so).

  • Alice ( Alice@beehaw.org ) 
    link
    fedilink
    arrow-up
    1
    ·
    2 years ago

    I’m just curious how this would differ from automatic moderating tools we already have. I know moderating actually can be a traumatic job due to stuff like gore and CSEM, but we already have automatic filters in place for that stuff, and things still slip through the cracks. Can we train an AI to recognize it when it hasn’t already been put into a filter? And if so, wouldn’t it hit false positives and require an appeal system, which could still be used to traumatize people?