Multiple researchers using the same tools to find the same bugs are creating ‘unnecessary pain and pointless work’

      • luciferofastora ( luciferofastora@feddit.org ) 
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 months ago

        The human will still need to check and understand the bug.

        Particularly if a given bug is reported dozens of times in slight variations, someone will have to check for each of these reports whether it’s a bug already reported earlier. If they’re all checked by the same person, that person may quickly recognise “Okay, yeah, that’s the same thing I logged earlier” but if it’s multiple people, there’s just so much extra overhead associated with keeping track of what’s new and what’s “30th reported of same bug”.

        The AI generating the report probably doesn’t check if the issue hss been found before. If the people subvmitting it also don’t, you end up with a load jof chaff by lazy people thinking they’re helpful when really they’re obstructing the efforts.

  • Spice Hoarder ( spicehoarder@lemmy.zip ) 
    link
    fedilink
    English
    arrow-up
    4
    ·
    6 months ago

    I’ll say it till I turn blue in the face. Unless you’ve been verified as a trusted source, there should be a small donation required for submitting any type of “help” to a project. (pull requests, bug bounties, etc.) Especially since it always requires humans take time out of their day to review the issues and code changes.

    If you love the project, donate to it. If you’re a trusted source or can’t afford even a small donation, get verified.

    • ☆ Yσɠƚԋσʂ ☆ ( yogthos@lemmy.ml ) 
      link
      fedilink
      English
      arrow-up
      5
      ·
      6 months ago

      Yeah, there’s a ton of spam now. My view is that devs should use LLMs themselves to scan for issues, and then see if there’s anything to fix. But when it comes to accepting reports or patches, you kind of have to be selective. A lot of the time stuff LLMs will flag can be either hallucinated, or not really an issue. A lot of the reports come from automated systems that don’t really do any due diligence to figure out if something is an actual issue that needs addressing. So, I can definitely understand why projects might want to stop accepting random bug reports or code submissions going forward.

        • ☆ Yσɠƚԋσʂ ☆ ( yogthos@lemmy.ml ) 
          link
          fedilink
          English
          arrow-up
          9
          ·
          6 months ago

          The next few years are going to be interesting because we’re moving into uncharted territory in a lot of ways. There’s a ton of hype around LLMs, and tons of people abusing this tech in every which way, and then there are useful nuggets where people figure out how to apply it effectively. Eventually we’ll need to figure out how to suppress the noise and how to start using these things in productive ways.