Before starting tasks, developers forecast that allowing AI will reduce completion time by 24%. After completing the study, developers estimate that allowing AI reduced completion time by 20%. Surprisingly, we find that allowing AI actually increases completion time by 19%

N = 16

  •  cygnus   ( @cygnus@lemmy.ca ) 
    link
    fedilink
    arrow-up
    10
    ·
    edit-2
    6 months ago

    I wish they’d found a larger sample, but this is still interesting. The fact that much of the time is wasted on prompting makes sense. One important thing not mentioned however is that much of the market for vibe-coding tools is non-developers, i.e. people who don’t have the knowledge to actually do it themselves.