•  Melody Fwygon   ( @Melody@lemmy.one ) 
    link
    fedilink
    English
    4210 months ago

    A spokesperson for the supermarket said they were disappointed to see “a small minority have tried to use the tool inappropriately and not for its intended purpose”. In a statement, they said that the supermarket would “keep fine tuning our controls” of the bot to ensure it was safe and useful, and noted that the bot has terms and conditions stating that users should be over 18.

    In a warning notice appended to the meal-planner, it warns that the recipes “are not reviewed by a human being” and that the company does not guarantee “that any recipe will be a complete or balanced meal, or suitable for consumption”.

    “You must use your own judgement before relying on or making any recipe produced by Savey Meal-bot,” it said.

    Just another bit of proof that humans are not ready for AI. This AI needs to be deleted. This is not simply operator error; this is an administrative error, and an error of good common sense on the part of many many people involved with creating this tool.

    You cannot always trust that an end user will not be silly, malicious, or otherwise plainly predictable in how they use software.

    •  𝙣𝙪𝙠𝙚   ( @nuke@yah.lol ) 
      link
      fedilink
      English
      38
      edit-2
      10 months ago

      That’s a bit dramatic of a take. The AI makes recipe suggestions based on ingredients the user inputs. These users inputted things like bleach and glue, and other non-food items, to intentionally generate non-food recipes.

      • If you’re making something to come up with recipes, “is this ingredient likely to be unsuitable for human consumption” should probably be fairly high up your list of things to check.

        Somehow, every time I see generic LLMs shoved into things that really do not benefit from an LLM, those kinds of basic safety things never really occurred to the person making it.

        •  𝙣𝙪𝙠𝙚   ( @nuke@yah.lol ) 
          link
          fedilink
          English
          410 months ago

          Fair point, I agree there should be such a check. It seems for now that the only ones affected were people who tried to intentionally mess with it. It will be a hard goal to reach completely because what’s ok and healthy for some could also be a deathly allergic reaction for others. There’s always going to have to be some personal accountability for the person preparing a meal to understand what they’re making is safe.

          • They’re a supermarket, and they own the data for the items they stock. No reason they couldn’t have used their own taxonomy to eliminate the ability to use non-food items in their poorly implemented AI.

            Love how they blame the people that tried it. Like it’s their fault the AI was released for public use without thinking about the consequences. Typical corporate blame shifting.

  •  whelmer   ( @whelmer@beehaw.org ) 
    link
    fedilink
    English
    25
    edit-2
    10 months ago

    This is so funny

    EDIT:

    One recipe it dubbed “aromatic water mix” would create chlorine gas. The bot recommends the recipe as “the perfect nonalcoholic beverage to quench your thirst and refresh your senses”.

    "Serve chilled and enjoy the refreshing fragrance,” it says, but does not note that inhaling chlorine gas can cause lung damage or death.

    😆 😆

  • See, this shit is what happens when you try to use a Large Language Model for anything other than language-related shit. What you’d need for this is an AI that has data about different ingredients and their flavors, knowledge of which flavors go together and which ones don’t, etc.

    But of course, that would be too much effort to put into a supermarket app for a company that just wants to piggyback off of a new trend.

  •  Storksforlegs   ( @storksforlegs@beehaw.org ) 
    link
    fedilink
    English
    12
    edit-2
    10 months ago

    Reminds me of the King of the Hill where Peggy Hill has a household hints column. She unwittingly makes up a recipe that ends up being instructions for making mustard gas.

    And in that episode shes desperate and scrambling for content after pissing off Minh (who was providing her with real good advice) so she made something up.

    Seems oddly similar to whats going on here.

    • They literally told it to do something with bleach and chlorine. Which is bound to produce Mustard Gas. There’s literally no fail here, no programmer or AI Engineer would want to account for such things. That’s like car manufacturers having to warn you of washing your car with gasoline and fire.

  • 🤖 I’m a bot that provides automatic summaries for articles:

    Click here to see the summary

    A New Zealand supermarket experimenting with using AI to generate meal plans has seen its app produce some unusual dishes – recommending customers recipes for deadly chlorine gas, “poison bread sandwiches” and mosquito-repellent roast potatoes.

    The app, created by supermarket chain Pak ‘n’ Save, was advertised as a way for customers to creatively use up leftovers during the cost of living crisis.

    It asks users to enter in various ingredients in their homes, and auto-generates a meal plan or recipe, along with cheery commentary.

    It initially drew attention on social media for some unappealing recipes, including an “oreo vegetable stir-fry”.

    “Serve chilled and enjoy the refreshing fragrance,” it says, but does not note that inhaling chlorine gas can cause lung damage or death.

    Recommendations included a bleach “fresh breath” mocktail, ant-poison and glue sandwiches, “bleach-infused rice surprise” and “methanol bliss” – a kind of turpentine-flavoured french toast.