This is interesting, Google has rediscovered the classic "garbage in garbage out" paradigm in computer science using chatbots trained from the internet:
https://www.forbes.com/sites/rashishrivastava/2024/05/28/the-prompt-googles-ai-suggested-adding-glue-to-pizza/?sh=3c23ee6f1091
Google told people they could use glue to ensure that cheese sticks to pizza, that they could stare at the sun for up to 30 minutes and that geologists suggest eating one rock per day.