As the researchers wrote in a summary of their findings, the “most common sycophantic code” they identified was the propensity for chatbots to rephrase and extrapolate “something the user said to validate and affirm them, while telling them they are unique and that their thoughts or actions have grand implications.”
There’s a certain irony in all the alright techbros really just wanting to be told they were “stunning and brave” this whole time.
I have a friend that’s really taken to ChatGPT to the point where “the AI named itself so I call it by that name”. Our friend group has tried to discourage her from relying on it so much but I think that’s just caused her to hide it.
I certainly enjoy talking to LLMs about work for example, asking things like “was my boss an arse to say x, y, z” as the LLM always seems to be on my side… Now it could be my boss is an arse, or it could be the LLM sucking up to me. Either way, because of the many examples I’ve read online, I take it with a pinch of salt.
okay how many of these “delusional” people in the study are making fun of the LLM tho
i don’t know because I don’t use the LLM i only see the screenshots. I am the control group. kinda. my nut is already off.
What I read in the first lines of the article is: “they go down the rabbit hole, just like social media echo chambers…” which are filled with bots and trolls, and have been for years - and that’s the dataset that a lot of chatbots are trained on.
and was filled with stuff like “hey wouldn’t it be funny to trick the AI into thinking you can make soup out of delicious caulk?” type stuff dammit don’t get me going off into the caulk rabbit hole right now
edit : yeah i heard it
Caulk rabbit
Paranoia amplification when ?
