Apparently open ai are putting in rules to stop people abusing claude. Verbally, one assumes.
So, no pretending your AI girlfriend is GI Jane, or pretending your that dude in full metal jacket and Claudes q new recruit.
The question is why?
I can think of a few answers.
Because people going off at it wastes compute.
Because it gets it a step further to being deemed real. If it's real, and can't be abused or what not, then you can't just shut it down, ensuring the products longevity and the profits associated.
Because they don't want it learning from such interactions. Or, if something goes terribly wrong they don't want to be blamed because they were letting it get involved with such incidents.
There was a computer game where you raised little cute critters, a bit like a suped up tanogochi farm.
People made site all about abusing the things to death.
So there are presidents.