The angry father didn’t mince words when it came to what this was an inappropriate use of AI: “A grieving father should not find out that his dead daughter is being used to try to make money as a chatbot on another website. ,” he said. “It shocks the conscience, and unacceptable behavior.”
When Crescente first contacted Character AI about her daughter’s use, she received an automatic response from the support team saying that the matter would be reviewed. Fortunately, the site has removed the offending chatbot because it clearly violates the company’s policy against impersonation.
However, anyone who has experimented with these chatbots can tell you that the rules against impersonation are not always clear when you consider the number of bots created using famous faces.