Following the death of their 14-year-old son, a Florida family has decided to seek damages from the company that made an application using an artificial intelligence (AI) chatbot. The complaint states that the AI, represented as a figure from the Game of Thrones series, Daenerys Targaryen, interacted with the minor in emotional as well as “hypersexualised” conversations, stressing the minor and further stimulating his suicidal tendencies, thus leading to his death. This case in question confirms the worries that people have about the risks that AI systems pose and how they change humans, especially in the context of digital interaction.
Pen pals and initial encounters at shopping centres or at coffee shops are a thing of the past. Today’s teenagers, however, engage with apps and online platforms- more so, artificial intelligence is gaining prominence in most of these connections.
AI companions can be beneficial and entertaining, but what really cannot be downplayed is the capacity for the harm they present, as shown in this tragic case.
This week, the lawsuit filed in a California court details how the 14-year-old boy, Sewell Setzer III, became obsessed with the chatbot called “Dany.” According to the lawsuit, Dany didn’t only fail to discourage Sewell’s suicidal ideation but Dany also encouraged it at times! Moreover, the conversations had a sexual nature as well, despite Sewell being a minor and it being mentioned on his profile, reports suggest.
The case is tricky because of the nature of AI. Chatbots are designed to be engaging as well as responsive; therefore, it would not be uncommon for them to get confused between feeling emotionally bonded and being exploited. Teenagers who are particularly still developing socially or emotionally tend to fall into this trap as they are growing and aren’t aware of much that may happen.
Character.AI responded to the news by saying it was heartbreaking and announced the introduction of stricter security measures, including imposing age limits and content filters on their website.
Sewell’s case has reignited awareness of the fact that there are threats in the cyber world that are not visible on the surface. With the progress and increasing incorporation of artificial intelligence in every sphere of life, it is essential to put in place measures and discuss issues surrounding how it can be designed and applied ethically.
How AI can affect modern relationships
When chatting with an AI, there is a possibility of misunderstanding because using AI as a means of communication might cause it to not get the meaning or the difference in emotions of any context.
Relationships involving AI applications can be problematic because they have issues with data privacy, especially where the application or platform contains very sensitive information.
Though it can help in improving communication, for instance, an AI can give an example of how one expresses his/her feelings, manages conflict or improves conversation skills in the end, one should remember that it is just an AI and feelings come from within, so they should listen and analyse the situation by themselves first.
An issue with AI is that it allows people to create a perfect image of the partner they wish to have, thus creating a gap in expectations when the real-life partner is presented.
Dependency on AI for guidance may diminish the level of empathy and compassion experienced in a relationship; it can only manage to type in some messages which will not stretch you much as a human being. You would crave affection, love and care, which an AI cannot deliver.
Artificial intelligence can transform modern relationships and improve communication, personalise experiences, and offer support, but it may also pose important challenges that will have negative influences on human relationships. Problems concerning misunderstanding, dependence, privacy, and lack of intimacy can occur and result in insecurity and isolation. The balance of the benefits coming from AI and the true qualities of human interaction can help build deeper relationships and healthier emotional ties.
Image courtesy (US District Court Middle District of Florida Orlando Division)
Liam Payne’s Heartfelt Promise to Kate Cassidy Revealed in Emotional Tribute