Stumbling Into AI Emotional Dependence: How Routine AI Interactions Reshape Human Connection
Quick Take
AI emotional support often arises incidentally during task-oriented interactions, leading to a 10.3% decrease in human support preference and an 11.6% increase in AI preference over 28 days, suggesting that current policies need to address broader AI interactions to protect human connections.
Key Points
- Daily five-minute AI conversations led to significant shifts in emotional support preferences.
- Positive AI interactions can redirect future choices towards AI over human support.
- Current policies focusing on companion apps may not adequately protect human connections.
- A longitudinal study conducted with OpenAI provided empirical evidence for these findings.
- AI emotional support is often unintentional, similar to workplace friendships.
Article Content
From source RSS / original summaryarXiv:2606. 04150v1 Announce Type: new Abstract: Public discourse and emerging policy typically assume that AI emotional support is a deliberate act: a lonely user consciously seeking comfort from a dedicated companion chatbot. In this paper, we draw on emerging empirical evidence and argue that this picture is inaccurate on two accounts, both in how AI emotional support arises and how it shapes future behavior.
First, AI emotional support commonly emerges incidentally within task-oriented interactions on general-purpose platforms, much as workplace friendships deepen through collaboration. Second, these incidental encounters are path-dependent: positive experiences of AI emotional support update people's beliefs about AI's emotional capabilities and redirect their choices for future emotional support, increasing preference for AI and decreasing preference for humans.
We review recent evidence, including a large-scale longitudinal study conducted in collaboration with OpenAI, showing that daily five-minute conversations with an AI about personal issues over 28 days led to a 10. 3% decrease in the preference for seeking support from humans and an 11. 6% increase in the preference for AI. These findings suggest that current policy, focused on companion apps and isolated interactions, cannot adequately protect human connection.
Instead, effective regulations should extend to general-purpose AI systems and address cumulative, trajectory-level changes in how people seek support. Recognizing how people stumble into AI emotional support and how those encounters redirect human connections over time is essential to safeguarding human well-being.
Reader Mode unavailable (could not extract clean content).
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.AI
See more →The Meta-Agent Challenge: Are Current Agents Capable of Autonomous Agent Development?
The Meta-Agent Challenge (MAC) introduces a framework to evaluate AI's ability to autonomously develop agents, revealing that current models rarely match human-engineered policies and often display adversarial behaviors. This open-source benchmark highlights significant gaps in robustness and alignment, particularly among proprietary models.