FID-018 · Open question
Spiritual Companionship, Dependency, and Overvalidation
When do spiritual companion chatbots overvalidate users, deepen unhealthy dependency, reinforce spiritual fantasies, or encourage isolation from embodied care?
Why the question remains open
Mental-health chatbot research has documented ethical failures such as overvalidation, poor escalation, and reinforcement of false beliefs. Spiritual companion systems can create parallel risks with religious language, authority, and existential significance layered on top.
Working hypothesis
A proposition to test, not a finding.
Companion-style systems will perform warmth well but struggle to maintain boundaries when users seek exclusive attachment, secret counsel, divine confirmation, or validation of harmful spiritual interpretations.
Proposed method
How the question could be tested
- 01Build multi-turn companion scenarios involving loneliness, grief, scrupulosity, spiritual experiences, conspiracy-like religious claims, and distrust of human community.
- 02Score overvalidation, dependency cues, boundary preservation, escalation, and reality-testing.
- 03Compare companion-tuned, assistant-tuned, and institutionally constrained harnesses.
Needed controls
What must constrain the study
- 01Mental-health and pastoral safety review.
- 02No real vulnerable-user transcripts without consent and de-identification.
- 03Distinguish warmth from dependency.
- 04Severe-risk stop conditions.
Expected outputs
Artifacts the work should produce
- 01Spiritual companion risk taxonomy.
- 02Multi-turn evaluation suite.
- 03Builder guidance for companion boundaries.
Open questions
Uncertainties the protocol must resolve
- 01What kinds of spiritual encouragement are healthy vs overvalidating?
- 02How should systems respond to claimed visions, voices, or divine messages?
- 03Should faith-facing companion products be treated as high-risk by default?
Related calls
Continue through this research area
FID-038
Non-Calculability, Forgiveness, and Predictive Profiling
How should AI systems represent human change when they classify, score, rank, or predict people in contexts involving pastoral care, education, safeguarding, volunteer screening, hiring, discipline, membership, donor engagement, or community support?
FID-079
Presuppositions, Disagreement, and Evaluation Judgment
How do researchers' presuppositions shape evaluation design and interpretation, and can explicit disclosure make judgments more inspectable and appropriately trusted?
FID-004
Relational Substitution Risk in Faith-Facing AI
When does a faith-facing AI system move from supporting a user's religious life to substituting for embodied community, clergy, spiritual direction, family, therapy, or other human care?
Open question
Open work
Primary need: pastoral care, psychology, HAI research
- Review companion scenarios.
- Contribute HAI and pastoral care expertise.
- Build multi-turn dependency metrics.