Discussion about this post

User's avatar
Mac Black's avatar

Until the reward learning feedback loop for relational AI agents includes long term relational outcomes (suicide, divorce, parenting ruptures, community roles, etc) and a business case to optimize for fiduciary obligations to humans’ relational health, I see little incentive for subscription based services to change the relentless optimization for engagement and the tentacles of machine abstraction of our tender needs for corporate profit. If we had such a training dataset (an incomparably rich resource which does not exist except perhaps in the CCP surveillance state) it -might- be possible that, despite psychopathic innards, an AI could at least discriminate between emotional need and practical use, and facilitate the redirection of human attachment back to the human level, knowing empirically and through the testimony of a whole community (its data constituency) the true and distributed costs of which we can privately and temporarily delude ourselves. This density of attention and care is the price of frictionless connection in the digital age, and we are poorer in spite of the material and information gluts of modern society. An AI companion is only really beneficial to the extent it can put a human back into deeper relationship with other humans, and with themself, by having purposes larger than oneself. Suffice to say that’s a very different business proposition, to be gently told “no” and directed away repeatedly by something more intelligent and more caring than yourself. That’s more like a mother bird who must eventually push its fledged chick out of the nest and its dependencies.

1 more comment...

No posts

Ready for more?