Back to Rankings

Recommendation Feedback Loops Shape Urban Income Segregation and Venue Visitation

Guangyuan Weng, Lin Chen, Ciro Beneduce, Giovanni Mauro, Massimiliano Luca, Takahiro Yabe, Bruno Lepri, Luca Pappalardo

Oct 30, 2026arXiv:2610.41911v1
cs.IRcs.CYcs.SIphysics.soc-ph
Share
Scorecard· 16/16
7.0/10 impact

Timely, well-executed simulation study with counterintuitive accuracy–segregation findings and an actionable mitigation, limited by simplified behavior (adoption=1), static venue supply and no real-world validation.

Abstract

Location-based recommender systems shape where people go in cities and learn from the visits they steer, forming a human-AI feedback loop. This feedback loop shapes whom people share places with across income groups and which venues keep attracting customers. Yet platforms judge these systems by their offline accuracy on past visits, a test in which the suggestions never change where people go and which therefore cannot capture long-term effects. Studying these effects in cities is challenging because, unlike online resources, travel constraints and limited venue capacity shape where people can go, while each recommended visit also changes whom other visitors encounter. To capture such features, we build a long-term simulation framework based on fine-grained human mobility data from four U.S. metropolitan areas, with distance and capacity constraints. Focusing on food venues, we study two urban consequences: how unevenly people's exposure is distributed across income groups (experienced income segregation) and the share of venues receiving no visits from simulated residents (venue disappearance). We find that, under every algorithm and in every metropolitan area, at least a fifth of venues stop receiving visits, and that more than half of this loss arises from retraining. More importantly, more accurate algorithms leave people more segregated, and the most accurate algorithm leaves people 15-21% more segregated than they actually are. We then test a re-ranking intervention that favours less popular venues and runs on top of a platform's existing algorithm. It lowers both venue disappearance and segregation across algorithms, largely without directing people to venues where they may feel less comfortable. Our results suggest that impact assessments of recommender systems should account for the feedback loop and report segregation and venue disappearance beyond accuracy.

AI Impact Assessments

(1 model)

Impact Assessment: Recommendation Feedback Loops Shape Urban Income Segregation and Venue Visitation

Core Contribution

The paper builds a long-horizon (about three years of weekly retraining) simulation of the human–AI feedback loop for location-based recommenders. It is grounded in Cuebiq GPS traces from four U.S. metros (Boston, San Francisco, Detroit, Chicago) and respects distance and venue-capacity constraints. Non-simulated visitors keep their observed visits, so recommendations to simulated residents also change the income mix other people encounter.

It measures two urban outcomes: experienced income segregation (Moro et al.'s measure) and "venue disappearance," the share of venues with no simulated visits.

The headline findings are:

  • Retraining accounts for 55–75% of venue disappearance.
  • Offline accuracy and segregation are ordered identically across four algorithms (UR-POI > ItemKNN > UserKNN > Markov). The most accurate algorithm, UR-POI, yields 15–21% more segregation than observed.
  • Losses concentrate in less active, lower-income tracts.
  • A simple popularity-tail re-ranking ("tail-boost") cuts venue disappearance by 54–75% within a 15% NDCG budget. It lowers segregation for three of four algorithms while largely preserving "comfortableness."
  • The conceptual advance is moving recommender evaluation from out-of-loop accuracy to in-loop, distributional, spatially grounded outcomes. The paper adds capacity constraints, social coupling and real GPS schedules to the prior Mauro et al. check-in-based urban simulation.

    Methodological Rigor

    Strengths

  • The out-of-loop control cleanly isolates retraining effects.
  • Five seeds with confidence intervals.
  • Paired comparisons.
  • Robustness checks over capacity and adoption (Boston only) and a second venue category (outdoor/recreation).
  • A random-choice baseline shows segregation depends on ranking rather than reachability alone.
  • A LightGCN reference.
  • A ranking-only ablation separates how tail-boost works (changing prominence vs. flattening choice probabilities).
  • An xQuAD comparison shows personalized diversification is ineffective here.
  • Spatial-block bootstrap for the tract regression.
  • Public code.
  • Weaknesses

  • The behavioral model is simple. The main setting uses adoption a=1, so every food trip follows the recommendations. This is unrealistic and probably overstates effects, although lower adoption was tested in Boston only.
  • Residents choose among K=20 venues proportional to min–max scores, with no preference or taste model beyond the recommender scores.
  • Schedules repeat every six months and venue supply is static: no venue entry or exit, and no real closures. "Disappearance" means zero simulated-resident visits, not business failure. The label risks overreach, since real venues have other traffic sources (non-simulated visitors, walk-ins, non-platform discovery).
  • Income is a block-group proxy.
  • Only four classic algorithms are tested, with no modern sequential or LLM recommenders. LightGCN appears in Boston only.
  • The accuracy–segregation "tradeoff" rests on four algorithms that differ along many dimensions, so it is correlational across algorithm types, not a mechanistic law. The ordering coincides with reliance on own history vs. others' visits.
  • No external validation against a real deployed platform, so the simulation outputs are counterfactual and unverifiable.
  • Several results come from one simulation per setting (Table 2).
  • Mitigation was tested in Boston only.
  • Tail-boost lowers segregation only modestly, and it slightly raises it for UserKNN and Markov at low λ.
  • Comfortableness is a limited proxy for user welfare, and accuracy is measured only offline.
  • Potential Impact

    The work speaks directly to recommender evaluation (accuracy-only paradigms), the human–AI coevolution literature, urban computing and computational social science. It also speaks to algorithmic auditing under the EU Digital Services Act. The practical message is actionable: report segregation and venue-visibility metrics alongside accuracy. Switching UR-POI to ItemKNN costs about 4–5% NDCG yet lowers both harms, and a simple re-ranker works on top of any base algorithm. Platforms such as Google Maps, Yelp and Foursquare, or auditors and regulators, could in principle use the framework, though it needs proprietary-quality mobility data. Policy relevance is high, but adoption by platforms is uncertain, and the framework's usability depends on access to GPS data like Cuebiq's.

    Timeliness & Relevance

    It is highly timely. Feedback-loop effects, regulatory systemic-risk assessments, the rise of LLM-based place recommenders, and the experienced-segregation literature all converge here. The authors acknowledge that LLM assistants remain for future work.

    Strengths

  • Realistic, constraint-aware urban simulation that fills a clear gap relative to online-item feedback-loop studies.
  • Counterintuitive and communicable findings, such as the best accuracy giving the worst segregation and most of the venue loss arising from retraining.
  • Equity analysis across income quartiles and neighborhoods.
  • Mitigation tested with ablations, not just diagnosis.
  • Transparent about limitations; code released; consistent results across four metros.
  • Limitations

  • The behavioral realism gap (a=1, static supply, fixed schedules) means magnitudes, such as "a fifth or more of venues disappear," should not be read as forecasts.
  • The accuracy–segregation relationship is demonstrated across only four algorithms.
  • The mitigation evidence is Boston-only and sometimes single-run.
  • The data are 2016–17, and the simulation is hard to validate.
  • The venue disappearance metric may be sensitive to the three-month window and the simulated-resident subsample.
  • The segregation effect is moderate, with changes of about 0.03–0.05 in S_i.
  • Other Observations

    The paper is dense but clearly structured. It reads as an extension of the group's earlier simulation work and sits in a growing cluster of feedback-loop simulation papers. It probably will be cited as a reference for in-loop evaluation of location recommenders and for urban fairness metrics, though not as a foundational primitive.

    Rating:7/ 10
    Significance 7Rigor 6.5Novelty 6.5Clarity 7.5

    Generated Nov 2, 2026

    Comparison History (0)

    No comparisons yet.