Back to Rankings

Predicting Social Media Engagement using Machine Learning

Ritwik Singh, Mayukh Majumdar, Subodha Kumar

Sep 14, 2026arXiv:2609.16082v1
cs.SIcs.LG
Share
Scorecard· 16/16
4.0/10 impact

Methodologically careful applied case study but narrow (single industry/platform), low novelty, and largely confirmatory findings limit broad impact.

Abstract

Social media platforms are popular channels for disseminating information, owing to their large user bases and ease of access. Companies also use social media as an important aspect of the advertising process. By creating high-quality posts, companies can strengthen their engagement metrics and increase their follower count. While a growing body of research has examined social media engagement, fewer studies have jointly examined the visual, textual, and temporal features of image posts, even though these features collectively determine the performance of content on social media. To understand the important drivers of social media engagement, we collect image posts of furniture firms on Facebook and extract visual, temporal, and textual features from them using text and image analytics methods. We evaluate several machine learning models - including Random Forest, Light Gradient Boosting Machine (LightGBM), and eXtreme Gradient Boosting (XGBoost) - to assess the drivers and the prediction power of social media engagement using the features from our data. Our research quantifies the extent to which these features are associated with interactions and provides recommendations that organizations may consider.

AI Impact Assessments

(1 model)

Scientific Impact Assessment

Core Contribution. This paper applies a machine learning pipeline to predict social media engagement for image-based Facebook posts, using a dataset of ~32,456 posts from 162 U.S. furniture brands. The stated contributions are twofold: (1) jointly modeling visual, textual, and temporal features (extracted via off-the-shelf tools: spaCy, TextBlob/VADER/RoBERTa, OpenCV, YOLO, CLIP) within a single gradient-boosting framework, and (2) introducing "brand-relative deviation" features (z-scores measuring how far a post departs from a brand's own historical norms), which emerge as among the strongest predictors. The work is explicitly framed as an in-depth single-industry case study rather than a general theory of engagement drivers, and it delivers practitioner-oriented recommendations for social media managers.

Methodological Rigor. This is the paper's strongest dimension relative to its modest ambitions. The authors show more methodological care than typical applied engagement-prediction work: brand-relative and z-score features are constructed using training-set statistics only and applied to held-out data; feature selection is performed within the training fold to avoid leakage; five-fold CV confirms stability (CV R² vs. test R² differ by only 0.001). Notably, they include a brand-only baseline (R²=0.688) to disentangle brand identity from content, showing content features add ~0.13 R². They further stress-test the deviation effects against seasonality (three separate checks), age effects, and brand-size confounding, and report a paired t-test establishing LightGBM's advantage over XGBoost (p=0.010). They are appropriately careful to frame findings as associational, not causal. These controls anticipate several obvious alternative explanations and lend credibility to the core claims.

Potential Impact. The impact is likely to be modest and confined to the marketing analytics / social media analytics subfield. The core methods (LightGBM, SHAP, CLIP, YOLO) are all standard, and the empirical setting is narrow (one industry, one platform). The findings — hashtags help, colorful/multi-image posts perform better, consistency with brand norms matters, brand identity dominates engagement — are largely consistent with or incrementally refine prior work (e.g., Gkikas et al., Li & Xie). The brand-relative deviation feature construction is the most transferable idea and could be reused by others studying branded content, but it is a feature-engineering refinement rather than a conceptual breakthrough. Practitioner value is real but framed cautiously ("suggestions worth testing").

Timeliness & Relevance. Social media engagement prediction is an active and commercially relevant area, and the integration of modern vision-language embeddings (CLIP) with tabular boosting is current. However, the paper does not address a pressing methodological bottleneck; it consolidates existing tools rather than pushing a frontier.

Strengths.

  • Careful leakage prevention and an unusually thorough battery of robustness/confound checks for an applied paper.
  • The brand-only baseline is a genuinely insightful control that quantifies how much predictive power is content vs. identity — a distinction many engagement papers ignore.
  • Clear, well-organized writing with honest limitations (paid boosting confound, single-industry generalizability, uninterpreted CLIP components).
  • Reasonable hyperparameter transparency.
  • Limitations.

  • Single industry, single platform — generalizability is explicitly limited, and the authors acknowledge this.
  • No causal identification; recommendations are associational.
  • The inability to separate organic from paid/boosted engagement is a material confound for a marketing-focused claim, since boosting directly drives the outcome variable.
  • Methodological novelty is low; the pipeline is an assembly of standard components.
  • Data is scraped and not released, and no code is provided, limiting exact reproducibility despite good method description.
  • The dominance of brand identity (R²=0.688 from identity alone) somewhat undercuts the actionable value of content features — much of the impressive 0.82 R² reflects "who posted," not "what was posted."
  • Additional Observations. The R²=0.8178 headline figure is inflated in perceived usefulness by the brand-identity component; the more honest and interesting result is the ~0.13 incremental R² from content. The paper is commendably transparent about this. Resource requirements are low (scraping + single-GPU-scale training), making the work easy to extend but also unremarkable in scale. The paper reads as a competent, well-executed applied study — likely to be cited occasionally within marketing analytics but unlikely to shift practices broadly or become foundational.

    Overall, this is a solid, methodologically careful applied case study with limited novelty and narrow scope. Its rigor exceeds its ambition; its impact will be incremental.

    Rating:4/ 10
    Significance 4Rigor 7Novelty 4Clarity 7.5

    Generated Sep 16, 2026

    Comparison History (0)

    No comparisons yet.