Gabriele Farina, Juan Carlos Perdomo
We give a Gordon-Greenwald-Marks (GGM) style black-box reduction from online learning to online multicalibration. Concretely, we show that to achieve high-dimensional multicalibration with respect to a class of functions H, it suffices to combine any no-regret learner over H with an expected variational inequality (EVI) solver. We also prove a converse statement showing that efficient multicalibration implies efficient EVI solving, highlighting how EVIs in multicalibration mirror the role of fixed points in the GGM result for -regret. This first set of results resolves the main open question in Garg, Jung, Reingold, and Roth (SODA '24), showing that oracle-efficient online multicalibration with -type guarantees is possible in full generality. Furthermore, our GGM-style reduction unifies the analyses of existing online multicalibration algorithms, enables new algorithms for challenging environments with delayed observations or censored outcomes, and yields the first efficient black-box reduction between online learning and multiclass omniprediction. Our second main result is a fine-grained reduction from high-dimensional online multicalibration to (contextual) -regret minimization. Together with our first result, this establishes a new route from external regret to Phi-regret that bypasses sophisticated fixed-point or semi-separation machinery, dramatically simplifies a result of Daskalakis, Farina, Fishelson, Pipis, and Schneider (STOC '25) while improving rates, and yields new algorithms that are robust to richer deviation classes, such as those belonging to any reproducing kernel Hilbert space.
This paper establishes two complementary black-box reductions that fundamentally reshape our understanding of the algorithmic landscape connecting online learning, multicalibration, and Φ-regret minimization.
First reduction (Theorem 4): Online multicalibration with respect to a function class H can be achieved by combining *any* no-regret learner over H with an expected variational inequality (EVI) solver. This is a GGM-style result where EVIs play the role that fixed points play in the classical Gordon-Greenwald-Marks framework for Φ-regret. The converse—that efficient multicalibration implies efficient EVI solving—establishes EVIs as the "right" nonlinear optimization primitive for multicalibration, paralleling Hazan and Kale's necessity result for fixed points.
Second reduction (Theorem 5): Φ-regret minimization reduces to multicalibration with respect to a carefully constructed test class H_Φ, via best-responding to multicalibrated forecasts. Crucially, this reduction is *fine-grained*: the complexity of the required multicalibration tests scales with the complexity of Φ, rather than requiring the full strength of ℓ₁-calibration.
Together, these establish a new route from external regret → (via EVIs) multicalibration → (via best response) Φ-regret, bypassing the fixed-point and semi-separation machinery of the GGM path.
The paper's proofs are remarkably concise and elegant. The proof of Theorem 4 is essentially four lines: the EVI guarantee provides non-negativity of a correction term, which telescopes into the regret of the external learner plus accumulated EVI error. Theorem 5's proof similarly exploits the optimality of best response (σ(p) minimizes p⊤z) to establish the key inequality. This simplicity is a strength—it suggests the results capture something fundamental rather than being artifacts of elaborate machinery.
The paper thoroughly validates its framework by:
1. Recovering Defensive Forecasting (K29) as FTRL over the RKHS ball within their reduction, matching guarantees up to constants
2. Recovering the Unbiased Prediction algorithm of Noarov et al. as Multiscale Multiplicative Weights within their framework
3. Demonstrating that swapping the EVI solver from regret-based to ellipsoid-based yields cubic runtime improvements (Ω(T³) → Õ(T))
The reliance on Fact 1 (efficient EVI solving from Zhang et al. [2025a]) is well-justified and the assumptions (well-bounded convex sets, bounded operators) are standard.
Resolving open problems: The paper directly resolves the main open question from Garg et al. (SODA '24) on oracle-efficient online multicalibration with √T rates in full generality, and provides the first efficient black-box reduction for multiclass omniprediction.
Unifying framework: By showing that disparate multicalibration algorithms are instantiations of one template (different regret minimizers + EVI solvers), the paper provides a organizing principle that should guide future algorithm design. This mirrors how GGM unified Φ-regret algorithms.
New algorithmic capabilities: The modular nature enables immediate transfer from the mature online learning literature:
Impact on Φ-regret: The alternative path to Φ-regret is potentially transformative. It improves the dimension dependence for linear swap regret from O(d⁴√T) to O(d^{5/2}√T), but more importantly, it eliminates the need for semi-separation oracles that have been the technical bottleneck in recent work. The extension to RKHS deviation classes (Theorem 6) is the first result of its kind and opens a genuinely new frontier—Gaussian RKHS deviations were previously out of reach.
Broader implications: Since multicalibration connects to fairness, omniprediction, outcome indistinguishability, complexity-theoretic regularity lemmas, and equilibrium computation, improvements to multicalibration algorithms propagate broadly. The batch setting benefits through online-to-batch reductions.
The paper arrives at a critical moment. The Φ-regret minimization community has been pushing GGM-based approaches to their limits, with increasingly sophisticated semi-separation techniques (Daskalakis et al. STOC '25, Arunachaleswaran et al. EC '25, Zhang et al. EC '25). The paper offers a fundamentally different and simpler path that sidesteps these difficulties. Simultaneously, multicalibration has emerged as a central concept connecting fairness, learning theory, and complexity theory, yet lacked a clean algorithmic foundation—this paper provides exactly that.
1. Conceptual clarity: The parallel between EVIs/multicalibration and fixed-points/Φ-regret is deeply illuminating and likely to become a standard framework
2. Proof elegance: Core results proved in a few lines, suggesting they capture essential structure
3. Practical modularity: Off-the-shelf components (any regret minimizer + any EVI solver) yield specialized algorithms
4. Breadth of consequences: One framework yields unified analyses, improved runtimes, new settings (delays, censoring, RKHS deviations), and connections across subfields
5. Full generality: Works for arbitrary compact convex Y, arbitrary H, no binning arguments needed
1. EVI solver dependency: The efficiency gains partly rely on recent EVI algorithms (Zhang et al. 2025a); the paper's practical impact is coupled to the maturity of EVI solvers
2. Rates for censored observations: The Õ(T^{3/4}) rate for censored outcomes may not be tight
3. Empirical validation: No experiments are provided; the paper is purely theoretical
4. Lower bounds: While the paper shows EVIs are necessary, it does not establish whether the achieved rates are optimal across all settings
5. Contextual Φ-regret: While mentioned, the contextual extension could be developed more fully
This is a high-impact theoretical contribution that provides the "missing" GGM theorem for multicalibration. Its dual reductions create a new structural bridge between forecasting and decision-making that is both simpler and more powerful than existing approaches, resolves multiple open problems, and opens new algorithmic frontiers (RKHS deviations, delayed/censored settings). The elegance of the framework—and its ability to unify, simplify, and extend—suggests it will become a standard reference.
Generated Apr 22, 2026
Paper 2 resolves a major open question (from SODA '24), provides a unifying black-box reduction framework connecting online learning, multicalibration, and Φ-regret minimization, dramatically simplifies prior STOC '25 results while improving rates, and enables new algorithms for delayed/censored settings and multiclass omniprediction. Its theoretical contributions span online learning, fairness/calibration, and game theory with broad foundational impact. Paper 1 offers a useful practical heuristic for Adam's β parameter but is more incremental—an empirical scaling rule across 11 experiments with narrower scope and less fundamental novelty.
Paper 2 resolves a major open question in learning theory and significantly simplifies foundational STOC '25 results. By establishing a unifying black-box reduction between online learning, multicalibration, and Phi-regret, it offers profound theoretical breakthroughs that will shape future algorithmic design across diverse learning environments. While Paper 1 provides a highly practical memory-efficiency optimization for deep learning, Paper 2's fundamental advancements in theoretical machine learning, unifications of subfields, and enablement of new robust algorithms give it higher potential for long-term foundational scientific impact.
Paper 2 has higher potential impact due to strong novelty (new black-box reductions), methodological rigor (tight equivalences and fine-grained reductions), and broad cross-field relevance spanning online learning, fairness/multicalibration, regret minimization, and game-theoretic optimization (EVIs). It resolves a stated open question (SODA’24), simplifies and improves a recent STOC’25 result, and enables new algorithms for delayed/censored feedback and richer deviation classes (e.g., RKHS), suggesting durable theoretical and practical influence. Paper 1 is valuable but more specialized to SDP surrogates and GNN expressivity.
Paper 1 offers a broadly novel theoretical unification: an efficient black-box reduction tying online learning, multicalibration, EVIs, and Φ-regret, resolving a stated open problem and simplifying/improving recent STOC results. Its methodological rigor (reductions, converses, rate improvements) and generality suggest lasting impact across online learning, game theory, algorithmic fairness/calibration, and omniprediction. Paper 2 proposes practical MoE gating tweaks with promising empirical gains, but evidence is narrower (small controlled settings/char-level LM) and impact may be more incremental/architecture-specific. Overall breadth, rigor, and foundational contribution favor Paper 1.
Paper 2 has higher estimated impact: it resolves a stated main open question (from SODA ’24), introduces broadly applicable black-box reductions linking online learning, multicalibration, EVIs, and Φ-regret, and simplifies/improves a recent STOC ’25 result while enabling new algorithms (delays, censoring, omniprediction, RKHS deviations). This combination of theoretical novelty, timeliness, and cross-area unification suggests wide influence across online learning, game theory, and algorithmic fairness. Paper 1 is valuable and practical, but its impact is narrower to SDP-solving surrogates and GNN expressivity.
Paper 1 likely has higher scientific impact: it resolves a stated open problem (oracle-efficient online multicalibration with √T guarantees), introduces a general black-box reduction linking online learning, multicalibration, and EVIs, and provides a new simplified route from external regret to Φ-regret with improved rates and broader deviation classes (e.g., RKHS). These are foundational, broadly applicable theoretical tools across online learning, game theory, and algorithmic fairness. Paper 2 proposes promising MoE gating heuristics with demonstrated gains, but its scope is narrower, evidence is limited to small-scale experiments, and generality/theory is less established.
Paper 1 addresses a highly critical and expensive bottleneck in modern AI: fitting scaling laws for large models. By reducing the compute budget required to predict model scaling by up to 90%, it offers massive immediate financial and practical utility for major AI research labs. While Paper 2 provides excellent theoretical breakthroughs in learning theory by resolving open questions in multicalibration and regret minimization, Paper 1's extreme timeliness, direct real-world application, and broad economic impact give it higher overall scientific and industry relevance today.
Paper 1 addresses fundamental problems in learning theory, resolving a significant open question from SODA '24 and substantially simplifying recent STOC '25 results while improving rates. Its theoretical contributions—unifying existing algorithms and providing new black-box reductions for multicalibration and Phi-regret—offer a broader foundational impact. Paper 2 presents a useful but more specialized methodological improvement for semi-supervised learning, making Paper 1's breakthroughs more likely to influence future theoretical and algorithmic developments across the broader machine learning community.
Paper 2 has higher likely impact due to stronger novelty and broader theoretical reach: it resolves a main open question on oracle-efficient online multicalibration, provides tight black-box reductions linking online learning, multicalibration, EVIs, and Φ-regret, and simplifies/improves recent STOC’25 results. These connections can influence multiple areas (online learning, game theory, algorithmic fairness, calibration/omniprediction) and enable new algorithms for delayed/censored feedback settings. Paper 1 is solid and applicable, but its contribution is more incremental within semi-supervised manifold regularization and variable selection.
While Paper 1 resolves significant theoretical open questions in online learning and multicalibration, Paper 2 addresses a critical, immediate bottleneck in the dominant paradigm for scaling LLM reasoning (RLVR). Identifying reward hacking in frontier LLMs and proposing a concrete mitigation (IPT) has profound implications for AI alignment, safety, and capability scaling, likely yielding broader real-world application and higher cross-disciplinary scientific impact.