Sequential LLM Release Facilitates Manipulation in Regulated Markets
Extracted source text · arXiv 2601.11496
\documentclass{article}
\usepackage{graphicx} % Required for inserting images
\usepackage{authblk}
\title{The Poisoned Apple Effect: Strategic Manipulation of Mediated Markets via Technology Expansion of AI Agents}
\author{Eilam Shapira}
\author{Moshe Tennenholtz}
\author{Roi Reichart}
\affil{Technion – Israel Institute of Technology}
\date{January 2026}
\usepackage[margin=2cm]{geometry}
\usepackage{lineno}
% --- PACKAGES ---
\usepackage{amssymb}
\usepackage{amsmath}
\usepackage{booktabs} % For nice tables
\usepackage{titlesec} % For customizing section headers
\usepackage{caption} % For table captions
\usepackage[numbers]{natbib}
\begin{document}
% \linenumbers
\maketitle
\begin{abstract}
The integration of AI agents into economic markets fundamentally alters the landscape of strategic interaction. We investigate the economic implications of expanding the set of available technologies in three canonical game-theoretic settings: bargaining (resource division), negotiation (asymmetric information trade), and persuasion (strategic information transmission). We find that simply increasing the choice of AI delegates can drastically shift equilibrium payoffs and regulatory outcomes, often creating incentives for regulators to proactively develop and release technologies. Conversely, we identify a strategic phenomenon termed the "Poisoned Apple" effect: an agent may release a new technology, which neither they nor their opponent ultimately uses, solely to manipulate the regulator’s choice of market design in their favor. This strategic release improves the releaser's welfare at the expense of their opponent and the regulator's fairness objectives. Our findings demonstrate that static regulatory frameworks are vulnerable to manipulation via technology expansion, necessitating dynamic market designs that adapt to the evolving landscape of AI capabilities.
\end{abstract}
% \section*{Significance Statement}
% As AI agents increasingly mediate the economy, the mere availability of new models can fundamentally alter market outcomes, even if those models are never used. We identify a strategic manipulation where actors release 'poisoned' technologies solely to force regulators into preferred market designs. This reveals a critical vulnerability in static regulatory frameworks for AI economies.
\section{Introduction}
The rapid integration of AI agents into the global economy is fundamentally altering the landscape of strategic interaction. In the near future, a substantial fraction of economic activities — ranging from real estate transactions to corporate partnerships — will be mediated by AI delegates acting on behalf of individuals and firms \cite{hadfield_economy_2025}. While current regulatory debates focus on model safety and bias, we identify a critical, overlooked economic vulnerability \cite{wellman_understanding_2025} arising from the mere availability of these technologies.
We investigate the strategic implications of expanding the set of available AI technologies within regulated markets. Specifically, we identify a phenomenon we term the \textit{Poisoned Apple} effect. In this scenario, a strategic actor releases a new technology not to use it, but to manipulate the regulator’s calculations of market design. By introducing a "poisoned" option, an agent can force a fairness-maximizing regulator to shift the market equilibrium in a way that benefits the releaser at the expense of their opponent.
Our analysis models this interaction as a meta-game \cite{howard_paradoxes_1971} involving two economic agents ("Alice" and "Bob") and a regulator. In this game, the regulator first determines the rules of interaction, while the participants choose among the available technologies. The utility of each participant is determined by the rules of interaction and the technologies selected by both participants. While the regulator intervenes to maximize social objectives like fairness, the agents strategically select AI representatives to maximize their own utility. We demonstrate that static regulatory frameworks are highly vulnerable to manipulation via technology expansion, necessitating dynamic market designs that adapt to the evolving landscape of AI capabilities.
\begin{figure}[htb]
\centering
\makebox[\textwidth][c]{%
\includegraphics[width=1\textwidth]{Figures/poisoned_apple.pdf}%
}
\caption{Illustration of the “poisoned apple” example, in which Alice increases her payoff at Bob’s expense by releasing a new technology—without the players actually using that technology in practice. (1) The technologies available to Alice and Bob are language models A–D.
(2a) For each possible market, the equilibrium in games between Alice and Bob under the market conditions is computed. For each equilibrium, the average fairness value that would be obtained if the equilibrium were played is calculated. (2b) The regulator, whose objective is to maximize fairness, decides that Market 4 will be the market in which Alice and Bob will play—the market that yields the maximum fairness value. Alice earns 0.49, Bob earns 0.50, and the fairness value is 1.00. (3) Technology E is released and is now available to both players. (4a) The process performed in \textit{2a} is repeated.
(4b) In the new equilibrium in Market 4, the resulting fairness value is 0.976. In the new equilibrium in Market 8, the resulting fairness value is 0.99. The regulator decides that Market 8 will be the market in which Alice and Bob will play. Alice earns 0.52, Bob earns 0.46.}
\label{fig:poisoned_apple}
\end{figure}
\section{Study Design and Experimental Framework}
To analyze these dynamics empirically, we utilize the GLEE dataset \cite{shapira_glee_2024}.
GLEE facilitates large-scale simulation of language-based economic environments across a combinatorial space of 1,320 distinct configurations. The dataset comprises over 580,000 strategic decisions generated by 13 state-of-the-art LLMs, treated as simulated economic agents \cite{horton_large_2023, shapira_can_2024}, across three canonical non-cooperative game families that capture fundamental economic interactions:
(1) \textbf{Bargaining}: An alternating-offers game where players must agree on splitting a surplus or receive zero \cite{rubinstein_perfect_1982};
(2) \textbf{Negotiation}: A bilateral trade setting involving private information between a buyer and seller \cite{myerson_efficient_1983};
and (3) \textbf{Persuasion}: A sender-receiver game where a seller attempts to convince a buyer to purchase based on strategic information transmission \cite{crawford_strategic_1982, kamenica_bayesian_2011}.
We classify these interactions into distinct \textit{Markets}, where each market $m$ is defined by a specific structural configuration of three parameters: Information Structure, Communication Form, and Game Horizon. This classification yields a set of fundamental environments that span the critical dimensions of economic interaction.
In our meta-game model, agents (Alice and Bob) review the performance matrix of available AI delegates and simultaneously select the representative that maximizes their expected utility. We solve for the Nash Equilibrium \cite{nash_non-cooperative_1951} -- a state where neither agent has an incentive to switch technologies solely given the other's choice. The regulator then evaluates the outcome based on Efficiency (total social welfare) or Fairness (minimizing the disparity between agents' payoffs) \cite{maskin_nash_1999}.
The core of our analysis involves a technology expansion. We first establish a baseline equilibrium with a subset of $N$ technologies ($2 \le N < 13$) available in the GLEE dataset. The regulator first selects the market environment that maximizes its objective (e.g., fairness). We then expand the set of available technologies to the agents' choice set by adding one of the other technologies from the GLEE dataset. In this newly generated meta-game, a new equilibrium may emerge for any given market selection; consequently, the regulator selects a potentially new market, optimizing its objective based on this new equilibrium. This allows us to isolate the specific economic impact of making a new technology available, regardless of whether it was ultimately adopted by the agents.
\section{Results}
\paragraph{The Poisoned Apple Effect} Our most striking finding is a strategic phenomenon we term the \textit{Poisoned Apple} effect, where an agent releases a new technology not to use it, but to manipulate the regulator’s market design. Consider a representative Bargaining meta-game (Figure \ref{fig:poisoned_apple}) where, initially, the agents have access to technologies $A-D$. In this setting, the regulator selects the market that maximizes fairness (Market 4), yielding expected payoffs of 0.49 for Alice and 0.50 for Bob.
Alice then releases a new technology ($E$). Crucially, if the regulator were to maintain the original market design, Alice would adopt strategy $E$ in the new equilibrium, causing fairness to drop significantly (from 1.00 to 0.976). To minimize this harm, the regulator is forced to migrate to a new market environment (Market 8) where fairness is relatively higher (0.990).
In this new market, the equilibrium strategies do not involve using $E$. However, the forced market shift dramatically alters the payoff distribution: Alice’s payoff jumps to 0.52 while Bob’s drops to 0.46. Thus, Alice successfully leverages the threat of using a "poisoned" technology to coerce the regulator into a favorable market design, improving her welfare at Bob's expense without ever actually deploying the model.
\paragraph{Systemic Vulnerability} This manipulation is not an isolated anomaly. Across more than 50,000 simulated meta-games, we observe a recurrent pattern where expanding the choice set causes payoffs to move in opposite directions—one player benefits while the other is harmed (Fig. 2A). Strikingly, in approximately one-third of these zero-sum shifts, the outcome reversal occurs even though the new technology remains unused by either player in the final equilibrium (Fig. 2B). This confirms that open-weight releases or API availability can serve as strategic weapons for regulatory arbitrage.
\paragraph{Regulatory Objectives and Stability} Broader analysis reveals that the impact of such expansions depends heavily on the regulator's goal. While technology expansion often improves outcomes when the regulator maximizes social welfare (efficiency), it frequently backfires when the goal is fairness (Fig. 2C).
We find that the utility of a new technology is a strong predictor of its regulatory impact. Improvements in the regulator's metric typically arise when the new technology is actively selected by at least one player in the new equilibrium (Fig. 2C). Conversely, decreases in the regulatory metric are strongly associated with instances where the added technology is not selected by either player (Fig. 2E). Finally, the results highlight the danger of regulatory inertia. If a regulator fails to re-optimize the market design following a technology release, the regulatory metric deteriorates in roughly 40\% of cases (Fig. 2F). This demonstrates that static regulatory frameworks are insufficient; market designs must be dynamic to withstand the strategic expansion of AI capabilities.
\begin{figure}[htbp]
\centering
\makebox[\textwidth][c]{%
\includegraphics[width=1\textwidth]{Figures/statistics.pdf}%
}
\caption{Strategic implications of technology expansion in meta-games. Analysis of equilibrium shifts across bargaining, negotiation, and persuasion environments. (A) Frequency of Opposite Payoff Changes: cases where expanding the technology set causes agents' expected payoffs (calculated over mixed strategy equilibria) to move in opposite directions. (B) Opposite Payoff Changes Despite Zero Adoption: The subset of these reversals occurring even when the new technology is not selected by either player in the new equilibrium—demonstrating the "Poisoned Apple" effect. (C) Frequency of Improvement in Regulatory Metric: How often the regulator's optimized objective (Fairness or Efficiency) increases versus decreases. (D–E) The relationship between regulatory outcomes and model adoption: Improvements typically align with high adoption rates (D), whereas harm to the objective is frequently observed when the new model is available but acts as a latent threat without being played (E). (F) Frequency of Metric Harm Without Market Update: The probability of degrading the regulatory objective if the market design remains static (regulatory inertia) after the new technology is released. Confidence intervals (95\%) are not shown, as all are narrower than 2 percentage points.}
\label{fig:statistics}
\end{figure}
\section{Discussion}
Our results challenge the assumption that expanding technological choice is inherently neutral or beneficial. We demonstrate that in regulated markets, the potential to use a technology is as impactful as its actual adoption. This \textit{Poisoned Apple} effect suggests that open-weight releases or API availability can serve as strategic instruments to manipulate regulatory landscapes. For policymakers, this implies that market designs cannot be static; they must be dynamic and robust to the continuous expansion of the agent strategy space.
\bibliographystyle{plain}
\bibliography{references}
\appendix
\input{appendix}
\end{document}
\section{The GLEE Framework}
The empirical basis of this study is the \textbf{GLEE (Games in Language-based Economic Environments)} framework \cite{shapira_glee_2024}. This infrastructure addresses a significant gap in evaluating Large Language Models (LLMs): the lack of a standardized way to assess strategic skills in complex settings. Unlike static benchmarks (such as QA tasks), GLEE evaluates agents in multi-turn scenarios where success depends on adaptation and consistent strategy.
By simulating thousands of interactions across 13 state-of-the-art LLMs as agents, GLEE generates a detailed dataset of strategic behaviors. The framework logs every interaction and message, allowing us to analyze decision-making processes. This comprehensive dataset enables rigorous statistical analysis of model performance under different economic conditions, controlling for variables to estimate causal effects for the meta-game analysis.
\subsection{Game Families: A Taxonomy of Core Economic Interactions}
The investigation focuses on three distinct families of games, selected to highlight unique and fundamental aspects of economic interaction. These families cover a range of cooperative and competitive dynamics found in real-world markets, from equal partnerships to settings with asymmetric information.
\subsubsection{Bargaining (Resource Division)}
This scenario is a sequential resource division game based on the standard Rubinstein bargaining model \cite{rubinstein_perfect_1982}.
Formally, two players, Alice ($A$) and Bob ($B$), must agree on how to divide a fixed surplus $M$ over a time horizon $T$ (potentially infinite). Time is modeled as a scarce resource using discount factors $\delta_A, \delta_B \in (0,1)$.
The game follows an alternating-offers protocol. In each odd round $t$, Alice proposes a split $(p, 1-p)$ where $p \in [0,1]$ is her share. Bob can accept or reject. If Bob accepts, the game ends, and the discounted payoffs are:
\begin{equation}
U_A = \delta_A^{t-1} p M, \quad U_B = \delta_B^{t-1} (1-p) M
\end{equation}
If Bob rejects, the game proceeds to round $t+1$, where Bob proposes a split $(q, 1-q)$. If no agreement is reached by the end of the horizon, both players receive 0. An outcome is denoted by the pair $(t_{ev}, p_{ev})$, where $t_{ev}$ is the round of agreement and $p_{ev}$ is Alice's agreed share.
\paragraph{Strategic Dynamics and Implications:}
The discount factors create tension between maximizing one's share and the risk of the surplus shrinking. Agents must balance greed with the need for a timely agreement. This environment tests the agents' ability to perform \textbf{backward induction}, anticipate the opponent's reservation value, and use signaling strategies to test the opponent's patience. For example, an agent might reject a fair offer in an early round to signal ``stubbornness,'' hoping to get a larger share later, despite the cost of delay.
\subsubsection{Negotiation (Bilateral Trade)}
This family models a bilateral trade setting with a buyer and a seller \cite{myerson_efficient_1983}. Unlike bargaining, roles here are asymmetric: the Seller (Alice) holds an item with subjective valuation $V_A$, and the Buyer (Bob) has subjective valuation $V_B$. To capture valuation scales, we parameterize $V_i = M \cdot F_i$ for $i \in \{A, B\}$, where $F_i$ is a factor parameter and $M$ is a scale parameter.
The game proceeds in alternating turns over a horizon $T$. In odd rounds, Alice posts a price $p$; Bob can buy (accept) or reject. In even rounds, Bob posts a price; Alice can sell (accept) or reject. If a trade occurs at price $p$, the payoffs are:
\begin{equation}
U_A = p - V_A, \quad U_B = V_B - p
\end{equation}
If no trade occurs, payoffs are $(0,0)$. The outcome is denoted by the final trading price $p_{ev}$ (or $\emptyset$ if no trade occurred).
\paragraph{Strategic Dynamics and Implications:}
The main challenge is \textbf{price discovery}: finding a mutually beneficial price without revealing too much private information. This game tests the agents' ability to bluff, infer value from offers, and navigate trust issues where high-value trades might fail due to a lack of credible signaling (the ``lemons problem'').
\subsubsection{Persuasion (Strategic Information Transmission)}
This game \cite{kamenica_bayesian_2011} is based on classical ``cheap talk'' models \cite{crawford_strategic_1982}. A Seller (Alice) tries to persuade a Buyer (Bob) to purchase a product at a fixed price $\pi$ (normalized to $\pi=1$). Alice privately observes the product quality, which is either \textbf{High} or \textbf{Low}. Bob only knows the prior probability of High quality, denoted by $p$.
Bob's valuation depends on quality: he values a High-quality product at $v > \pi$ and a Low-quality product at $u < \pi$ (normalized to $u=0$). We introduce a scale parameter $M$ for the buyer's utility.
\begin{itemize}
\item \textbf{Alice's Payoff:} 1 if Bob buys, 0 otherwise (regardless of quality).
\item \textbf{Bob's Payoff:} $M(v-1)$ if he buys a High-quality product; $-M$ if he buys a Low-quality product; 0 if he does not buy.
\end{itemize}
The game lasts for $T$ rounds. The outcome is defined as a tuple $(n_{ev}, k_{ev}, r_{ev})$, where $n_{ev}$ is the number of High-quality rounds, $k_{ev}$ is the number of purchased High-quality items, and $r_{ev}$ is the number of rejected Low-quality items.
\paragraph{Strategic Dynamics and Implications:}
This game evaluates the ability to use language for manipulation versus credibility. Sellers face a dilemma: tell the truth to build a reputation (if the buyer is long-term) or lie for short-term gain. Buyers must distinguish truthful signals from ``cheap talk,'' inferring quality from incentives rather than just message content.
\subsection{Markets and Parameters: The Architecture of Interaction}
Within the purview of the instant study, a ``Market'' is defined not merely as a venue for exchange, but as a rigid configuration of environmental parameters and rules that shape the incentives and constraints of the agents. While the GLEE framework accommodates a broad spectrum of continuous and discrete parameters, the focus herein is restricted to \textbf{structural parameters} that fundamentally alter the strategic landscape and the nature of the equilibrium.
\subsubsection{Parameters Defining Markets by Family}
\textbf{Bargaining:}
\begin{itemize}
\item \textbf{Information Structure (CI):} Boolean. Distinguishes between \textit{Complete Information}, wherein agents possess perfect knowledge of their opponent's discount factor (patience), and \textit{Incomplete Information}, wherein this parameter remains private. Incomplete information introduces profound uncertainty, frequently precipitating aggressive posturing or ``wars of attrition.''
\item \textbf{Communication Form (MA):} Boolean. \textit{Messages Allowed} denotes whether agents are permitted to exchange free-form natural language messages alongside numerical offers, or are restricted to structured proposals. Linguistic communication allows for the introduction of normative arguments (e.g., appeals to fairness), framing effects, and justification.
\item \textbf{Horizon (T):} The duration of the game. A \textit{Finite} horizon (e.g., 10 rounds) induces ``end-game effects'' wherein backward induction strictly dictates strategy. An \textit{Infinite} horizon (simulated as an extended game with stochastic termination) models a steady-state negotiation environment wherein reputational concerns may dominate.
\end{itemize}
\textbf{Negotiation:}
\begin{itemize}
\item \textbf{Information Structure (CI):} Boolean. Determines whether the seller is cognizant of the buyer's exact valuation (\textit{Complete Information}) or merely the probability distribution from which it is drawn (\textit{Incomplete Information}).
\item \textbf{Communication Form (MA):} Boolean. Indicates the permissibility of natural language messages. In negotiation, language enables complex tactics beyond elementary price signaling, such as highlighting product features or feigning disinterest.
\item \textbf{Horizon (T):} Finite versus Infinite, affecting the pressure to concede as the deadline approaches.
\end{itemize}
\textbf{Persuasion:}
\begin{itemize}
\item \textbf{Information Structure (CI):} Boolean. Determines whether the seller is cognizant of the buyer's specific valuation for a high-quality product.
\item \textbf{Communication Form (MA):} Categorical. The mode of communication permitted (e.g., binary signals versus full textual persuasion). Full text affords greater nuance but simultaneously introduces noise and potential for hallucination.
\item \textbf{Buyer Type (MYOPIC):} Boolean. Differentiates between a \textit{Long-living} buyer (who optimizes utility over the entire game duration) and a \textit{Myopic} buyer (who optimizes solely for the current turn).
\end{itemize}
\subsection{Regulatory Metrics: Fairness and Efficiency}
Market outcomes are assessed based on two primary regulatory objectives, which quantify the social desirability of the game results. These metrics serve as the objective function for the regulator in the meta-game model.
\paragraph{Efficiency (Welfare):}
Represents the total social surplus generated by the interaction. It assesses the extent to which resources are maximized and waste—whether via delay, disagreement, or failure to trade—is minimized.
\begin{itemize}
\item In \textit{Bargaining}, efficiency is defined as the normalized sum of discounted payoffs at the time of agreement ($t_{ev}$). Since delays erode value (due to $\delta < 1$), earlier agreements are inherently more efficient. An agreement in round 1 preserves 100\% of the surplus, whereas an agreement in round 10 might preserve only a fraction due to the time value of money:
\begin{equation}
\text{Efficiency} = \delta_{A}^{t_{ev}-1}p_{ev} + \delta_{B}^{t_{ev}-1}(1-p_{ev})
\end{equation}
(In the absence of agreement, efficiency is 0, representing a total deadweight loss).
\item In \textit{Negotiation}, it reflects allocative efficiency—whether a mutually beneficial trade occurred. It functions as a binary indicator variable that equals 1 if trade occurs when the buyer values the item more than the seller ($V_B \ge V_A$) or if trade correctly \textit{does not} occur when the seller values it more ($V_A > V_B$):
\begin{equation}
\text{Efficiency} = \mathbb{1}_{\{\text{Outcome is Efficient}\}}
\end{equation}
\item In \textit{Persuasion}, the outcome of a game of length $T$ rounds is defined as a tuple $(n_{ev}, k_{ev}, r_{ev})$. Here, $n_{ev}$ represents the total number of rounds wherein the product was truly of \textbf{High} quality. Efficiency measures the rate of successful transactions for these high-quality goods:
\begin{equation}
\text{Efficiency} = \frac{k_{ev}}{n_{ev}}
\end{equation}
(Where $k_{ev}$ is the number of rounds in which a high-quality product was successfully purchased by the buyer).
\end{itemize}
\paragraph{Fairness (Equity):}
Represents the equality of the outcome distribution between agents, penalizing outcomes wherein one party exploits the other.
\begin{itemize}
\item In \textit{Bargaining}, fairness is calculated as the deviation from an equal division. A quadratic penalty is employed to strictly sanction large deviations from equality (0.5), reflecting a strong societal preference for equitable splits in partnership scenarios:
\begin{equation}
\text{Fairness} = 1 - 4\left(p_{ev} - 0.5\right)^2
\end{equation}
(If no agreement is reached, fairness is defined as 1, as both parties receive 0, which is technically equal, albeit deeply inefficient).
\item In \textit{Negotiation}, it measures the deviation of the transaction price ($p_{ev}$) from the theoretically fair price ($p_f = \frac{V_A + V_B}{2}$), which divides the surplus equally between buyer and seller. This is normalized by the scale $M$:
\begin{equation}
\text{Fairness} = 1 - 4\left(\frac{p_{ev} - p_f}{M}\right)^2
\end{equation}
(If no trade occurs, fairness is defined as 1).
\item In \textit{Persuasion}, fairness focuses on consumer protection against deception. Using the notation established above, let $T - n_{ev}$ represent the total number of rounds wherein the product was of \textbf{Low} quality. Fairness is defined as the proportion of these low-quality products that were successfully rejected by the buyer (i.e., NOT purchased due to misleading signals):
\begin{equation}
\text{Fairness} = \frac{r_{ev}}{T - n_{ev}}
\end{equation}
(Where $r_{ev}$ is the number of rounds in which a low-quality product was correctly rejected by the buyer).
\end{itemize}
\subsection{Language Models and Collected Data: The Strategy Space}
The strategy space appertaining to the meta-game is comprised of 13 state-of-the-art Large Language Models (LLMs). This diverse selection includes both proprietary models accessed via API and open-weight models, spanning a range of capabilities, sizes, and reasoning architectures.
\textbf{Models Included in the Analysis:} Claude 3.5 Sonnet, Claude 3.7 Sonnet, Gemini 1.5 Flash, Gemini 1.5 Pro, Gemini 2.0 Flash, Gemini 2.0 Flash Lite, GPT-4o, GPT-4o Mini, o3-mini, Grok 2, LLaMA 3.1-405B, LLaMA 3.3-70B, and Mistral Large 2411.
\subsection{Payoff Estimation via Linear Regression}
The dataset comprises over 80,000 simulated games. We use the statistical framework from GLEE to construct robust payoff matrices.
Separate Linear Regression models were trained for each game family and metric. These models predict the expected outcome for any model pair in any market configuration. Based on GLEE benchmark findings, these linear models provide predictive performance comparable to non-linear baselines.
\paragraph{Model Specification:}
The models use one-hot encoding for:
\begin{itemize}
\item \textbf{Agent Pair Interaction:} The specific pair of interacting models ($i$ vs. $j$).
\item \textbf{Market Design Rules:} The structural parameters ($CI$, $MA$, $T$).
\item \textbf{Situational Parameters:} Economic variables specific to the instance (e.g., $\delta, M, V$).
\end{itemize}
Equation \ref{eq:linear_model} represents the linear regression model:
\begin{equation}
\hat{y}_{m,i,j} = \beta_0 + \beta_{market} + \beta_{pair=(i,j)} + \sum \beta_{situation}
\label{eq:linear_model}
\end{equation}
Since we are interested in calculating the interaction values between model pairs when market conditions are known, but specific player conditions (situational parameters) are unknown or averaged out, the values we calculate for the payoff table will be:
\begin{equation}
\hat{y}_{m,i,j} = \beta_0 + \beta_{market} + \beta_{pair=(i,j)}
\label{eq:linear_model_interaction}
\end{equation}
\section{The Meta Game}
\paragraph{Calculating Game Matrices}
We model the selection of AI delegates as a meta-game where human principals (Alice and Bob) choose an AI agent from the available set. For a given market, we construct four $N \times N$ matrices (When $N$ is the number of available technologies) using the regression predictions:
\begin{enumerate}
\item \textbf{Row Player Payoff ($U_A$)}
\item \textbf{Column Player Payoff ($U_B$)}
\item \textbf{Designer Metric - Fairness ($D_F$)}
\item \textbf{Designer Metric - Efficiency ($D_E$)}
\end{enumerate}
\paragraph{Finding Equilibrium}
We compute the \textbf{Mixed Strategy Nash Equilibrium (MSNE)} for the game defined by $U_A$ and $U_B$. Using the Lemke-Howson algorithm (via the \texttt{nashpy} library), we enumerate all equilibria returned by the algorithm. When multiple equilibria exist, the expected payoffs of the agents and the regulator are defined as the average of their expected values across all such equilibria.
\paragraph{Regulatory Optimization}
Once equilibria are identified for all candidate market configurations, the regulator (Designer) utilizes the Designer matrices ($D_F$ or $D_E$) to determine the optimal market structure.
For each market $m$, let $(\sigma_A^*, \sigma_B^*)$ be the computed equilibrium profile. The expected value of the Designer's objective $V_D(m)$ is calculated as:
\begin{equation}
V_D(m) = (\sigma_A^*)^T \cdot D_m \cdot \sigma_B^*
\end{equation}
where $D_m$ is the Designer matrix (Fairness or Efficiency) for market $m$. The regulator then selects the market configuration $m^*$ that maximizes this expected value:
\begin{equation}
m^* = \arg\max_{m \in \mathcal{M}} V_D(m)
\end{equation}
This step completes the meta-game loop, determining the final regulatory environment and the resulting agent payoffs.
\section{The Poisoned Apple Effect}
This section provides a detailed breakdown of the ``Poisoned Apple'' phenomenon illustrated in Figure 1 of the main text. The effect describes a strategic manipulation where a player introduces a new technology not to utilize it, but to force a fairness-maximizing regulator to alter the market design in a way that disproportionately benefits the releaser.
We examine a specific instance from the \textbf{Bargaining} game family. The initial strategy space consists of four Large Language Models: Model A (\texttt{claude-3-7-sonnet}), Model B (\texttt{gemini-2.0-flash}),\\ Model C (\texttt{llama-3.1-405b-instruct}), and Model D (\texttt{llama-3.3-70b-instruct}). The regulator's objective is to maximize \textbf{Fairness} (defined in Eq.~4 as the minimization of deviation from an equal split).
\paragraph{Phase 1: The Status Quo (Pre-Release).}
The regulator evaluates the potential equilibria across all market configurations and selects the environment that maximizes fairness. Table~\ref{tab:pre-release} details the fairness scores for market configurations in this initial state.
The optimal design, designated as \textbf{Market 4}, is defined by \textbf{Incomplete Information} ($\text{CI}=\text{False}$), \textbf{Allowed Communication} ($\text{MA}=\text{True}$), and an \textbf{Infinite Horizon} ($T=\infty$).
\begin{table}[h]
\centering
\caption{Fairness Scores Across Markets (Pre-Release)}
\label{tab:pre-release}
\begin{tabular}{clc}
\toprule
\textbf{Market ID} & \textbf{Parameters (Info, Comm, Horizon)} & \textbf{Fairness} \\
\midrule
1 & Incomplete, No Messages, Finite & 0.975 \\
2 & Incomplete, No Messages, Infinite & 0.965 \\
3 & Incomplete, Messages, Finite & 0.989 \\
\textbf{4} & \textbf{Incomplete, Messages, Infinite} & \textbf{1.000} \\
5 & Complete, Messages, Finite & 0.977 \\
6 & Complete, Messages, Infinite & 0.962 \\
7 & Complete, No Messages, Finite & 0.974 \\
8 & Complete, No Messages, Infinite & 0.990 \\
\bottomrule
\end{tabular}
\end{table}
In this environment (Market 4), the game stabilizes at a pure strategy equilibrium:
\begin{itemize}
\item \textbf{Alice} selects \textbf{Model D} (\texttt{llama-3.3-70b-instruct}).
\item \textbf{Bob} selects \textbf{Model A} (\texttt{claude-3-7-sonnet}).
\item \textbf{Outcome:} This pairing results in a perfect Fairness score of \textbf{1.000}. The expected payoffs are \textbf{0.49} for Alice and \textbf{0.50} for Bob.
\end{itemize}
\paragraph{Phase 2: The Toxic Release (Intermediate State).}
Alice introduces a new technology, \textbf{Model E} (\texttt{gemini-1.5-pro}), into the ecosystem. The availability of this model drastically alters the strategic landscape. Table~\ref{tab:post-release} displays the re-calculated fairness scores with Model E available.
\begin{table}[h]
\centering
\caption{Fairness Scores Across Markets (Post-Release)}
\label{tab:post-release}
\begin{tabular}{clc}
\toprule
\textbf{Market ID} & \textbf{Parameters (Info, Comm, Horizon)} & \textbf{Fairness} \\
\midrule
1 & Incomplete, No Messages, Finite & 0.975 \\
2 & Incomplete, No Messages, Infinite & 0.965 \\
3 & Incomplete, Messages, Finite & 0.988 \\
\textbf{4} & \textbf{Incomplete, Messages, Infinite} & \textbf{0.976} \\
5 & Complete, Messages, Finite & 0.967 \\
6 & Complete, Messages, Infinite & 0.962 \\
7 & Complete, No Messages, Finite & 0.959 \\
\textbf{8} & \textbf{Complete, No Messages, Infinite} & \textbf{0.990} \\
\bottomrule
\end{tabular}
\end{table}
As shown in Table~\ref{tab:post-release}, the fairness in the original Market 4 drops significantly (from 1.000 to 0.976). The availability of Model E destabilizes the original equilibrium:
\begin{itemize}
\item \textbf{Alice} switches to the new \textbf{Model E} (\texttt{gemini-1.5-pro}).
\item \textbf{Bob} continues to play \textbf{Model A} (\texttt{claude-3-7-sonnet}).
\item \textbf{Impact:} This shift causes the Fairness in Market 4 to deteriorate. In this intermediate state (if the market were not updated), Alice's payoff would theoretically rise to 0.51, while Bob's would drop to 0.40.
\end{itemize}
\paragraph{Phase 3: Regulatory Flight and Payoff Reversal (Post-Release).}
To restore fairness, the regulator is compelled to abandon Market 4 and migrate to the new optimal alternative. The data indicates that \textbf{Market 8}---defined by \textbf{Complete Information} ($\text{CI}=\text{True}$), \textbf{Prohibited Communication} ($\text{MA}=\text{False}$), and an \textbf{Infinite Horizon} ($T=\infty$)---is now the fairness-maximizing choice (0.990).
In this new market, the strategic landscape reorganizes completely:
\begin{itemize}
\item \textbf{Alice} switches to \textbf{Model A} (\texttt{claude-3-7-sonnet}).
\item \textbf{Bob} switches to \textbf{Model B} (\texttt{gemini-2.0-flash}).
\item \textbf{Non-Adoption:} Crucially, in this new equilibrium, \textbf{neither player selects the new Model E}. The technology that precipitated the market shift is discarded.
\item \textbf{Outcome:} The regulator restores Fairness to \textbf{0.990}. However, the forced regulatory shift drastically alters the payoff distribution. Alice's expected payoff rises to \textbf{0.52} ($+0.03$ relative to the status quo), while Bob's payoff falls to \textbf{0.46} ($-0.04$).
\end{itemize}