Showing 1–36 of 36 results for author: Seuken, S

Truthful Aggregation of LLMs with an Application to Online Advertising

Authors: Ermis Soumalias, Michael J. Curry, Sven Seuken

Abstract: Online platforms generate hundreds of billions of dollars in revenue per year by showing advertisements alongside their own content. Currently, these platforms are integrating Large Language Models (LLMs) into their services. This makes revenue generation from LLM-generated content the next major challenge in online advertising. We consider a scenario where advertisers aim to influence the respons… ▽ More Online platforms generate hundreds of billions of dollars in revenue per year by showing advertisements alongside their own content. Currently, these platforms are integrating Large Language Models (LLMs) into their services. This makes revenue generation from LLM-generated content the next major challenge in online advertising. We consider a scenario where advertisers aim to influence the responses of an LLM to align with their interests, while platforms seek to maximize advertiser value and ensure user satisfaction. We introduce an auction mechanism for this problem that operates without LLM fine-tuning or access to model weights and provably converges to the output of the optimally fine-tuned LLM for the platform's objective as computational resources increase. Our mechanism ensures that truthful reporting is a dominant strategy for advertisers and it aligns each advertiser's utility with their contribution to social welfare - an essential feature for long-term viability. Additionally, it can incorporate contextual information about the advertisers, significantly accelerating convergence. Via experiments with a publicly available LLM, we show that our mechanism significantly boosts advertiser value and platform revenue, with low computational overhead. While our motivating application is online advertising, our mechanism can be applied in any setting with monetary transfers, making it a general-purpose solution for truthfully aggregating the preferences of self-interested agents over LLM-generated replies. △ Less

Submitted 26 June, 2024; v1 submitted 9 May, 2024; originally announced May 2024.

Automated Design of Affine Maximizer Mechanisms in Dynamic Settings

Authors: Michael Curry, Vinzenz Thoma, Darshan Chakrabarti, Stephen McAleer, Christian Kroer, Tuomas Sandholm, Niao He, Sven Seuken

Abstract: Dynamic mechanism design is a challenging extension to ordinary mechanism design in which the mechanism designer must make a sequence of decisions over time in the face of possibly untruthful reports of participating agents. Optimizing dynamic mechanisms for welfare is relatively well understood. However, there has been less work on optimizing for other goals (e.g. revenue), and without restrictiv… ▽ More Dynamic mechanism design is a challenging extension to ordinary mechanism design in which the mechanism designer must make a sequence of decisions over time in the face of possibly untruthful reports of participating agents. Optimizing dynamic mechanisms for welfare is relatively well understood. However, there has been less work on optimizing for other goals (e.g. revenue), and without restrictive assumptions on valuations, it is remarkably challenging to characterize good mechanisms. Instead, we turn to automated mechanism design to find mechanisms with good performance in specific problem instances. In fact, the situation is similar even in static mechanism design. However, in the static case, optimization/machine learning-based automated mechanism design techniques have been successful in finding high-revenue mechanisms in cases beyond the reach of analytical results. We extend the class of affine maximizer mechanisms to MDPs where agents may untruthfully report their rewards. This extension results in a challenging bilevel optimization problem in which the upper problem involves choosing optimal mechanism parameters, and the lower problem involves solving the resulting MDP. Our approach can find truthful dynamic mechanisms that achieve strong performance on goals other than welfare, and can be applied to essentially any problem setting-without restrictions on valuations-for which RL can learn optimal policies. △ Less

Submitted 12 February, 2024; originally announced February 2024.

Comments: To be published in the Thirty-Eighth Proceedings of the AAAI Conference on Artificial Intelligence 2024

Scalable Mechanism Design for Multi-Agent Path Finding

Authors: Paul Friedrich, Yulun Zhang, Michael Curry, Ludwig Dierks, Stephen McAleer, Jiaoyang Li, Tuomas Sandholm, Sven Seuken

Abstract: Multi-Agent Path Finding (MAPF) involves determining paths for multiple agents to travel simultaneously and collision-free through a shared area toward given goal locations. This problem is computationally complex, especially when dealing with large numbers of agents, as is common in realistic applications like autonomous vehicle coordination. Finding an optimal solution is often computationally i… ▽ More Multi-Agent Path Finding (MAPF) involves determining paths for multiple agents to travel simultaneously and collision-free through a shared area toward given goal locations. This problem is computationally complex, especially when dealing with large numbers of agents, as is common in realistic applications like autonomous vehicle coordination. Finding an optimal solution is often computationally infeasible, making the use of approximate, suboptimal algorithms essential. Adding to the complexity, agents might act in a self-interested and strategic way, possibly misrepresenting their goals to the MAPF algorithm if it benefits them. Although the field of mechanism design offers tools to align incentives, using these tools without careful consideration can fail when only having access to approximately optimal outcomes. In this work, we introduce the problem of scalable mechanism design for MAPF and propose three strategyproof mechanisms, two of which even use approximate MAPF algorithms. We test our mechanisms on realistic MAPF domains with problem sizes ranging from dozens to hundreds of agents. We find that they improve welfare beyond a simple baseline. △ Less

Submitted 8 May, 2024; v1 submitted 30 January, 2024; originally announced January 2024.

Comments: 12 pages, 5 figures. IJCAI'24 camera-ready version

Learning Best Response Policies in Dynamic Auctions via Deep Reinforcement Learning

Authors: Vinzenz Thoma, Michael Curry, Niao He, Sven Seuken

Abstract: Many real-world auctions are dynamic processes, in which bidders interact and report information over multiple rounds with the auctioneer. The sequential decision making aspect paired with imperfect information renders analyzing the incentive properties of such auctions much more challenging than in the static case. It is clear that bidders often have incentives for manipulation, but the full scop… ▽ More Many real-world auctions are dynamic processes, in which bidders interact and report information over multiple rounds with the auctioneer. The sequential decision making aspect paired with imperfect information renders analyzing the incentive properties of such auctions much more challenging than in the static case. It is clear that bidders often have incentives for manipulation, but the full scope of such strategies is not well-understood. We aim to develop a tool for better understanding the incentive properties in dynamic auctions by using reinforcement learning to learn the optimal strategic behavior for an auction participant. We frame the decision problem as a Markov Decision Process, show its relation to multi-task reinforcement learning and use a soft actor-critic algorithm with experience relabeling to best-respond against several known analytical equilibria as well as to find profitable deviations against exploitable bidder strategies. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: 14 pages, 4 figures

Computing Perfect Bayesian Equilibria in Sequential Auctions

Authors: Vinzenz Thoma, Vitor Bosshard, Sven Seuken

Abstract: We present a best-response based algorithm for computing verifiable $\varepsilon$-perfect Bayesian equilibria for sequential auctions with combinatorial bidding spaces and incomplete information. Previous work has focused only on computing Bayes-Nash equilibria for static single-round auctions, which our work captures as a special case. Additionally, we prove an upper bound $\varepsilon$ on the ut… ▽ More We present a best-response based algorithm for computing verifiable $\varepsilon$-perfect Bayesian equilibria for sequential auctions with combinatorial bidding spaces and incomplete information. Previous work has focused only on computing Bayes-Nash equilibria for static single-round auctions, which our work captures as a special case. Additionally, we prove an upper bound $\varepsilon$ on the utility loss of our approximate equilibria and present an algorithm to efficiently compute $\varepsilon$ based on the immediate loss at each subgame. We evaluate the performance of our algorithm by reproducing known results from several auctions previously introduced in the literature, including a model of combinatorial split-award auctions used in procurement. △ Less

Submitted 7 December, 2023; originally announced December 2023.

Comments: 12 pages, 8 figures

Machine Learning-Powered Combinatorial Clock Auction

Authors: Ermis Soumalias, Jakob Weissteiner, Jakob Heiss, Sven Seuken

Abstract: We study the design of iterative combinatorial auctions (ICAs). The main challenge in this domain is that the bundle space grows exponentially in the number of items. To address this, several papers have recently proposed machine learning (ML)-based preference elicitation algorithms that aim to elicit only the most important information from bidders. However, from a practical point of view, the ma… ▽ More We study the design of iterative combinatorial auctions (ICAs). The main challenge in this domain is that the bundle space grows exponentially in the number of items. To address this, several papers have recently proposed machine learning (ML)-based preference elicitation algorithms that aim to elicit only the most important information from bidders. However, from a practical point of view, the main shortcoming of this prior work is that those designs elicit bidders' preferences via value queries (i.e., ``What is your value for the bundle $\{A,B\}$?''). In most real-world ICA domains, value queries are considered impractical, since they impose an unrealistically high cognitive burden on bidders, which is why they are not used in practice. In this paper, we address this shortcoming by designing an ML-powered combinatorial clock auction that elicits information from the bidders only via demand queries (i.e., ``At prices $p$, what is your most preferred bundle of items?''). We make two key technical contributions: First, we present a novel method for training an ML model on demand queries. Second, based on those trained ML models, we introduce an efficient method for determining the demand query with the highest clearing potential, for which we also provide a theoretical foundation. We experimentally evaluate our ML-based demand query mechanism in several spectrum auction domains and compare it against the most established real-world ICA: the combinatorial clock auction (CCA). Our mechanism significantly outperforms the CCA in terms of efficiency in all domains, it achieves higher efficiency in a significantly reduced number of rounds, and, using linear prices, it exhibits vastly higher clearing potential. Thus, with this paper we bridge the gap between research and practice and propose the first practical ML-powered ICA. △ Less

Submitted 28 March, 2024; v1 submitted 20 August, 2023; originally announced August 2023.

Comments: AAAI 2024 (8 pages + appendix)

MSC Class: 91A06 ACM Class: I.2

Journal ref: Proceedings of the AAAI Conference on Artificial Intelligence, 38(9) (2024) 9891-9900

Machine Learning-Powered Course Allocation

Authors: Ermis Soumalias, Behnoosh Zamanlooy, Jakob Weissteiner, Sven Seuken

Abstract: We study the course allocation problem, where universities assign course schedules to students. The current state-of-the-art mechanism, Course Match, has one major shortcoming: students make significant mistakes when reporting their preferences, which negatively affects welfare and fairness. To address this issue, we introduce a new mechanism, Machine Learning-powered Course Match (MLCM). At the c… ▽ More We study the course allocation problem, where universities assign course schedules to students. The current state-of-the-art mechanism, Course Match, has one major shortcoming: students make significant mistakes when reporting their preferences, which negatively affects welfare and fairness. To address this issue, we introduce a new mechanism, Machine Learning-powered Course Match (MLCM). At the core of MLCM is a machine learning-powered preference elicitation module that iteratively asks personalized pairwise comparison queries to alleviate students' reporting mistakes. Extensive computational experiments, grounded in real-world data, demonstrate that MLCM, with only ten comparison queries, significantly increases both average and minimum student utility by 7%-11% and 17%-29%, respectively. Finally, we highlight MLCM's robustness to changes in the environment and show how our design minimizes the risk of upgrading to MLCM while making the upgrade process simple for universities and seamless for their students. △ Less

Submitted 9 March, 2024; v1 submitted 3 October, 2022; originally announced October 2022.

Bayesian Optimization-based Combinatorial Assignment

Authors: Jakob Weissteiner, Jakob Heiss, Julien Siems, Sven Seuken

Abstract: We study the combinatorial assignment domain, which includes combinatorial auctions and course allocation. The main challenge in this domain is that the bundle space grows exponentially in the number of items. To address this, several papers have recently proposed machine learning-based preference elicitation algorithms that aim to elicit only the most important information from agents. However, t… ▽ More We study the combinatorial assignment domain, which includes combinatorial auctions and course allocation. The main challenge in this domain is that the bundle space grows exponentially in the number of items. To address this, several papers have recently proposed machine learning-based preference elicitation algorithms that aim to elicit only the most important information from agents. However, the main shortcoming of this prior work is that it does not model a mechanism's uncertainty over values for not yet elicited bundles. In this paper, we address this shortcoming by presenting a Bayesian optimization-based combinatorial assignment (BOCA) mechanism. Our key technical contribution is to integrate a method for capturing model uncertainty into an iterative combinatorial auction mechanism. Concretely, we design a new method for estimating an upper uncertainty bound that can be used to define an acquisition function to determine the next query to the agents. This enables the mechanism to properly explore (and not just exploit) the bundle space during its preference elicitation phase. We run computational experiments in several spectrum auction domains to evaluate BOCA's performance. Our results show that BOCA achieves higher allocative efficiency than state-of-the-art approaches. △ Less

Submitted 13 March, 2023; v1 submitted 31 August, 2022; originally announced August 2022.

Journal ref: Proceedings of the AAAI Conference on Artificial Intelligence Vol 37 (2023)

Non-decreasing Payment Rules for Combinatorial Auctions

Authors: Vitor Bosshard, Ye Wang, Sven Seuken

Abstract: Combinatorial auctions are used to allocate resources in domains where bidders have complex preferences over bundles of goods. However, the behavior of bidders under different payment rules is not well understood, and there has been limited success in finding Bayes-Nash equilibria of such auctions due to the computational difficulties involved. In this paper, we introduce non-decreasing payment ru… ▽ More Combinatorial auctions are used to allocate resources in domains where bidders have complex preferences over bundles of goods. However, the behavior of bidders under different payment rules is not well understood, and there has been limited success in finding Bayes-Nash equilibria of such auctions due to the computational difficulties involved. In this paper, we introduce non-decreasing payment rules. Under such a rule, the payment of a bidder cannot decrease when he increases his bid, which is a natural and desirable property. VCG-nearest, the payment rule most commonly used in practice, violates this property and can thus be manipulated in surprising ways. In contrast, we show that many other payment rules are non-decreasing. We also show that a non-decreasing payment rule imposes a structure on the auction game that enables us to search for an approximate Bayes-Nash equilibrium much more efficiently than in the general case. Finally, we introduce the utility planes BNE algorithm, which exploits this structure and outperforms a state-of-the-art algorithm by multiple orders of magnitude. △ Less

Submitted 7 June, 2022; originally announced June 2022.

Comments: Published at IJCAI 2018. Includes corrigendum explaining a mistake in the original paper

Enabling Trade-offs in Machine Learning-based Matching for Refugee Resettlement

Authors: Nils Olberg, Sven Seuken

Abstract: The Swiss State Secretariat for Migration recently announced a pilot project for a machine learning-based assignment process for refugee resettlement. This approach has the potential to substantially increase the overall employment rate of refugees in Switzerland. However, the currently proposed method ignores families' preferences. In this paper, we build on this prior work and propose two matchi… ▽ More The Swiss State Secretariat for Migration recently announced a pilot project for a machine learning-based assignment process for refugee resettlement. This approach has the potential to substantially increase the overall employment rate of refugees in Switzerland. However, the currently proposed method ignores families' preferences. In this paper, we build on this prior work and propose two matching mechanisms that additionally take families' preferences over locations into account. The first mechanism is strategyproof while the second is not but achieves higher family welfare. Importantly, we parameterize both mechanisms, giving placement officers precise control how to trade off family welfare against overall employment success. Preliminary simulations on synthetic data show that both mechanisms can significantly increase family welfare even with only a small loss on the overall employment rate of refugees. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Market Design for Drone Traffic Management

Authors: Sven Seuken, Paul Friedrich, Ludwig Dierks

Abstract: The rapid development of drone technology is leading to more and more use cases being proposed. In response, regulators are drawing up drone traffic management frameworks. However, to design solutions that are efficient, fair, simple, non-manipulable, and scalable, we need market design and AI expertise. To this end, we introduce the drone traffic management problem as a new research challenge to… ▽ More The rapid development of drone technology is leading to more and more use cases being proposed. In response, regulators are drawing up drone traffic management frameworks. However, to design solutions that are efficient, fair, simple, non-manipulable, and scalable, we need market design and AI expertise. To this end, we introduce the drone traffic management problem as a new research challenge to the market design and AI communities. We present five design desiderata that we have derived from our interviews with stakeholders from the regulatory side as well as from public and private enterprises. Finally, we provide an overview of the solution space to point out possible directions for future research. △ Less

Submitted 19 January, 2022; v1 submitted 26 October, 2021; originally announced October 2021.

Comments: Final version of a Blue Sky Ideas paper forthcoming at the 36th AAAI Conference on Artificial Intelligence, Vancouver, Canada, 2022. Changes to prev. version: expanded several sections, fixed typos, added references

Monotone-Value Neural Networks: Exploiting Preference Monotonicity in Combinatorial Assignment

Authors: Jakob Weissteiner, Jakob Heiss, Julien Siems, Sven Seuken

Abstract: Many important resource allocation problems involve the combinatorial assignment of items, e.g., auctions or course allocation. Because the bundle space grows exponentially in the number of items, preference elicitation is a key challenge in these domains. Recently, researchers have proposed ML-based mechanisms that outperform traditional mechanisms while reducing preference elicitation costs for… ▽ More Many important resource allocation problems involve the combinatorial assignment of items, e.g., auctions or course allocation. Because the bundle space grows exponentially in the number of items, preference elicitation is a key challenge in these domains. Recently, researchers have proposed ML-based mechanisms that outperform traditional mechanisms while reducing preference elicitation costs for agents. However, one major shortcoming of the ML algorithms that were used is their disregard of important prior knowledge about agents' preferences. To address this, we introduce monotone-value neural networks (MVNNs), which are designed to capture combinatorial valuations, while enforcing monotonicity and normality. On a technical level, we prove that our MVNNs are universal in the class of monotone and normalized value functions, and we provide a mixed-integer linear program (MILP) formulation to make solving MVNN-based winner determination problems (WDPs) practically feasible. We evaluate our MVNNs experimentally in spectrum auction domains. Our results show that MVNNs improve the prediction performance, they yield state-of-the-art allocative efficiency in the auction, and they also reduce the run-time of the WDPs. Our code is available on GitHub: https://github.com/marketdesignresearch/MVNN. △ Less

Submitted 11 March, 2023; v1 submitted 30 September, 2021; originally announced September 2021.

Journal ref: Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence Main Track (2022). Pages 541-548

Shapley-Based Core-Selecting Payment Rules

Authors: Vitor Bosshard, Sven Seuken

Abstract: In this research note, we lay some groundwork for analyzing the manipulability of core-selecting payment rules in combinatorial auctions. In particular, we focus on payment rules based on the bidders' Shapley values. We define a sensitivity metric, and provide analytical results for this metric in LLG, for six different payment vectors used as reference points for minimum-revenue core-selecting pa… ▽ More In this research note, we lay some groundwork for analyzing the manipulability of core-selecting payment rules in combinatorial auctions. In particular, we focus on payment rules based on the bidders' Shapley values. We define a sensitivity metric, and provide analytical results for this metric in LLG, for six different payment vectors used as reference points for minimum-revenue core-selecting payment rules. We furthermore show how this sensitivity affects the derivative of the resulting payment rules. △ Less

Submitted 2 July, 2021; originally announced July 2021.

Comments: Research Note

Search and Matching for Adoption from Foster Care

Authors: Ludwig Dierks, Nils Olberg, Sven Seuken, Vincent W. Slaugh, M. Utku Ünver

Abstract: To find families for the more than 100,000 children in need of adoptive placements, most United States child welfare agencies have employed a family-driven search strategy in which prospective families respond to announcements made by the agency. However, some agencies have switched to a caseworker-driven search strategy in which the caseworker directly contacts families recommended for a child. W… ▽ More To find families for the more than 100,000 children in need of adoptive placements, most United States child welfare agencies have employed a family-driven search strategy in which prospective families respond to announcements made by the agency. However, some agencies have switched to a caseworker-driven search strategy in which the caseworker directly contacts families recommended for a child. We introduce a novel search-and-matching model to capture essential aspects of the adoption process and compare the two approaches through a game-theoretical analysis. We show that the search equilibria induced by threshold strategies form a lattice structure under either approach. Our main theoretical result establishes that the equilibrium outcomes in family-driven search can never Pareto dominate the outcomes in caseworker-driven search, but it is possible that each caseworker-driven search outcome Pareto dominates all family-driven search outcomes. We also find that when families are sufficiently impatient, caseworker-driven search is better for all children. We illustrate numerically that most agents are better off under caseworker-driven search for a wide range of parameters. Finally, we provide empirical evidence from an agency that switched to caseworker-driven search and achieved a three-year adoption probability that outperformed a statewide benchmark by 17%. △ Less

Submitted 23 May, 2024; v1 submitted 18 March, 2021; originally announced March 2021.

NOMU: Neural Optimization-based Model Uncertainty

Authors: Jakob Heiss, Jakob Weissteiner, Hanna Wutte, Sven Seuken, Josef Teichmann

Abstract: We study methods for estimating model uncertainty for neural networks (NNs) in regression. To isolate the effect of model uncertainty, we focus on a noiseless setting with scarce training data. We introduce five important desiderata regarding model uncertainty that any method should satisfy. However, we find that established benchmarks often fail to reliably capture some of these desiderata, even… ▽ More We study methods for estimating model uncertainty for neural networks (NNs) in regression. To isolate the effect of model uncertainty, we focus on a noiseless setting with scarce training data. We introduce five important desiderata regarding model uncertainty that any method should satisfy. However, we find that established benchmarks often fail to reliably capture some of these desiderata, even those that are required by Bayesian theory. To address this, we introduce a new approach for capturing model uncertainty for NNs, which we call Neural Optimization-based Model Uncertainty (NOMU). The main idea of NOMU is to design a network architecture consisting of two connected sub-NNs, one for model prediction and one for model uncertainty, and to train it using a carefully-designed loss function. Importantly, our design enforces that NOMU satisfies our five desiderata. Due to its modular architecture, NOMU can provide model uncertainty for any given (previously trained) NN if given access to its training data. We evaluate NOMU in various regressions tasks and noiseless Bayesian optimization (BO) with costly evaluations. In regression, NOMU performs at least as well as state-of-the-art methods. In BO, NOMU even outperforms all considered benchmarks. △ Less

Submitted 11 March, 2023; v1 submitted 26 February, 2021; originally announced February 2021.

Comments: 9 pages + appendix

Journal ref: Proceedings of the 39th International Conference on Machine Learning, PMLR 162:8708-8758, 2022

The Cost of Simple Bidding in Combinatorial Auctions

Authors: Vitor Bosshard, Sven Seuken

Abstract: We study a class of manipulations in combinatorial auctions where bidders fundamentally misrepresent what goods they are interested in. Prior work has largely assumed that bidders only submit bids on their bundles of interest, which we call simple bidding: strategizing over the bid amounts, but not the bundle identities. However, we show that there exists an entire class of auction instances for w… ▽ More We study a class of manipulations in combinatorial auctions where bidders fundamentally misrepresent what goods they are interested in. Prior work has largely assumed that bidders only submit bids on their bundles of interest, which we call simple bidding: strategizing over the bid amounts, but not the bundle identities. However, we show that there exists an entire class of auction instances for which simple bids are never optimal in Bayes-Nash equilibrium, always being strictly dominated by complex bids (where bidders bid on goods they are not interested in). We show this result for the two most widely used auction mechanisms: first price and VCG-nearest. We also explore the structural properties of the winner determination problem that cause this phenomenon, and we use the insights gained to investigate how impactful complex bidding may be. We find that, in the worst case, a bidder's optimal complex bid may require bidding on an exponential number of bundles, even if the bidder is interested only in a single good. Thus, this phenomenon can greatly impact the auction's outcome and should not be ignored by bidders and auction designers alike. △ Less

Submitted 10 September, 2021; v1 submitted 24 November, 2020; originally announced November 2020.

iMLCA: Machine Learning-powered Iterative Combinatorial Auctions with Interval Bidding

Authors: Benjamin Lubin, Sven Seuken, Manuel Beyeler, Gianluca Brero

Abstract: Preference elicitation is a major challenge in large combinatorial auctions because the bundle space grows exponentially in the number of items. Recent work has used machine learning (ML) algorithms to identify a small set of bundles to query from each bidder. However, a shortcoming of this prior work is that bidders must submit exact values for the queried bundles, which can be quite costly. To a… ▽ More Preference elicitation is a major challenge in large combinatorial auctions because the bundle space grows exponentially in the number of items. Recent work has used machine learning (ML) algorithms to identify a small set of bundles to query from each bidder. However, a shortcoming of this prior work is that bidders must submit exact values for the queried bundles, which can be quite costly. To address this, we propose iMLCA, a new ML-powered iterative combinatorial auction with interval bidding (i.e., where bidders submit upper and lower bounds instead of exact values). To steer the auction towards an efficient allocation, we introduce a price-based activity rule, asking bidders to tighten bounds on relevant bundles only. In our experiments, iMLCA achieves the same allocative efficiency as the prior ML-based auction that uses exact bidding. Moreover, it outperforms the well-known combinatorial clock auction in a realistically-sized domain. △ Less

Submitted 29 August, 2021; v1 submitted 28 September, 2020; originally announced September 2020.

Comments: 30 pages, 3 figures

Fourier Analysis-based Iterative Combinatorial Auctions

Authors: Jakob Weissteiner, Chris Wendler, Sven Seuken, Ben Lubin, Markus Püschel

Abstract: Recent advances in Fourier analysis have brought new tools to efficiently represent and learn set functions. In this paper, we bring the power of Fourier analysis to the design of combinatorial auctions (CAs). The key idea is to approximate bidders' value functions using Fourier-sparse set functions, which can be computed using a relatively small number of queries. Since this number is still too l… ▽ More Recent advances in Fourier analysis have brought new tools to efficiently represent and learn set functions. In this paper, we bring the power of Fourier analysis to the design of combinatorial auctions (CAs). The key idea is to approximate bidders' value functions using Fourier-sparse set functions, which can be computed using a relatively small number of queries. Since this number is still too large for practical CAs, we propose a new hybrid design: we first use neural networks (NNs) to learn bidders' values and then apply Fourier analysis to the learned representations. On a technical level, we formulate a Fourier transform-based winner determination problem and derive its mixed integer program formulation. Based on this, we devise an iterative CA that asks Fourier-based queries. We experimentally show that our hybrid ICA achieves higher efficiency than prior auction designs, leads to a fairer distribution of social welfare, and significantly reduces runtime. With this paper, we are the first to leverage Fourier analysis in CA design and lay the foundation for future work in this area. Our code is available on GitHub: https://github.com/marketdesignresearch/FA-based-ICAs. △ Less

Submitted 11 March, 2023; v1 submitted 22 September, 2020; originally announced September 2020.

Journal ref: Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence Main Track (2022). Pages 549-556

Revenue Maximization for Consumer Software: Subscription or Perpetual License?

Authors: Ludwig Dierks, Sven Seuken

Abstract: We study the revenue maximization problem of a publisher selling consumer software. We assume that the publisher sells either traditional perpetual licenses, subscription licenses, or both. For our analysis, we employ a game-theoretic model, which enables us to derive the users' equilibrium strategies and the publisher's optimal pricing strategy. Via extensive numerical evaluations, we then demons… ▽ More We study the revenue maximization problem of a publisher selling consumer software. We assume that the publisher sells either traditional perpetual licenses, subscription licenses, or both. For our analysis, we employ a game-theoretic model, which enables us to derive the users' equilibrium strategies and the publisher's optimal pricing strategy. Via extensive numerical evaluations, we then demonstrate the sizable impact different pricing strategies have on the publisher's revenue, and we provide comparative statics for the most important settings parameters. Although in practice, many publishers still only sell perceptual licenses, we find that offering a subscription license in addition to a perpetual license typically (but not always) leads to significantly higher revenue than only selling either type of license on its own. △ Less

Submitted 22 July, 2020; originally announced July 2020.

An Axiomatic Decomposition of Strategyproofness for Ordinal Mechanism with Indifferences

Authors: Timo Mennle, Sven Seuken

Abstract: We study mechanism which operate on ordinal preference information (i.e., rank ordered lists of alternatives) on the full domain of weak preferences that admits indifferences. We present a novel decomposition of strategyproofness into three axioms: separation monotonic, separation upper invariant, and separation lower invariant. Each axiom is a natural restriction on how mechanisms can react when… ▽ More We study mechanism which operate on ordinal preference information (i.e., rank ordered lists of alternatives) on the full domain of weak preferences that admits indifferences. We present a novel decomposition of strategyproofness into three axioms: separation monotonic, separation upper invariant, and separation lower invariant. Each axiom is a natural restriction on how mechanisms can react when agents change their opinion about the relative ranking of any two adjacently ranked groups of alternatives. Our result extends a result from (Mennle and Seuken, 2017), a decomposition of strategyproofness for strict preferences, to the full domain that includes weak preferences. △ Less

Submitted 14 July, 2020; originally announced July 2020.

Two New Impossibility Results for the Random Assignment Problem

Authors: Timo Mennle, Sven Seuken

Abstract: In this note, we prove two new impossibility results for random assignment mechanisms: Bogomolnaia and Moulin (2001) showed that no assignment mechanism can satisfy strategyproofness, ordinal efficiency, and symmetry at the same time, and Mennle and Seuken (2017) gave a decomposition of strategyproofness into the axioms swap monotonicity, upper invariance, and lower invariance. For our first impos… ▽ More In this note, we prove two new impossibility results for random assignment mechanisms: Bogomolnaia and Moulin (2001) showed that no assignment mechanism can satisfy strategyproofness, ordinal efficiency, and symmetry at the same time, and Mennle and Seuken (2017) gave a decomposition of strategyproofness into the axioms swap monotonicity, upper invariance, and lower invariance. For our first impossibility result, we show that upper invariance, lower invariance, ordinal efficiency, and symmetry are incompatible. This refines the prior impossibility result because it relaxes swap monotonicity. For our second impossibility result, we show that no assignment mechanism satisfies swap monotonicity, lower invariance, ordinal efficiency, anonymity, neutrality, and non-bossiness. By contrasts, the Probabilistic Serial (PS) mechanism that Bogomolnaia and Moulin (2001) introduced, satisfies these axioms when lower invariance is replaced by upper invariance. It follows that there cannot exists a lower invariant counterpart to PS. △ Less

Submitted 14 July, 2020; originally announced July 2020.

Local Sufficiency for Partial Strategyproofness

Authors: Timo Mennle, Sven Seuken

Abstract: In (Mennle and Seuken, 2017), we have introduced partial strategyproofness, a new, relaxed notion of strategyproofness, to study the incentive properties of non-strategyproof assignment mechanisms. In this paper, we present results pertaining to local sufficiency for partial strategyproofness: We show that, for any r in [0,1], r-local partial strategyproofness implies r^2-partial strategyproofness… ▽ More In (Mennle and Seuken, 2017), we have introduced partial strategyproofness, a new, relaxed notion of strategyproofness, to study the incentive properties of non-strategyproof assignment mechanisms. In this paper, we present results pertaining to local sufficiency for partial strategyproofness: We show that, for any r in [0,1], r-local partial strategyproofness implies r^2-partial strategyproofness, and we show that this is the tightest polynomial bound for which a guarantee can be proven. Our results unify the two prior local sufficiency results for strategyproofness (Carroll, 2012) and lexicographic dominance-strategyproofness (Cho, 2012). △ Less

Submitted 14 July, 2020; originally announced July 2020.

The Competitive Effects of Variance-based Pricing

Authors: Ludwig Dierks, Sven Seuken

Abstract: In many markets, like electricity or cloud computing markets, providers incur large costs for kee** sufficient capacity in reserve to accommodate demand fluctuations of a mostly fixed user base. These costs are significantly affected by the unpredictability of the users' demand. Nevertheless, standard mechanisms charge fixed per-unit prices that do not depend on the variability of the users' dem… ▽ More In many markets, like electricity or cloud computing markets, providers incur large costs for kee** sufficient capacity in reserve to accommodate demand fluctuations of a mostly fixed user base. These costs are significantly affected by the unpredictability of the users' demand. Nevertheless, standard mechanisms charge fixed per-unit prices that do not depend on the variability of the users' demand. In this paper, we study a variance-based pricing rule in a two-provider market setting and perform a game-theoretic analysis of the resulting competitive effects. We show that an innovative provider who employs variance-based pricing can choose a pricing strategy that guarantees himself a higher profit than using fixed per-unit prices for any individually rational response of a provider playing a fixed pricing strategy. We characterize all equilibria for the setting where both providers employ variance-based pricing strategies. We find that, while in equilibrium, the profits of the providers may increase or decrease depending on their cost functions, social welfare always weakly increases. △ Less

Submitted 6 April, 2020; v1 submitted 31 January, 2020; originally announced January 2020.

Machine Learning-powered Iterative Combinatorial Auctions

Authors: Gianluca Brero, Benjamin Lubin, Sven Seuken

Abstract: We present a machine learning-powered iterative combinatorial auction (MLCA). The main goal of integrating machine learning (ML) into the auction is to improve preference elicitation, which is a major challenge in large combinatorial auctions (CAs). In contrast to prior work, our auction design uses value queries instead of prices to drive the auction. The ML algorithm is used to help the auction… ▽ More We present a machine learning-powered iterative combinatorial auction (MLCA). The main goal of integrating machine learning (ML) into the auction is to improve preference elicitation, which is a major challenge in large combinatorial auctions (CAs). In contrast to prior work, our auction design uses value queries instead of prices to drive the auction. The ML algorithm is used to help the auction decide which value queries to ask in every iteration. While using ML inside a CA introduces new challenges, we demonstrate how we obtain a design that is individually rational, satisfies no-deficit, has good incentives, and is computationally practical. We benchmark our new auction against the well-known combinatorial clock auction (CCA). Our results indicate that, especially in large domains, MLCA can achieve significantly higher allocative efficiency than the CCA, even with only a small number of value queries. △ Less

Submitted 1 September, 2021; v1 submitted 18 November, 2019; originally announced November 2019.

Monotonic and Non-Monotonic Solution Concepts for Generalized Circuits

Authors: Steffen Schuldenzucker, Sven Seuken

Abstract: Generalized circuits are an important tool in the study of the computational complexity of equilibrium approximation problems. However, in this paper, we reveal that they have a conceptual flaw, namely that the solution concept is not monotonic. By this we mean that if $\varepsilon < \varepsilon'$, then an $\varepsilon$-approximate solution for a certain generalized circuit is not necessarily also… ▽ More Generalized circuits are an important tool in the study of the computational complexity of equilibrium approximation problems. However, in this paper, we reveal that they have a conceptual flaw, namely that the solution concept is not monotonic. By this we mean that if $\varepsilon < \varepsilon'$, then an $\varepsilon$-approximate solution for a certain generalized circuit is not necessarily also an $\varepsilon'$-approximate solution. The reason for this non-monotonicity is the way Boolean operations are modeled. We illustrate that non-monotonicity creates subtle technical issues in prior work that require intricate additional arguments to circumvent. To eliminate this problem, we show that the Boolean gates are a redundant feature: one can simulate stronger, monotonic versions of the Boolean gates using the other gate types. Arguing at the level of these stronger Boolean gates eliminates all of the aforementioned issues in a natural way. We hope that our results will enable new studies of sub-classes of generalized circuits and enabler simpler and more natural reductions from generalized circuits to other equilibrium search problems. △ Less

Submitted 30 July, 2019; originally announced July 2019.

Deep Learning-powered Iterative Combinatorial Auctions

Authors: Jakob Weissteiner, Sven Seuken

Abstract: In this paper, we study the design of deep learning-powered iterative combinatorial auctions (ICAs). We build on prior work where preference elicitation was done via kernelized support vector regressions (SVRs). However, the SVR-based approach has limitations because it requires solving a machine learning (ML)-based winner determination problem (WDP). With expressive kernels (like gaussians), the… ▽ More In this paper, we study the design of deep learning-powered iterative combinatorial auctions (ICAs). We build on prior work where preference elicitation was done via kernelized support vector regressions (SVRs). However, the SVR-based approach has limitations because it requires solving a machine learning (ML)-based winner determination problem (WDP). With expressive kernels (like gaussians), the ML-based WDP cannot be solved for large domains. While linear or quadratic kernels have better computational scalability, these kernels have limited expressiveness. In this work, we address these shortcomings by using deep neural networks (DNNs) instead of SVRs. We first show how the DNN-based WDP can be reformulated into a mixed integer program (MIP). Second, we experimentally compare the prediction performance of DNNs against SVRs. Third, we present experimental evaluations in two medium-sized domains which show that even ICAs based on relatively small-sized DNNs lead to higher economic efficiency than ICAs based on kernelized SVRs. Finally, we show that our DNN-powered ICA also scales well to very large CA domains. △ Less

Submitted 11 March, 2023; v1 submitted 12 July, 2019; originally announced July 2019.

Journal ref: Proceedings of the AAAI Conference on Artificial Intelligence Vol 34 (2020) 2284-2293

Computing Bayes-Nash Equilibria in Combinatorial Auctions with Verification

Authors: Vitor Bosshard, Benedikt Bünz, Benjamin Lubin, Sven Seuken

Abstract: We present a new algorithm for computing pure-strategy $\varepsilon$-Bayes-Nash equilibria ($\varepsilon$-BNEs) in combinatorial auctions with continuous value and action spaces. An essential innovation of our algorithm is to separate the algorithm's search phase (for finding the $\varepsilon$-BNE) from the verification phase (for computing the $\varepsilon$). Using this approach, we obtain an alg… ▽ More We present a new algorithm for computing pure-strategy $\varepsilon$-Bayes-Nash equilibria ($\varepsilon$-BNEs) in combinatorial auctions with continuous value and action spaces. An essential innovation of our algorithm is to separate the algorithm's search phase (for finding the $\varepsilon$-BNE) from the verification phase (for computing the $\varepsilon$). Using this approach, we obtain an algorithm that is both very fast and provides theoretical guarantees on the $\varepsilon$ it finds. Our main technical contribution is a verification method which allows us to upper bound the $\varepsilon$ across the whole continuous value space without making assumptions about the mechanism. Using our algorithm, we can now compute $\varepsilon$-BNEs in multi-minded domains that are significantly more complex than what was previously possible to solve. We release our code under an open-source license to enable researchers to perform algorithmic analyses of auctions, to enable bidders to analyze different strategies, and to facilitate many other applications. △ Less

Submitted 24 July, 2020; v1 submitted 5 December, 2018; originally announced December 2018.

Comments: 40 pages

Fast Iterative Combinatorial Auctions via Bayesian Learning

Authors: Gianluca Brero, Sébastien Lahaie, Sven Seuken

Abstract: Iterative combinatorial auctions (CAs) are often used in multi-billion dollar domains like spectrum auctions, and speed of convergence is one of the crucial factors behind the choice of a specific design for practical applications. To achieve fast convergence, current CAs require careful tuning of the price update rule to balance convergence speed and allocative efficiency. Brero and Lahaie (2018)… ▽ More Iterative combinatorial auctions (CAs) are often used in multi-billion dollar domains like spectrum auctions, and speed of convergence is one of the crucial factors behind the choice of a specific design for practical applications. To achieve fast convergence, current CAs require careful tuning of the price update rule to balance convergence speed and allocative efficiency. Brero and Lahaie (2018) recently introduced a Bayesian iterative auction design for settings with single-minded bidders. The Bayesian approach allowed them to incorporate prior knowledge into the price update algorithm, reducing the number of rounds to convergence with minimal parameter tuning. In this paper, we generalize their work to settings with no restrictions on bidder valuations. We introduce a new Bayesian CA design for this general setting which uses Monte Carlo Expectation Maximization to update prices at each round of the auction. We evaluate our approach via simulations on CATS instances. Our results show that our Bayesian CA outperforms even a highly optimized benchmark in terms of clearing percentage and convergence speed. △ Less

Submitted 10 July, 2019; v1 submitted 14 September, 2018; originally announced September 2018.

Comments: 9 pages, 2 figures, AAAI-19

FedMark: A Marketplace for Federated Data on the Web

Authors: Tobias Grubenmann, Abraham Bernstein, Dmitry Moor, Sven Seuken

Abstract: The Web of Data (WoD) has experienced a phenomenal growth in the past. This growth is mainly fueled by tireless volunteers, government subsidies, and open data legislations. The majority of commercial data has not made the transition to the WoD, yet. The problem is that it is not clear how publishers of commercial data can monetize their data in this new setting. Advertisement, which is one of the… ▽ More The Web of Data (WoD) has experienced a phenomenal growth in the past. This growth is mainly fueled by tireless volunteers, government subsidies, and open data legislations. The majority of commercial data has not made the transition to the WoD, yet. The problem is that it is not clear how publishers of commercial data can monetize their data in this new setting. Advertisement, which is one of the main financial engines of the World Wide Web, cannot be applied to the Web of Data as such unwanted data can easily be filtered out, automatically. This raises the question how the WoD can (i) maintain its grow when subsidies disappear and (ii) give commercial data providers financial incentives to share their wealth of data. In this paper, we propose a marketplace for the WoD as a solution for this data monetization problem. Our approach allows a customer to transparently buy data from a combination of different providers. To that end, we introduce two different approaches for deciding which data elements to buy and compare their performance. We also introduce FedMark, a prototypical implementation of our marketplace that represents a first step towards an economically viable WoD beyond subsidies. △ Less

Submitted 19 August, 2018; originally announced August 2018.

On the cluster admission problem for cloud computing

Authors: Ludwig Dierks, Ian A. Kash, Sven Seuken

Abstract: Cloud computing providers face the problem of matching heterogeneous customer workloads to resources that will serve them. This is particularly challenging if customers, who are already running a job on a cluster, scale their resource usage up and down over time. The provider therefore has to continuously decide whether she can add additional workloads to a given cluster or if doing so would impac… ▽ More Cloud computing providers face the problem of matching heterogeneous customer workloads to resources that will serve them. This is particularly challenging if customers, who are already running a job on a cluster, scale their resource usage up and down over time. The provider therefore has to continuously decide whether she can add additional workloads to a given cluster or if doing so would impact existing workloads' ability to scale. Currently, this is often done using simple threshold policies to reserve large parts of each cluster, which leads to low efficiency (i.e., low average utilization of the cluster). We propose more sophisticated policies for controlling admission to a cluster and demonstrate that they significantly increase cluster utilization. We first introduce the cluster admission problem and formalize it as a constrained Partially Observable Markov Decision Process (POMDP). As it is infeasible to solve the POMDP optimally, we then systematically design admission policies that estimate moments of each workload's distribution of future resource usage. Via extensive simulations grounded in a trace from Microsoft Azure, we show that our admission policies lead to a substantial improvement over the simple threshold policy. We then show that substantial further gains are possible if high-quality information is available about arriving workloads. Based on this, we propose an information elicitation approach to incentivize users to provide this information and simulate its effects. △ Less

Submitted 14 August, 2020; v1 submitted 20 April, 2018; originally announced April 2018.

Comments: This paper is a significantly extended version of work that was published as a 6-page extended abstract in the proceedings of the 14th Workshop on the Economics of Networks, Systems and Computation (NetEcon'19)

The Computational Complexity of Financial Networks with Credit Default Swaps

Authors: Steffen Schuldenzucker, Sven Seuken, Stefano Battiston

Abstract: The 2008 financial crisis has been attributed to "excessive complexity" of the financial system due to financial innovation. We employ computational complexity theory to make this notion precise. Specifically, we consider the problem of clearing a financial network after a shock. Prior work has shown that when banks can only enter into simple debt contracts with each other, then this problem can b… ▽ More The 2008 financial crisis has been attributed to "excessive complexity" of the financial system due to financial innovation. We employ computational complexity theory to make this notion precise. Specifically, we consider the problem of clearing a financial network after a shock. Prior work has shown that when banks can only enter into simple debt contracts with each other, then this problem can be solved in polynomial time. In contrast, if they can also enter into credit default swaps (CDSs), i.e., financial derivative contracts that depend on the default of another bank, a solution may not even exist. In this work, we show that deciding if a solution exists is NP-complete if CDSs are allowed. This remains true if we relax the problem to $\varepsilon$-approximate solutions, for a constant $\varepsilon$. We further show that, under sufficient conditions where a solution is guaranteed to exist, the approximate search problem is PPAD-complete for constant $\varepsilon$. We then try to isolate the "origin" of the complexity. It turns out that already determining which banks default is hard. Further, we show that the complexity is not driven by the dependence of counterparties on each other, but rather hinges on the presence of so-called naked CDSs. If naked CDSs are not present, we receive a simple polynomial-time algorithm. Our results are of practical importance for regulators' stress tests and regulatory policy. △ Less

Submitted 20 May, 2019; v1 submitted 4 October, 2017; originally announced October 2017.

The Pareto Frontier for Random Mechanisms

Authors: Timo Mennle, Sven Seuken

Abstract: We study the trade-offs between strategyproofness and other desiderata, such as efficiency or fairness, that often arise in the design of random ordinal mechanisms. We use approximate strategyproofness to define manipulability, a measure to quantify the incentive properties of non-strategyproof mechanisms, and we introduce the deficit, a measure to quantify the performance of mechanisms with respe… ▽ More We study the trade-offs between strategyproofness and other desiderata, such as efficiency or fairness, that often arise in the design of random ordinal mechanisms. We use approximate strategyproofness to define manipulability, a measure to quantify the incentive properties of non-strategyproof mechanisms, and we introduce the deficit, a measure to quantify the performance of mechanisms with respect to another desideratum. When this desideratum is incompatible with strategyproofness, mechanisms that trade off manipulability and deficit optimally form the Pareto frontier. Our main contribution is a structural characterization of this Pareto frontier, and we present algorithms that exploit this structure to compute it. To illustrate its shape, we apply our results for two different desiderata, namely Plurality and Veto scoring, in settings with 3 alternatives and up to 18 agents. △ Less

Submitted 10 January, 2017; v1 submitted 20 February, 2015; originally announced February 2015.

Comments: Working Paper

Trade-offs in School Choice: Comparing Deferred Acceptance, the Naive and the Classic Boston Mechanism

Authors: Timo Mennle, Sven Seuken

Abstract: The three most common school choice mechanisms are the Deferred Acceptance mechanism (DA), the classic Boston mechanism (BM), and a variant of the Boston mechanism where students automatically skip exhausted schools, which we call the adaptive Boston mechanism (ABM). Assuming truthful reporting, we compare student welfare under these mechanisms both from a conceptual and from a quantitative perspe… ▽ More The three most common school choice mechanisms are the Deferred Acceptance mechanism (DA), the classic Boston mechanism (BM), and a variant of the Boston mechanism where students automatically skip exhausted schools, which we call the adaptive Boston mechanism (ABM). Assuming truthful reporting, we compare student welfare under these mechanisms both from a conceptual and from a quantitative perspective: We first show that, BM rank dominates DA whenever they are comparable; and via limit arguments and simulations we show that ABM yields intermediate student welfare between BM and DA. Second, we perform computational experiments with preference data from the high school match in Mexico City. We find that student welfare (in terms of rank transitions) is highest under BM, intermediate under ABM, and lowest under DA. BM, ABM, and DA can thus be understood to form a hierarchy in terms of student welfare. In contrast, in (Mennle and Seuken, 2017), we have found that the same mechanisms also form a hierarchy in terms of incentives for truthtelling that points in the opposite direction. A decision between them therefore involves an implicit trade-off between incentives and student welfare. △ Less

Submitted 10 July, 2017; v1 submitted 12 June, 2014; originally announced June 2014.

Comments: Working Paper

Partial Strategyproofness: Relaxing Strategyproofness for the Random Assignment Problem

Authors: Timo Mennle, Sven Seuken

Abstract: We present partial strategyproofness, a new, relaxed notion of strategyproofness for studying the incentive properties of non-strategyproof assignment mechanisms. Informally, a mechanism is partially strategyproof if it makes truthful reporting a dominant strategy for those agents whose preference intensities differ sufficiently between any two objects. We demonstrate that partial strategyproofnes… ▽ More We present partial strategyproofness, a new, relaxed notion of strategyproofness for studying the incentive properties of non-strategyproof assignment mechanisms. Informally, a mechanism is partially strategyproof if it makes truthful reporting a dominant strategy for those agents whose preference intensities differ sufficiently between any two objects. We demonstrate that partial strategyproofness is axiomatically motivated and yields a parametric measure for "how strategyproof" an assignment mechanism is. We apply this new concept to derive novel insights about the incentive properties of the probabilistic serial mechanism and different variants of the Boston mechanism. △ Less

Submitted 2 August, 2020; v1 submitted 15 January, 2014; originally announced January 2014.

Comments: Working Paper

Hybrid Mechanisms: Trading off Strategyproofness and Efficiency of Random Assignment Mechanisms

Authors: Timo Mennle, Sven Seuken

Abstract: Severe impossibility results restrict the design of strategyproof random assignment mechanisms, and trade-offs are necessary when aiming for more demanding efficiency requirements, such as ordinal or rank efficiency. We introduce hybrid mechanisms, which are convex combinations of two component mechanisms. We give a set of conditions under which such hybrids facilitate a non-degenerate trade-off b… ▽ More Severe impossibility results restrict the design of strategyproof random assignment mechanisms, and trade-offs are necessary when aiming for more demanding efficiency requirements, such as ordinal or rank efficiency. We introduce hybrid mechanisms, which are convex combinations of two component mechanisms. We give a set of conditions under which such hybrids facilitate a non-degenerate trade-off between strategyproofness (in terms of partial strategyproofness) and efficiency (in terms of dominance). This set of conditions is tight in the sense that trade-offs may become degenerate if any of the conditions are dropped. Moreover, we give an algorithm for the mechanism designer's problem of determining a maximal mixing factor. Finally, we prove that our construction can be applied to mix Random Serial Dictatorship with Probabilistic Serial, as well as with the adaptive Boston mechanism, and we illustrate the efficiency gains numerically. △ Less

Submitted 10 July, 2017; v1 submitted 11 March, 2013; originally announced March 2013.

Comments: Working Paper

Improved Memory-Bounded Dynamic Programming for Decentralized POMDPs

Authors: Sven Seuken, Shlomo Zilberstein

Abstract: Memory-Bounded Dynamic Programming (MBDP) has proved extremely effective in solving decentralized POMDPs with large horizons. We generalize the algorithm and improve its scalability by reducing the complexity with respect to the number of observations from exponential to polynomial. We derive error bounds on solution quality with respect to this new approximation and analyze the convergence behavi… ▽ More Memory-Bounded Dynamic Programming (MBDP) has proved extremely effective in solving decentralized POMDPs with large horizons. We generalize the algorithm and improve its scalability by reducing the complexity with respect to the number of observations from exponential to polynomial. We derive error bounds on solution quality with respect to this new approximation and analyze the convergence behavior. To evaluate the effectiveness of the improvements, we introduce a new, larger benchmark problem. Experimental results show that despite the high complexity of decentralized POMDPs, scalable solution techniques such as MBDP perform surprisingly well. △ Less

Submitted 20 June, 2012; originally announced June 2012.

Comments: Appears in Proceedings of the Twenty-Third Conference on Uncertainty in Artificial Intelligence (UAI2007)

Report number: UAI-P-2007-PG-344-351