A distributed decision-making structure for dynamic resource allocation using nonlinear functional approximations

Huseyin Topaloglu, Warren Buckler Powell

Research output: Contribution to journalArticle

29 Citations (Scopus)

Abstract

This paper proposes a distributed solution approach to a certain class of dynamic resource allocation problems and develops a dynamic programming-based multiagent decision-making, learning, and communication mechanism. In the class of dynamic resource allocation problems we consider, a set of reusable resources of different types has to be assigned to tasks that arrive randomly over time. The assignment of a resource to a task removes the task from the system, modifies the state of the resource, and generates a contribution. We build a decision-making scheme where the decisions regarding the resources in different sets of states are made by different agents. We explain how to coordinate the actions of different agents using nonlinear functional approximations, and show that in a distributed setting, nonlinear approximations produce sequences of min-cost network flow problems that naturally yield integer solutions. We also experimentally compare the performances of the centralized and distributed solution strategies.

Original languageEnglish (US)
Pages (from-to)281-297
Number of pages17
JournalOperations Research
Volume53
Issue number2
DOIs
StatePublished - Mar 1 2005

Fingerprint

Resource allocation
Decision making
Dynamic programming
Communication
Resources
Distributed decision making
Approximation
Costs
Allocation problem

All Science Journal Classification (ASJC) codes

  • Management Science and Operations Research

Cite this

@article{23f5ab9007e144919bdba8e32b3b00c3,
title = "A distributed decision-making structure for dynamic resource allocation using nonlinear functional approximations",
abstract = "This paper proposes a distributed solution approach to a certain class of dynamic resource allocation problems and develops a dynamic programming-based multiagent decision-making, learning, and communication mechanism. In the class of dynamic resource allocation problems we consider, a set of reusable resources of different types has to be assigned to tasks that arrive randomly over time. The assignment of a resource to a task removes the task from the system, modifies the state of the resource, and generates a contribution. We build a decision-making scheme where the decisions regarding the resources in different sets of states are made by different agents. We explain how to coordinate the actions of different agents using nonlinear functional approximations, and show that in a distributed setting, nonlinear approximations produce sequences of min-cost network flow problems that naturally yield integer solutions. We also experimentally compare the performances of the centralized and distributed solution strategies.",
author = "Huseyin Topaloglu and Powell, {Warren Buckler}",
year = "2005",
month = "3",
day = "1",
doi = "https://doi.org/10.1287/opre.1040.0166",
language = "English (US)",
volume = "53",
pages = "281--297",
journal = "Operations Research",
issn = "0030-364X",
publisher = "INFORMS Inst.for Operations Res.and the Management Sciences",
number = "2",

}

A distributed decision-making structure for dynamic resource allocation using nonlinear functional approximations. / Topaloglu, Huseyin; Powell, Warren Buckler.

In: Operations Research, Vol. 53, No. 2, 01.03.2005, p. 281-297.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A distributed decision-making structure for dynamic resource allocation using nonlinear functional approximations

AU - Topaloglu, Huseyin

AU - Powell, Warren Buckler

PY - 2005/3/1

Y1 - 2005/3/1

N2 - This paper proposes a distributed solution approach to a certain class of dynamic resource allocation problems and develops a dynamic programming-based multiagent decision-making, learning, and communication mechanism. In the class of dynamic resource allocation problems we consider, a set of reusable resources of different types has to be assigned to tasks that arrive randomly over time. The assignment of a resource to a task removes the task from the system, modifies the state of the resource, and generates a contribution. We build a decision-making scheme where the decisions regarding the resources in different sets of states are made by different agents. We explain how to coordinate the actions of different agents using nonlinear functional approximations, and show that in a distributed setting, nonlinear approximations produce sequences of min-cost network flow problems that naturally yield integer solutions. We also experimentally compare the performances of the centralized and distributed solution strategies.

AB - This paper proposes a distributed solution approach to a certain class of dynamic resource allocation problems and develops a dynamic programming-based multiagent decision-making, learning, and communication mechanism. In the class of dynamic resource allocation problems we consider, a set of reusable resources of different types has to be assigned to tasks that arrive randomly over time. The assignment of a resource to a task removes the task from the system, modifies the state of the resource, and generates a contribution. We build a decision-making scheme where the decisions regarding the resources in different sets of states are made by different agents. We explain how to coordinate the actions of different agents using nonlinear functional approximations, and show that in a distributed setting, nonlinear approximations produce sequences of min-cost network flow problems that naturally yield integer solutions. We also experimentally compare the performances of the centralized and distributed solution strategies.

UR - http://www.scopus.com/inward/record.url?scp=18744397562&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=18744397562&partnerID=8YFLogxK

U2 - https://doi.org/10.1287/opre.1040.0166

DO - https://doi.org/10.1287/opre.1040.0166

M3 - Article

VL - 53

SP - 281

EP - 297

JO - Operations Research

JF - Operations Research

SN - 0030-364X

IS - 2

ER -