No abstract available.
Cited By
- Liu Y and Zhang D (2024). Intraconsumer Price Discrimination with Credit Refund Policies, Management Science, 70:10, (6835-6851), Online publication date: 1-Oct-2024.
- Kalør A and Popovski P (2023). Timely Monitoring of Dynamic Sources With Observations From Multiple Wireless Sensors, IEEE/ACM Transactions on Networking, 31:3, (1263-1276), Online publication date: 1-Jun-2023.
- Clarkson J, Lin K and Glazebrook K (2023). A Classical Search Game in Discrete Locations, Mathematics of Operations Research, 48:2, (687-707), Online publication date: 1-May-2023.
- Wang J, Wang X and Zhang L (2023). Stochastic Regularized Newton Methods for Nonlinear Equations, Journal of Scientific Computing, 94:3, Online publication date: 1-Mar-2023.
- Santamaria S (2022). Portfolio Entrepreneurs’ Behavior and Performance, Management Science, 68:1, (333-354), Online publication date: 1-Jan-2022.
- Yoo O and McCardle K (2020). The Valuator’s Curse, Decision Analysis, 17:4, (299-313), Online publication date: 1-Dec-2020.
- Zenkevich N, Sokolov Y and Fattakhova M (2020). Game-Theoretic Modeling of the Project Management Contract, Automation and Remote Control, 81:11, (2094-2107), Online publication date: 1-Nov-2020.
- Zhang R, Cheng P, Chen Z, Li Y and Vucetic B (2019). A Learning-Based Two-Stage Spectrum Sharing Strategy With Multiple Primary Transmit Power Levels, IEEE Transactions on Signal Processing, 67:18, (4899-4914), Online publication date: 15-Sep-2019.
- Sun Y and Zhang D (2019). A Model of Customer Reward Programs with Finite Expiration Terms, Management Science, 65:8, (3889-3903), Online publication date: 1-Aug-2019.
- Li Y, Courcoubetis C and Duan L Recommending Paths: Follow or Not Follow? IEEE INFOCOM 2019 - IEEE Conference on Computer Communications, (928-936)
- Jansen N, Junges S, Katoen J, Quatmann T, Becker B, Wimmer R and Winterer L Correct-by-construction policies for POMDPs Proceedings of the Fifth International Workshop on Symbolic-Numeric methods for Reasoning about CPS and IoT, (6-8)
- Winterer L, Junges S, Wimmer R, Jansen N, Topcu U, Katoen J and Becker B Motion planning under partial observability using game-based abstraction 2017 IEEE 56th Annual Conference on Decision and Control (CDC), (2201-2208)
- Parizi M and Ghate A Lot-sizing in sequential auctions while learning bid and demand distributions Proceedings of the 2016 Winter Simulation Conference, (895-906)
- Skutella M, Sviridenko M and Uetz M (2016). Unrelated Machine Scheduling with Stochastic Processing Times, Mathematics of Operations Research, 41:3, (851-864), Online publication date: 1-Aug-2016.
- Salemi Parizi M and Ghate A (2019). Multi-class, multi-resource advance scheduling with no-shows, cancellations and overbooking, Computers and Operations Research, 67:C, (90-101), Online publication date: 1-Mar-2016.
- Sudderth W (2016). Finitely Additive Dynamic Programming, Mathematics of Operations Research, 41:1, (92-108), Online publication date: 1-Feb-2016.
- Montúfar G, Ay N and Ghazi-Zahedi K (2015). Geometry and expressive power of conditional restricted Boltzmann machines, The Journal of Machine Learning Research, 16:1, (2405-2436), Online publication date: 1-Jan-2015.
- Uc-Cetina V (2013). A novel reinforcement learning architecture for continuous state and action spaces, Advances in Artificial Intelligence, 2013, (7-7), Online publication date: 1-Jan-2013.
- Frazier P Optimization via simulation with Bayesian statistics and dynamic programming Proceedings of the Winter Simulation Conference, (1-16)
- Gocgun Y and Ghate A (2012). Lagrangian relaxation and constraint generation for allocation and advanced scheduling, Computers and Operations Research, 39:10, (2323-2336), Online publication date: 1-Oct-2012.
- Kolomvatsos K, Anagnostopoulos C and Hadjiefthymiades S (2012). A Fuzzy Logic System for Bargaining in Information Markets, ACM Transactions on Intelligent Systems and Technology (TIST), 3:2, (1-26), Online publication date: 1-Feb-2012.
- Lee D, Mo J, Walrand J and Park J A token pricing scheme for internet services Proceedings of the 7th international conference on Internet charging and QoS technologies: economics of converged, internet-based networks, (26-37)
- Koutsopoulos I and Tassiulas L Control and optimization meet the smart power grid Proceedings of the 2nd International Conference on Energy-Efficient Computing and Networking, (41-50)
- Gocgun Y and Ghate A A Lagrangian approach to dynamic resource allocation Proceedings of the Winter Simulation Conference, (3330-3340)
- Al-Zubaidy H, Lambadaris I and Talim J (2010). Optimal scheduling in high-speed downlink packet access networks, ACM Transactions on Modeling and Computer Simulation, 21:1, (1-27), Online publication date: 1-Dec-2010.
- Akuiyibo E and Boyd S (2010). Adaptive modulation with smoothed flow utility, EURASIP Journal on Wireless Communications and Networking, 2010, (1-9), Online publication date: 1-Apr-2010.
- Ngo M and Krishnamurthy V (2019). Monotonicity of constrained optimal transmission policies in correlated fading channels with ARQ, IEEE Transactions on Signal Processing, 58:1, (438-451), Online publication date: 1-Jan-2010.
- Mutlu H, Alanyali M and Starobinski D (2009). Spot pricing of secondary spectrum access in wireless cellular networks, IEEE/ACM Transactions on Networking (TON), 17:6, (1794-1804), Online publication date: 1-Dec-2009.
- Krishnamurthy V and Wahlberg B (2009). Partially Observed Markov Decision Process Multiarmed Bandits---Structural Results, Mathematics of Operations Research, 34:2, (287-302), Online publication date: 1-May-2009.
- Xu D and Liu X Opportunistic spectrum access in cognitive radio networks Proceedings of the 4th Annual International Conference on Wireless Internet, (1-6)
- Bhadra S, Lu Y and Squillante M (2007). Optimal capacity planning in stochastic loss networks with time-varying workloads, ACM SIGMETRICS Performance Evaluation Review, 35:1, (227-238), Online publication date: 12-Jun-2007.
- Bhadra S, Lu Y and Squillante M Optimal capacity planning in stochastic loss networks with time-varying workloads Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, (227-238)
- Rossi M and Zorzi M (2007). Integrated Cost-Based MAC and Routing Techniques for Hop Count Forwarding in Wireless Sensor Networks, IEEE Transactions on Mobile Computing, 6:4, (434-448), Online publication date: 1-Apr-2007.
- Cheevaprawatdomrong T, Schochetman I, Smith R and Garcia A (2007). Solution and Forecast Horizons for Infinite-Horizon Nonhomogeneous Markov Decision Processes, Mathematics of Operations Research, 32:1, (51-72), Online publication date: 1-Feb-2007.
- Jonker J, Piersma N and Potharst R (2006). A decision support system for direct mailing decisions, Decision Support Systems, 42:2, (915-925), Online publication date: 1-Nov-2006.
- Palmer J and Mitrani I (2005). Optimal and heuristic policies for dynamic server allocation, Journal of Parallel and Distributed Computing, 65:10, (1204-1211), Online publication date: 1-Oct-2005.
- Ermiş E and Saligrama V Adaptive statistical sampling methods for decentralized estimation and detection of localized phenomena Proceedings of the 4th international symposium on Information processing in sensor networks, (19-es)
- Abeni L, Cucinotta T, Lipari G, Marzario L and Palopoli L (2018). QoS Management Through Adaptive Reservations, Real-Time Systems, 29:2-3, (131-155), Online publication date: 1-Mar-2005.
- Psounis K, Zhu A, Prabhakar B and Motwani R (2004). Modeling correlations in web traces and implications for designing replacement policies, Computer Networks: The International Journal of Computer and Telecommunications Networking, 45:4, (379-398), Online publication date: 15-Jul-2004.
- Koole G and Nain P (2019). An Explicit Solution for the Value Function of a Priority Queue, Queueing Systems: Theory and Applications, 47:3, (251-282), Online publication date: 1-Jul-2004.
- Barto A and Mahadevan S (2019). Recent Advances in Hierarchical Reinforcement Learning, Discrete Event Dynamic Systems, 13:4, (341-379), Online publication date: 1-Oct-2003.
- Barto A and Mahadevan S (2019). Recent Advances in Hierarchical Reinforcement Learning, Discrete Event Dynamic Systems, 13:1-2, (41-77), Online publication date: 1-Jan-2003.
- Talim J, Liu Z, Nain P and Coffman E (2001). Controlling the robots of Web search engines, ACM SIGMETRICS Performance Evaluation Review, 29:1, (236-244), Online publication date: 1-Jun-2001.
- Talim J, Liu Z, Nain P and Coffman E Controlling the robots of Web search engines Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, (236-244)
- Bertsekas D and Castanon D (2019). Rollout Algorithms for Stochastic Scheduling Problems, Journal of Heuristics, 5:1, (89-108), Online publication date: 1-Apr-1999.
- Liu C and Wellman M Using qualitative relationships for bounding probability distributions Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence, (346-353)
- Kim E and Van Oyen M (2019). Dynamic scheduling to minimize lost sales subject to set-up costs, Queueing Systems: Theory and Applications, 29:2/4, (193-229), Online publication date: 15-May-1998.
- Cao X (2019). The Relations Among Potentials, Perturbation Analysis,and Markov Decision Processes, Discrete Event Dynamic Systems, 8:1, (71-87), Online publication date: 1-Mar-1998.
- Samaratunga C, Sethi S and Zhou X (1997). Computational Evaluation of Hierarchical Production Control Policies for Stochastic Manufacturing Systems, Operations Research, 45:2, (258-274), Online publication date: 1-Apr-1997.
- (1996). Recursive Utility for Stochastic Trees, Operations Research, 44:5, (788-809), Online publication date: 1-Oct-1996.
- Bitran G and Mondschein S (1996). Mailing Decisions in the Catalog Sales Industry, Management Science, 42:9, (1364-1381), Online publication date: 1-Sep-1996.
- Tseng K and Hsiao M (1995). Optimal Control of Arrivals to Token Ring Networks with Exhaustive Service Discipline, Operations Research, 43:1, (89-101), Online publication date: 1-Feb-1995.
- Schwartz D (2019). ATM scheduling with queuing delay predictions, ACM SIGCOMM Computer Communication Review, 23:4, (205-211), Online publication date: 1-Oct-1993.
- Schwartz D ATM scheduling with queuing delay predictions Conference proceedings on Communications architectures, protocols and applications, (205-211)
- Altman E and Nain P (1992). Closed-loop control with delayed information, ACM SIGMETRICS Performance Evaluation Review, 20:1, (193-204), Online publication date: 1-Jun-1992.
- Altman E and Nain P Closed-loop control with delayed information Proceedings of the 1992 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, (193-204)
- De Serres Y (1991). Simultaneous optimization of flow control and scheduling in a single server queue with two job classes, Operations Research Letters, 10:2, (103-112), Online publication date: 1-Mar-1991.
- Sennott L (1989). Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded Costs, Operations Research, 37:4, (626-633), Online publication date: 1-Aug-1989.
- Fine C and Porteus E (1989). Dynamic Process Improvement, Operations Research, 37:4, (580-591), Online publication date: 1-Aug-1989.
- (1989). A Resource Allocation Problem in a Random Environment, Operations Research, 37:2, (329-338), Online publication date: 1-Apr-1989.
- Danzig P (2019). Finite buffers for fast multicast, ACM SIGMETRICS Performance Evaluation Review, 17:1, (108-117), Online publication date: 1-Apr-1989.
- Danzig P Finite buffers for fast multicast Proceedings of the 1989 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, (108-117)
- Kumar P (1985). A Survey of Some Results in Stochastic Adaptive Control, SIAM Journal on Control and Optimization, 23:3, (329-380), Online publication date: 1-May-1985.
Recommendations
Constrained Undiscounted Stochastic Dynamic Programming
In this paper we investigate the computation of optimal policies in constrained discrete stochastic dynamic programming with the average reward as utility function. The state-space and action-sets are assumed to be finite. Constraints which are linear ...
Stochastic Dynamic Programming with Non-linear Discounting
AbstractIn this paper, we study a Markov decision process with a non-linear discount function and with a Borel state space. We define a recursive discounted utility, which resembles non-additive utility functions considered in a number of models in ...
Persistently Optimal Policies in Stochastic Dynamic Programming with Generalized Discounting
In this paper we study a Markov decision process with a nonlinear discount function. First, we define a utility on the space of trajectories of the process in the finite and infinite time horizon and then take their expected values. It turns out that ...