research-article

Learning-Aided Optimization for Energy-Harvesting Devices With Outdated State Information

Authors:

Michael J. NeelyAuthors Info & Claims

IEEE/ACM Transactions on Networking (TON), Volume 27, Issue 4

Pages 1501 - 1514

https://doi.org/10.1109/TNET.2019.2926403

Published: 01 August 2019 Publication History

Abstract

This paper considers utility optimal power control for energy-harvesting wireless devices with a finite capacity battery. The distribution information of the underlying wireless environment and harvestable energy is unknown, and only outdated system state information is known at the device controller. This scenario shares similarity with Lyapunov opportunistic optimization and online learning but is different from both. By a novel combination of Zinkevich’s online gradient learning technique and the drift-plus-penalty technique from Lyapunov opportunistic optimization, this paper proposes a learning-aided algorithm that achieves utility within $O\epsilon$ of the optimal, for any desired $\epsilon >0$, by using a battery with an $O1/\epsilon$ capacity. The proposed algorithm has low complexity and makes power investment decisions based on system history, without requiring knowledge of the system state or its probability distribution.

References

[1]

H. Yu and M. J. Neely, "Learning aided optimization for energy harvesting devices with outdated state information," in Proc. IEEE Conf. Comput. Commun., Apr. 2018, pp. 1853-1861.

[2]

J. A. Paradiso and T. Starner, "Energy scavenging for mobile and wireless electronics," IEEE Pervasive Comput., vol. 4, no. 1, pp. 18-27, Jan./Mar. 2005.

Digital Library

[3]

S. Sudevalayam and P. Kulkarni, "Energy harvesting sensor nodes: Survey and implications," IEEE Commun. Surveys Tuts., vol. 13, no. 3, pp. 443-461, 3rd Quart., 2011.

[4]

S. Ulukus et al., "Energy harvesting wireless communications: A review of recent advances," IEEE J. Sel. Areas Commun., vol. 33, no. 3, pp. 360-381, Mar. 2015.

Digital Library

[5]

A. Kansal, J. Hsu, S. Zahedi, and M. B. Srivastava, "Power management in energy harvesting sensor networks," ACM Trans. Embedded Comput. Syst., vol. 6, no. 4, p. 32, Sep. 2007.

Digital Library

[6]

P. Kamalinejad et al., "Wireless energy harvesting for the Internet of Things," IEEE Commun. Mag., vol. 53, no. 6, pp. 102-108, Jun. 2015.

Digital Library

[7]

E. Hossain and M. Hasan, "5G cellular: Key enabling technologies and research challenges," IEEE Instrum. Meas. Mag., vol. 18, no. 3, pp. 11-21, Jun. 2015.

[8]

J. Yang and S. Ulukus, "Optimal packet scheduling in an energy harvesting communication system," IEEE Trans. Commun., vol. 60, no. 1, pp. 220-230, Jan. 2012.

[9]

K. Tutuncuoglu and A. Yener, "Optimum transmission policies for battery limited energy harvesting nodes," IEEE Trans. Wireless Commun., vol. 11, no. 3, pp. 1180-1189, Mar. 2012.

[10]

P. Blasco, D. Gunduz, and M. Dohler, "A learning theoretic approach to energy harvesting communication system optimization," IEEE Trans. Wireless Commun., vol. 12, no. 4, pp. 1872-1882, Apr. 2013.

[11]

N. Michelusi, K. Stamatiou, and M. Zorzi, "Transmission policies for energy harvesting sensors with time-correlated energy supply," IEEE Trans. Commun., vol. 61, no. 7, pp. 2988-3001, Jul. 2013.

[12]

D. Shaviv and A. Özgür, "Universally near optimal online power control for energy harvesting nodes," IEEE J. Sel. Areas Commun., vol. 34, no. 12, pp. 3620-3631, Dec. 2016.

Digital Library

[13]

W. Wu, J. Wang, X. Wang, F. Shan, and J. Luo, "Online throughput maximization for energy harvesting communication systems with battery overflow," IEEE Trans. Mobile Comput., vol. 16, no. 1, pp. 185-197, Jan. 2017.

Digital Library

[14]

A. Arafa, A. Baknina, and S. Ulukus, "Energy harvesting networks with general utility functions: Near optimal online policies," in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Jun. 2017, pp. 809-813.

[15]

M. Gatzianas, L. Georgiadis, and L. Tassiulas, "Control of wireless networks with rechargeable batteries," IEEE Trans. Commun., vol. 9, no. 2, pp. 581-593, Feb. 2010.

Digital Library

[16]

L. Huang and M. J. Neely, "Utility optimal scheduling in energy-harvesting networks," IEEE/ACM Trans. Netw., vol. 21, no. 4, pp. 1117-1130, Aug. 2013.

Digital Library

[17]

R. Urgaonkar, B. Urgaonkar, M. J. Neely, and A. Sivasubramaniam, "Optimal power cost management using stored energy in data centers," in Proc. ACM SIGMETRICS Joint Int. Conf. Meas. Modeling Comput. Syst., Jun. 2011, pp. 221-232.

Digital Library

[18]

M. Zinkevich, "Online convex programming and generalized infinitesimal gradient ascent," in Proc. 20th Int. Conf. Int. Conf. Mach. Learn., Aug. 2003, pp. 928-935.

Digital Library

[19]

N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games. Cambridge, U.K.: Cambridge, Univ. Press, 2006.

Digital Library

[20]

S. Shalev-Shwartz, "Online learning and online convex optimization," Found. Trends Mach. Learn., vol. 4, no. 2, pp. 107-194, 2012.

Digital Library

[21]

M. Mahdavi, R. Jin, and T. Yang, "Trading regret for efficiency: Online convex optimization with long term constraints," J. Mach. Learn. Res., vol. 13, no. 1, pp. 2503-2528, 2012.

Digital Library

[22]

R. Jenatton, J. C. Huang, and C. Archambeau, "Adaptive algorithms for online convex optimization with long-term constraints," in Proc. 33rd Int. Conf. Int. Conf. Mach. Learn., Jun. 2016, pp. 402-411.

Digital Library

[23]

H. Yu and M. J. Neely, "A low complexity algorithm with O(?T) regret and finite constraint violations for online convex optimization with long term constraints," Oct. 2016, arXiv:1604.02218. [Online]. Available: https://arxiv.org/abs/1604.02218.

[24]

M. J. Neely and H. Yu, "Online convex optimization with time-varying constraints," Feb. 2017, arXiv:1702.04783. [Online]. Available: https://arxiv.org/abs/1702.04783.

[25]

H. Yu, M. J. Neely, and X. Wei, "Online convex optimization with stochastic constraints," in Proc. 31st Int. Conf. Neural Inf. Process. Syst., 2017, pp. 1427-1437.

Digital Library

[26]

M. J. Neely. Stochastic Network Optimization With Application to Communication and Queueing Systems. San Rafael, CA, USA: Morgan & Claypool, 2010.

Digital Library

[27]

R. Srivastava and C. E. Koksal, "Basic performance limits and tradeoffs in energy-harvesting sensor nodes with finite data and energy storage," IEEE/ACM Trans. Netw., vol. 21, no. 4, pp. 1049-1062, Aug. 2013.

Digital Library

[28]

H. Yu and M. J. Neely, "A new backpressure algorithm for joint rate control and routing with vanishing utility optimality gaps and finite queue lengths," in Proc. IEEE Conf. Comput. Commun., May 2017, pp. 1-9.

[29]

L. Tassiulas and A. Ephremides, "Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks," IEEE Trans. Autom. Control, vol. 37, no. 12, pp. 1936-1948, Dec. 1992.

[30]

M. J. Neely, E. Modiano, and C. E. Rohrs, "Dynamic power allocation and routing for time-varying wireless networks," IEEE J. Sel. Areas Commun., vol. 23, no. 1, pp. 89-103, Jan. 2005.

[31]

A. Eryilmaz and R. Srikant, "Joint congestion control, routing, and MAC for stability and fairness in wireless networks," IEEE J. Sel. Areas Commun., vol. 24, no. 8, pp. 1514-1524, Aug. 2006.

Digital Library

[32]

A. L. Stolyar, "Maximizing queueing network utility subject to stability: Greedy primal-dual algorithm," Queueing Syst., vol. 50, no. 4, pp. 401-457, 2005.

Digital Library

[33]

M. J. Neely, E. Modiano, and C.-P. Li, "Fairness and optimal stochastic control for heterogeneous networks," IEEE/ACM Trans. Netw., vol. 16, no. 2, pp. 396-409, Apr. 2008.

Digital Library

[34]

E. Hazan, A. Agarwal, and S. Kale, "Logarithmic regret algorithms for online convex optimization," Mach. Learn., vol. 69, nos. 2-3, pp. 169-192, 2007.

Digital Library

[35]

H. Yu and M. J. Neely, "A simple parallel algorithm with an O(1/t) convergence rate for general convex programs," SIAM J. Optim., vol. 27, no. 2, pp. 759-783, 2017.

Digital Library

[36]

S. Mannor, J. N. Tsitsiklis, and J. Y. Yu, "Online learning with sample path constraints," J. Mach. Learn. Res., vol. 10, pp. 569-590, Mar. 2009.

Digital Library

Cited By

Yang JLi PIslam MRen S(2024)Online Allocation with Replenishable Budgets: Worst Case and BeyondProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36390308:1(1-34)Online publication date: 21-Feb-2024
https://dl.acm.org/doi/10.1145/3639030
Yang JRen SWilliams BChen YNeville J(2023)Learning-assisted algorithm unrolling for online optimization with budget constraintsProceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v37i9.26278(10771-10779)Online publication date: 7-Feb-2023
https://dl.acm.org/doi/10.1609/aaai.v37i9.26278
Guo HWei HLiu XYing LKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)Online convex optimization with hard constraintsProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602909(36426-36439)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602909
Show More Cited By

Learning-Aided Optimization for Energy-Harvesting Devices With Outdated State Information
1. Networks
  1. Network types

Recommendations

Learning Aided Optimization for Energy Harvesting Devices with Outdated State Information
IEEE INFOCOM 2018 - IEEE Conference on Computer Communications
This paper considers utility optimal power control for energy harvesting wireless devices with a finite capacity battery. The distribution information of the underlying wireless environment and harvestable energy is unknown and only outdated system state ...
Networking Low-Power Energy Harvesting Devices: Measurements and Algorithms

Recent advances in energy harvesting materials and ultra-low-power communications will soon enable the realization of networks composed of energy harvesting devices. These devices will operate using very low ambient energy, such as energy harvested from ...
A Reconfigurable Energy Storage Architecture for Energy-harvesting Devices
ASPLOS '18

Battery-free, energy-harvesting devices operate using energy collected exclusively from their environment. Energy-harvesting devices allow maintenance-free deployment in extreme environments, but requires a power system to provide the right amount of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE/ACM Transactions on Networking

IEEE/ACM Transactions on Networking Volume 27, Issue 4

August 2019

479 pages

ISSN:1063-6692

Issue’s Table of Contents

Copyright © 2019.

Publisher

IEEE Press

Publication History

Published: 01 August 2019

Published in TON Volume 27, Issue 4

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
55
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yang JLi PIslam MRen S(2024)Online Allocation with Replenishable Budgets: Worst Case and BeyondProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36390308:1(1-34)Online publication date: 21-Feb-2024
https://dl.acm.org/doi/10.1145/3639030
Yang JRen SWilliams BChen YNeville J(2023)Learning-assisted algorithm unrolling for online optimization with budget constraintsProceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v37i9.26278(10771-10779)Online publication date: 7-Feb-2023
https://dl.acm.org/doi/10.1609/aaai.v37i9.26278
Guo HWei HLiu XYing LKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)Online convex optimization with hard constraintsProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602909(36426-36439)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602909
Asgari KNeely M(2022)Bregman-style Online Convex Optimization with Energy Harvesting ConstraintsACM SIGMETRICS Performance Evaluation Review10.1145/3543516.345627049:1(75-76)Online publication date: 7-Jun-2022
https://dl.acm.org/doi/10.1145/3543516.3456270
Chen YWang JZhang QGao FSong J(2022)Online Optimizing Multi-user Interference Network Utility with Unknown CSI under Budget Constraint2022 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC51071.2022.9771704(1623-1628)Online publication date: 10-Apr-2022
https://dl.acm.org/doi/10.1109/WCNC51071.2022.9771704
Guo JZhang X(2022)Online Power Control and Optimization for Energy Harvesting Communication System Based on State of ChargeWireless Personal Communications: An International Journal10.1007/s11277-021-09098-4122:4(3513-3527)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1007/s11277-021-09098-4
Asgari KNeely MHuang LGandhi AKiyavash NWang J(2021)Bregman-style Online Convex Optimization with Energy Harvesting ConstraintsAbstract Proceedings of the 2021 ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems10.1145/3410220.3456270(75-76)Online publication date: 31-May-2021
https://dl.acm.org/doi/10.1145/3410220.3456270
Asgari KNeely M(2020)Bregman-style Online Convex Optimization with EnergyHarvesting ConstraintsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/34283374:3(1-25)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1145/3428337

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents