Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Machine learning based state observer for discrete time systems evolving on Lie groups

Published: 01 January 2025 Publication History

Abstract

In this paper, a machine learning based observer for systems evolving on manifolds is designed such that the state of the observer is restricted to the Lie group on which the system evolves. Designing machine learning based observers for systems evolving on Lie groups using charts would require training a machine learning based observer for each chart of the Lie group, and switching between the trained models based on the state of the system. We propose a novel deep learning based technique whose predictions are restricted to certain measure 0 subsets of the Euclidean space without using charts. Using this network, we design an observer ensuring that the state of the observer is restricted to the Lie group, and predicting the state using only one trained algorithm. The deep learning network predicts an error term on the Lie algebra of the Lie group, uses the map from the Lie algebra to the group, the group operation, and the present state to estimate the state at the next epoch. This approach, being purely data driven, does not require a model of the system. The proposed algorithm provides a novel framework for constraining the output of machine learning networks to certain measure 0 subsets of a Euclidean space without training on each specific chart and without requiring switching. We show the validity of this method using Monte Carlo simulations performed of the rigid body rotation and translation system.

References

[1]
Ansel J., Yang E., He H., Gimelshein N., Jain A., Voznesensky M., Bao B., Bell P., Berard D., Burovski E., Chauhan G., Chourdia A., Constable W., Desmaison A., DeVito Z., Ellison E., Feng W., Gong J., Gschwind M., Hirsh B., Huang S., Kalambarkar K., Kirsch L., Lazos M., Lezcano M., Liang Y., Liang J., Lu Y., Luk C.K., Maher B., Pan Y., Puhrsch C., Reso M., Saroufim M., Siraichi M.Y., Suk H., Suo M., Tillet P., Wang E., Wang X., Wen W., Zhang S., Zhao X., Zhou K., Zou R., Mathews A., Chanan G., Wu P., Chintala S., GRU — PyTorch 2.3 documentation, 2024, GRU — PyTorch 2.3 documentation, https://pytorch.org/docs/stable/generated/torch.nn.GRU.html.
[2]
Barbaresco F., Souriau exponential map algorithm for machine learning on matrix Lie groups, in: Nielsen F., Barbaresco F. (Eds.), Geometric Science of Information, in: Lecture Notes in Computer Science, Springer International Publishing, Cham, 2019, pp. 85–95,.
[3]
Barbaresco F., Gaussian distributions on the space of symmetric positive definite matrices from Souriau’s gibbs state for Siegel domains by coadjoint orbit and moment map, Nielsen F., Barbaresco F. (Eds.), Geometric Science of Information, vol. 12829, Springer International Publishing, Cham, 2021, pp. 245–255,.
[4]
Barbaresco F., Gay-Balmaz F., Lie group cohomology and (multi)symplectic integrators: New geometric tools for Lie group machine learning based on souriau geometric statistical mechanics, Entropy 22 (5) (2020) 498,.
[5]
Bishnoi, S., Bhattoo, R., Jayadeva, J., Ranu, S., Krishnan, N.M.A., 2022. Enhancing the Inductive Biases of Graph Neural ODE for Modeling Physical Systems. In: The Eleventh International Conference on Learning Representations.
[6]
Brás S., Izadi M., Silvestre C., Sanyal A., Oliveira P., Nonlinear observer for 3D rigid body motion, in: 52nd IEEE Conference on Decision and Control, CDC, 2013, pp. 2588–2593,.
[7]
Brosowsky M., Keck F., Dünkel O., Zöllner M., Sample-specific output constraints for neural networks, Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, 2021, pp. 6812–6821,.
[8]
Brossard M., Bonnabel S., Condomines J.P., Unscented Kalman filtering on Lie groups, in: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, 2017, pp. 2485–2491,.
[9]
Celledoni E., Leone A., Murari D., Owren B., Learning Hamiltonians of constrained mechanical systems, J. Comput. Appl. Math. 417 (2023),.
[10]
Celledoni E., Marthinsen A., Owren B., Commutator-free Lie group methods, Future Gener. Comput. Syst. 19 (3) (2003) 341–352,.
[11]
Chang D.E., Globally exponentially convergent continuous observers for velocity bias and state for invariant kinematic systems on matrix Lie groups, IEEE Trans. Autom. Control 66 (7) (2021) 3363–3369,.
[12]
Cho K., van Merriënboer B., Gulcehre C., Bahdanau D., Bougares F., Schwenk H., Bengio Y., Learning phrase representations using RNN encoder–decoder for statistical machine translation, in: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP, 2014, pp. 1724–1734,.
[13]
Ding S.X., Yin S., Wang Y., Wang Y., Yang Y., Ni B., Data-driven design of observers and its applications, IFAC Proc. Vol. 44 (1) (2011) 11441–11446,.
[14]
Farrell J.A., Aided Navigation: GPS with High Rate Sensors, McGraw Hill Professional, 2008.
[15]
Finzi M., Wang K.A., Wilson A.G., Simplifying Hamiltonian and Lagrangian neural networks via explicit constraints, Advances in Neural Information Processing Systems, vol. 33, Curran Associates, Inc., 2020, pp. 13880–13889.
[16]
Glorot X., Bengio Y., Understanding the difficulty of training deep feedforward neural networks, in: Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, JMLR Workshop and Conference Proceedings, 2010, pp. 249–256.
[17]
Grunnet-Jepsen A., Harville M., Fulkerson B., Piro D., Brook S., Radford J., Introduction to Intel® RealSense™ Visual SLAM and the T265 Tracking Camera, Intel® RealSense™ Developer Documentation, 2023, https://dev.intelrealsense.com/docs/intel-realsensetm-visual-slam-and-the-t265-tracking-camera.
[18]
He K., Zhang X., Ren S., Sun J., Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification, in: 2015 IEEE International Conference on Computer Vision, ICCV, 2015, pp. 1026–1034,.
[19]
Hendriks J., Jidling C., Wills A., Schön T., Linearly constrained neural networks, 2021,. arXiv:2002.01600.
[20]
Höfer S., Bekris K., Handa A., Gamboa J.C., Mozifian M., Golemo F., Atkeson C., Fox D., Goldberg K., Leonard J., Karen Liu C., Peters J., Song S., Welinder P., White M., Sim2Real in robotics and automation: Applications and challenges, IEEE Trans. Autom. Sci. Eng. 18 (2) (2021) 398–400,.
[21]
Khosravian A., Trumpf J., Mahony R., Lageman C., Observers for invariant systems on Lie groups with biased input measurements and homogeneous outputs, Automatica 55 (2015) 19–26,.
[22]
Koenig N., Howard A., Design and use paradigms for Gazebo, an open-source multi-robot simulator, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), vol. 3, 2004, pp. 2149–2154 vol.3,.
[23]
Lageman C., Trumpf J., Mahony R., Gradient-like observers for invariant dynamics on a Lie group, IEEE Trans. Autom. Control 55 (2) (2010) 367–377,.
[24]
Lee J.M., Introduction to smooth manifolds, Graduate Texts in Mathematics, vol. 218, Springer New York, New York, NY, 2012,.
[25]
Levinson J., Esteves C., Chen K., Snavely N., Kanazawa A., Rostamizadeh A., Makadia A., An analysis of SVD for deep rotation estimation, Advances in Neural Information Processing Systems, vol. 33, Curran Associates, Inc., 2020, pp. 22554–22565.
[26]
Loshchilov, I., Hutter, F., 2018. Decoupled Weight Decay Regularization. In: International Conference on Learning Representations. ICLR.
[27]
Lutter M., Peters J., Combining physics and deep learning to learn continuous-time dynamics models, Int. J. Robot. Res. 42 (3) (2023) 83–107,.
[28]
Mahony R., Hamel T., Pflimlin J.M., Nonlinear complementary filters on the special orthogonal group, IEEE Trans. Autom. Control 53 (5) (2008) 1203–1218,.
[29]
Park J.H., Chang D.E., Unscented Kalman filter with stable embedding for simple, accurate, and computationally efficient state estimation of systems on manifolds in Euclidean space, Internat. J. Robust Nonlinear Control 33 (3) (2023) 1479–1492,.
[30]
Park J.H., Phogat K.S., Kim W., Chang D.E., Transversely stable extended Kalman filters for systems on manifolds in Euclidean spaces, J. Dyn. Syst. Meas. Control 143 (6) (2021),.
[31]
Peralez J., Nadri M., Deep learning-based Luenberger observer design for discrete-time nonlinear systems, in: 2021 60th IEEE Conference on Decision and Control, CDC, 2021, pp. 4370–4375,.
[32]
Phogat K.S., Chang D.E., Invariant extended Kalman filter on matrix Lie groups, Automatica 114 (2020),.
[33]
Pilte M., Barbaresco F., Tracking quality monitoring based on information geometry and geodesic shooting, in: 2016 17th International Radar Symposium, IRS, IEEE, Krakow, Poland, 2016, pp. 1–6,.
[34]
Ramos L.d.C., Di Meglio F., Morgenthaler V., da Silva L.F.F., Bernard P., Numerical design of Luenberger observers for nonlinear systems, in: 2020 59th IEEE Conference on Decision and Control, CDC, 2020, pp. 5435–5442,.
[35]
Shanbhag S., Chang D.E., Globally exponentially convergent observer for the rigid body system on SE(3), in: 2022 IEEE 61st Conference on Decision and Control, CDC, 2022 IEEE 61st Conference on Decision and Control (CDC), 2022, pp. 1257–1262,.
[36]
Vasconcelos J.F., Cunha R., Silvestre C., Oliveira P., A nonlinear position and attitude observer on SE(3) using landmark measurements, Systems Control Lett. 59 (3) (2010) 155–166,.
[37]
Wang M., Tayebi A., Hybrid nonlinear observers for inertial navigation using landmark measurements, IEEE Trans. Autom. Control 65 (12) (2020) 5173–5188,.
[38]
Whitney H., The self-intersections of a smooth n-manifold in 2n-space, Ann. Mat. 45 (2) (1944) 220,. arXiv:1969265.
[39]
Zhong Y.D., Dey B., Chakraborty A., Benchmarking energy-conserving neural networks for learning dynamics from data, in: Proceedings of the 3rd Conference on Learning for Dynamics and Control, PMLR, 2021, pp. 1218–1229.
[40]
Zhou Y., Barnes C., Lu J., Yang J., Li H., On the continuity of rotation representations in neural networks, in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR, 2019, pp. 5738–5746,.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence  Volume 139, Issue PB
Jan 2025
1555 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 January 2025

Author Tags

  1. Observer design
  2. Machine learning
  3. Lie groups

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media