Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Decentralized Dynamic Scheduling of TCPS Flows and a Simulator for Time-sensitive Networking

Published: 14 November 2022 Publication History

Abstract

Cybersickness and control-loop instabilities are two main concerns in Tactile Cyber-Physical Systems (TCPS). TCPS applications demand stringent bounds on end-to-end latencies to avoid their occurrences. Traditional best-effort networks cannot guarantee packet latencies in the presence of external traffic. However, emerging deterministic networks such as IEEE 802.1 Time-Sensitive Networking (TSN) can isolate time-critical flows from external traffic using IEEE 802.1Qbv Time-Aware Shaper (TAS) to guarantee bounded end-to-end packet latencies. In this work, we develop eDDSCH-TSN, a decentralized dynamic scheduling protocol to configure non-overlapping gate slots in TAS-enabled TSN switches to support TCPS flows. eDDSCH-TSN supports plug-and-play operation of compatible TCPS terminals with guaranteed minimal end-to-end packet latencies. Compared to the state-of-the-art, eDDSCH-TSN provides three orders lower end-to-end packet latencies for TCPS flows in mid-size networks with 10 hops between source and destination terminals. Further, we also present PYTSN, an open-source discrete-event TSN simulator that we use for evaluating eDDSCH-TSN. In particular, we use PYTSN to show the isolation of TCPS flows from external traffic and plug-and-play operation of TCPS terminals.
Appendix

A PYTSN: A TSN Network Simulator

We use Python and Simpy [32] to create PYTSN, a discrete event network simulator for TSN. PYTSN supports simulation models for the most-common TSN network components such as (i) TSN switch with support for TAS and eDDSCH-TSN, (ii) ST and BE terminals, and (iii) network link. The simulation models expose several configure options for users to modify and simulate different network scenarios. In this section, we describe the high-level architecture of PYTSN’s switch component. For the architecture and the Simpy design of all other supported components in PYTSN, refer to Reference [21] and PYTSN’s source code in Section 6.
Figure 22 shows the architecture of the TSN switch that supports eDDSCH-TSN. The design supports four ports: Port-A (P\(_A\)), Port-B (P\(_B\)), Port-C (P\(_C\)), and Port-D (P\(_D\)). Ports are built for general purpose usage and can be configured to support ST traffic. Only ports configured to support ST traffic can directly connect to an ST-Terminal and send data and beacons of eDDSCH-TSN. Each port consists of a packet receiving block (Rx) and a packet transmitting block (Tx).
Fig. 22.
Fig. 22. Architecture of PYTSN’s TSN switch that supports eDDSCH-TSN. Each port of the switch can be connected to either a BE or ST terminal or the port of a different switch using a full-duplex network link.
If Rx receives a data packet, then it is sent to the Switch Fabric (SF). SF routes these packets from one port to another. To decide which port to route the packet, SF looks up the switch forwarding table using the incoming packet’s destination-ID. In the current version of the TSN switch, the forwarding table entries are preset during component initialization. If Rx receives a control packet, i.e., registration request and response of eDDSCH-TSN, then it forwards the packet to the Port Control Logic (PCL) for further action.
Figure 23 shows the architecture of Tx. SF uses it to transmit data packets and PCL uses it to transmit control packets. Tx consists of a packet demultiplexer (dmux), six gated TAS queues, and a priority transmitter. The current version of Tx has four queues (\(q_1\) to \(q_4\)) to support ST flows, one queue (\(q_{be}\)) to support BE flows, and one network management queue (\(q_{nm}\)), to support registration request/response packets and beacon packets. The block dmux uses the flow-id and the port through which it has received an incoming packet to route it to the associated queue. Every ST terminal embeds a unique flow-id (\(\gt \!0\)) in the packets it sends. All BE terminals embed a flow-id of \(-1\) in their packets. Control packets such as the registration, deregistration, and beacons use a flow-id of 0. If the received packets’ flow-id is \(-1\), then dmux routes the packets to \(q_{be}\). If it is 0, then the packets are routed to \(q_{nm}\). The block dmux uses the metadata field, prt-rcv, in the packets for routing ST packets having flow-id \(\gt \!0\) to queues. When Rx receives a packet, it creates a metadata field, prt-rcv, to identify the receiving port. The block dmux routes an ST packet it receives to \(q_1\), \(q_2\), \(q_3\), or \(q_4\), if prt-rcv of the packet corresponds to P\(_A\), P\(_B\), P\(_C\), or P\(_D\), respectively. Packets in the queue are transmitted when the gate of that queue is opened. Tx receives these gate control events from PCL through \(in\_gc\). The priority transmitter reads packets from the open queues and prioritizes their transmission using the packet’s priority field if more than one queue is open at the same time.
Fig. 23.
Fig. 23. Architecture of Tx block in Figure 22.
Although Tx in Figure 23 appears to have a simple architecture, building its discrete event simulation model is non-trivial. First, we need to ensure that data is transferred from queues to the Simpy store resources (\(i_i\): \(i_{nm}\), \(i_{be}\), \(i_1,\ldots i_4\)) at the priority transmitter.s input when there is no pending data waiting for transmission. In our work, we use an interrupt mechanism; each time after transmitting data, the priority transmitter will generate an event noted by the Simpy process (transfer-process) that transfers data from the queue to the priority transmitter’s input-side store resources. A similar problem exists when the priority transmitter tries to read data from its input-side Simpy store resources, but no packets are available. Here, too, we implement an interrupt mechanism. Whenever packets are transferred to the Simpy store resources (\(i_i\): \(i_{nm}\), \(i_{be}\), \(i_1,\ldots i_4\)) or when there is a change in the gate control, an event is generated, which the packet transmitter waits to read packets.
The PCL’s residing in the switch ports (see Figure 22) generates gate control events to open and close gates of queues in Tx. For generating these gate control events, it uses the GCL it receives from the Switch Control Logic (SCL) at the start of every CT. Further, PCL is responsible for (i) transferring registration requests/responses received by Rx to SCL, (ii) transmitting the registration messages received from SCL to other switches in the network via Tx, and (iii) generating and transmitting both configuration and data beacon to the connected ST terminal. PCL infers the timings to generate and send the beacons from the GCL it receives from SCL.
SCL (see Figure 22) controls and coordinates the functioning of eDDSCH-TSN. It continuously updates GCL of the ports from the registration response messages it receives. It sends these updated GCL to the switch ports’ PCL blocks at the start of every CT. During the registration phase of TCPS terminals, SCL is also responsible for forwarding the registration requests and responses it receives to other connected switches in the network.

References

[1]
Daniël Van Den Berg, Rebecca Glans, Dorian De Koning, Fernando A. Kuipers, Jochem Lugtenburg, Kurian Polachan, Prabhakar T. Venkata, Chandramani Singh, Belma Turkovic, and Bryan Van Wijk. 2017. Challenges in haptic communications over the tactile internet. IEEE Access 5 (2017), 23502–23518.
[2]
ITU. 2014. The Tactile Internet. (2014). Retrieved from https://www.itu.int/en/ITU-T/techwatch/Pages/tactile-internet.aspx.
[3]
Konstantinos Antonakoglou, Xiao Xu, Eckehard Steinbach, Toktam Mahmoodi, and Mischa Dohler. 2018. Toward haptic communications over the 5G tactile Internet. IEEE Commun. Surv. Tutor. 20, 4 (2018), 3034–3059.
[4]
Kurian Polachan, T. V. Prabhakar, Chandramani Singh, and Deepak Panchapakesan. 2019. Quality of control assessment for tactile cyber-physical systems. In Proceedings of the 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). 1–9. DOI:
[5]
Joseph J. LaViola, Jr.2000. A discussion of cybersickness in virtual environments. SIGCHI Bull. 32, 1 (2000), 10.
[6]
Adnan Aijaz, Zaher Dawy, Nikolaos Pappas, Meryem Simsek, Sharief Oteafy, and Oliver Holland. 2018. Toward a Tactile Internet Reference Architecture: Vision and Progress of the IEEE P1918.1 Standard. (2018). arxiv:cs.NI/1807.11915.
[7]
Kurian Polachan. 2021. Tactile Cyber-physical Systems: A Testbed, A Performance Metric and Network Resource Allocation Protocols. Ph.D. Dissertation. Indian Institute of Science, Bangalore.
[8]
Shree Krishna Sharma, Isaac Woungang, Alagan Anpalagan, and Symeon Chatzinotas. 2020. Toward tactile internet in beyond 5G era: Recent advances, current issues, and future directions. IEEE Access 8 (2020), 56948–56991.
[9]
Joachim Sachs, Lars A. A. Andersson, José Araújo, Calin Curescu, Johan Lundsjö, Göran Rune, Eckehard Steinbach, and Gustav Wikström. 2018. Adaptive 5G low-latency communication for tactile internet services. Proc. IEEE 107, 2 (2018), 325–349.
[10]
K. S. Kim, D. K. Kim, C. Chae, S. Choi, Y. Ko, J. Kim, Y. Lim, M. Yang, S. Kim, B. Lim, K. Lee, and K. L. Ryu. 2019. Ultrareliable and low-latency communication techniques for tactile internet services. Proc. IEEE 107, 2 (2019), 376–393.
[11]
A. Nasrallah, A. S. Thyagaturu, Z. Alharbi, C. Wang, X. Shao, M. Reisslein, and H. ElBakoury. 2019. Ultra-Low latency (ULL) networks: The IEEE TSN and IETF DetNet standards and related 5G ULL research. IEEE Commun. Surv. Tutor. 21, 1 (2019).
[12]
N. Finn. 2018. Introduction to time-sensitive networking. IEEE Commun. Stand. Mag. 2, 2 (2018), 22–28.
[13]
IEEE Standards Association et al. 2016. IEEE standard for local and metropolitan area networks—bridges and bridged networks—amendment 25: Enhancements for scheduled traffic. IEEE Std 802.1Qbv-2015 (Amendment to IEEE Std 802.1Q-2014 as amended by IEEE Std 802.1Qca-2015, IEEE Std 802.1Qcd-2015, and IEEE Std 802.1Q-2014/Cor 1-2015) (2016), 1–57. Retreival 10th January 2021.
[14]
Ahmed Nasrallah, Venkatraman Balasubramanian, Akhilesh Thyagaturu, Martin Reisslein, and Hesham ElBakoury. 2019. Reconfiguration Algorithms for High Precision Communications in Time-sensitive Networks: Time-Aware Shaper Configuration with IEEE 802.1Qcc (Extended Version). (2019). arxiv:cs.NI/1906.11596.
[15]
W. Steiner, S. S. Craciunas, and R. S. Oliver. 2018. Traffic planning for time-sensitive communication. IEEE Commun. Stand. Mag. 2, 2 (2018), 42–47.
[16]
Aellison Cassimiro T. dos Santos, Ben Schneider, and Vivek Nigam. 2019. TSNSCHED: Automated schedule generation for time sensitive networking. In Proceedings of the Formal Methods in Computer Aided Design Conference (FMCAD). IEEE, 69–77.
[17]
Silviu S. Craciunas, Ramon Serna Oliver, Martin Chmelík, and Wilfried Steiner. 2016. Scheduling real-time communication in IEEE 802.1 Qbv time-sensitive networks. In Proceedings of the 24th International Conference on Real-Time Networks and Systems. 183–192.
[18]
Silviu S. Craciunas, Ramon Serna Oliver, and Wilfried Steiner. 2018. Demo abstract: Slate XNS–An online management tool for deterministic TSN networks. In Proceedings of the IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS). IEEE, 103–104.
[19]
A. Nasrallah, V. Balasubramanian, A. Thyagaturu, M. Reisslein, and H. ElBakoury. 2019. Reconfiguration algorithms for high precision communications in time-sensitive networks. In Proceedings of the IEEE Globecom Workshops (GC Wkshps). 1–6.
[20]
René Hummen, Stephan Kehrer, and Oliver Kleineberg. 2016. TSN–Time-sensitive networking. Hirschmann, USA, WP00027 (2016).
[21]
K. Polachan, Chandramani Singh, and T. V. Prabhakar. 2021. Decentralized dynamic gate scheduling of IEEE 802.1Qbv time aware shaper and a TSN simulator for tactile cyber-physical systems. In Proceedings of the 17th IFIP/IEEE International Symposium on Integrated Network Management. Retreival 10th January 2021.
[22]
Junhui Jiang, Yuting Li, Seung Ho Hong, Aidong Xu, and Kai Wang. 2018. A time-sensitive networking (TSN) simulation model based on OMNET++. In Proceedings of the IEEE International Conference on Mechatronics and Automation (ICMA). IEEE, 643–648.
[23]
Peter Heise, Fabien Geyer, and Roman Obermaisser. 2016. TSimNet: An industrial time-sensitive networking simulation framework based on OMNeT++. In Proceedings of the 8th IFIP International Conference on New Technologies, Mobility and Security (NTMS). IEEE, 1–5.
[24]
Maryam Pahlevan and Roman Obermaisser. 2018. Evaluation of time-triggered traffic in time-sensitive networks using the OPNET simulation framework. In Proceedings of the 26th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP). IEEE, 283–287.
[25]
J. Falk, D. Hellmanns, B. Carabelli, N. Nayak, F. Dürr, S. Kehrer, and K. Rothermel. 2019. NeSTiNg: Simulating IEEE time-sensitive networking (TSN) in OMNeT++. In Proceedings of the International Conference on Networked Systems (NetSys). 1–8.
[26]
OMNeT++ Discrete Event Simulator. Retrieved from https://omnetpp.org/. (????).
[27]
NS-3. 2018. NS-3 Consortium. (2018). Retrieved from https://www.nsnam.org.
[28]
IEEE Standards Association et al. 2020. IEEE standard for local and metropolitan area networks—timing and synchronization for time-sensitive applications in bridged local area networks. IEEE Std 802 (2020).
[29]
Kevin B. Stanton. 2018. Distributing deterministic, accurate time for tightly coordinated network and software applications: IEEE 802.1 AS, the TSN profile of PTP. IEEE Commun. Stand. Mag. 2, 2 (2018), 34–40.
[30]
memory-profiler. (????). Retrieved 10th January 2021 from https://pypi.org/project/memory-profiler/.
[31]
G. S. Guthart and J. K. Salisbury. 2000. The intuitive/sup TM/ telesurgery system: Overview and application. In Proceedings of the IEEE International Conference on Robotics and Automation.618–621. DOI:
[32]
Simpy. 2020. Simpy-Discrete event simulation for Python. (2020). Retrieved from simpy.rtfd.org.

Cited By

View all
  • (2022)Assessing Quality of Control in Tactile Cyber–Physical SystemsIEEE Transactions on Network and Service Management10.1109/TNSM.2022.316410019:4(5348-5365)Online publication date: Dec-2022

Index Terms

  1. Decentralized Dynamic Scheduling of TCPS Flows and a Simulator for Time-sensitive Networking

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Internet Technology
    ACM Transactions on Internet Technology  Volume 22, Issue 4
    November 2022
    642 pages
    ISSN:1533-5399
    EISSN:1557-6051
    DOI:10.1145/3561988
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 November 2022
    Online AM: 03 February 2022
    Accepted: 09 November 2021
    Revised: 30 September 2021
    Received: 14 March 2021
    Published in TOIT Volume 22, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Time-sensitive networking
    2. Time-Aware Shaper
    3. tactile internet
    4. Tactile Cyber-Physical Systems
    5. network simulator

    Qualifiers

    • Research-article
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)181
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 14 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Assessing Quality of Control in Tactile Cyber–Physical SystemsIEEE Transactions on Network and Service Management10.1109/TNSM.2022.316410019:4(5348-5365)Online publication date: Dec-2022

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media