Article

Inter-stream synchronization between haptic media and voice in collaborative virtual environments

Authors:

Yutaka Ishibashi,

Takeshi Kanbara,

Shuji TasakaAuthors Info & Claims

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

Pages 604 - 611

https://doi.org/10.1145/1027527.1027670

Published: 10 October 2004 Publication History

Abstract

This paper addresses an inter-stream synchronization issue between haptic media and voice in networked virtual environments. The paper proposes a media synchronization algorithm for the two types of media stream by enhancing the virtual-time rendering (VTR) algorithm, which the authors previously proposed. The new algorithm employs two types of error range in order to keep high quality of intra-stream synchronization at the expense of slight deterioration in the inter-stream synchronization quality. One is the imperceptible range of inter-stream synchronization error, and the other is the allowable range of the error. If the error is beyond the allowable range, the algorithm tries to reduce the error gradually until the error becomes within the imperceptible range. Otherwise, it accepts the error. By carrying out an experiment in which two users do collaborative work with haptic media and voice in a virtual space, we demonstrate the effectiveness of the algorithm quantitatively.

References

[1]

M. A. Srinivasan and C. Basdogan, "Haptics in virtual environments: Taxonomy, research status, and challenges," Computers and Graphics, vol. 21, no. 4, pp. 393--404, Apr. 1997.]]

[2]

G. Blakowski and R. Steinmetz, "A media synchronization survey: Reference model, specification, and case studies," IEEE J. Sel. Areas in Commun., vol. 14, no. 1, pp. 5--35, Jan. 1996.]]

Digital Library

[3]

K. Hikichi, H. Morino, Y. Yasuda, I. Arimoto, and K. Sezaki, "The evaluation of adaptive control for haptics collaboration over the Internet," in Proc. the 16th International Workshop on Communications Quality & Reliability (CQR'02), pp. 218--222, May 2002 (also Conf. Rec. IEEE GLOBECOM'02, Nov. 2002).]]

[4]

Y. Ishibashi, S. Tasaka, and T. Hasegawa, "The virtual-time rendering algorithm for haptic media synchronization in networked virtual environments," in Proc. the 16th International Workshop on Communications Quality & Reliability (CQR'02), pp. 213--217, May 2002.]]

[5]

I. Elhajj, N. Xi, B. Song, M.-M. Yu, W. T. Lo, and Y. H. Liu, "Transparency and synchronization in supermedia enhanced Internet-based teleoperation," in Proc. the 2002 IEEE International Conference on Robotics & Automation, pp. 2713--2718, May 2002.]]

[6]

Y. Ishibashi and S. Tasaka, "A synchronization mechanism for continuous media in multimedia communications," in Proc. IEEE INFOCOM'95, pp. 1010--1019, Apr. 1995.]]

Digital Library

[7]

Y. Ishibashi, T. Hasegawa, and S. Tasaka, "Group synchronization control for haptic media in networked virtual environments," in Proc. the 12th IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (Haptics'04), pp. 106--113, Mar. 2004.]]

Digital Library

[8]

T. Harada, S. Ohno, and M. Sato, "The influence of multimodal sensory information display on dribbling of a basketball in a virtual workspace," in Proc. the 4th International Conference on Virtual Systems and Multimedia, vol. 2, pp. 548--553, 1998.]]

[9]

D. E. DiFranco, G. L. Beauregard, and M. A. Srinivasan, "The effect of auditory cues on the haptic perception of stiffness in virtual environments," in Proc. the ASME Dynamic Systems and Control Division, vol. 61, pp. 17--22, 1997.]]

[10]

S. Matsumoto, I. Fukuda, H. Morino, K. Hikichi, K. Sezaki, and Y. Yasuda, "The influences of network issues on haptic collaboration in shared virtual environments," in Proc. the Fifth PHANToM Users Group Workshop, Oct. 2000.]]

[11]

ITU-T Recommendation G.114, "Transmission systems and media, general characteristics of international telephone connections and international telephone circuits: One-way transmission time," Feb. 1996.]]

[12]

J. K. Salisbury and M. A. Srinivasan, "Phantom-based haptic interaction with virtual objects," IEEE Computer Graphics and Applications, vol. 17, no. 5, pp. 6--10, Sep./Oct. 1997.]]

Digital Library

[13]

SensAble Technologies, Inc., "GHOST SDK programmer's guide," Version 3.0, 1999.]]

[14]

Y. Ishibashi, S. Tasaka, and Y. Tachibana, "Media synchronization and causality control for distributed multimedia applications," IEICE Trans. Commun., vol. E84-B, no. 3, pp. 667--677, Mar. 2001.]]

[15]

R. Steinmetz, "Human perception of jitter and media synchronization," IEEE J. Sel. Areas in Commun., vol. 14, no. 1, pp. 61--72, Jan. 1996.]]

Digital Library

[16]

S. Tasaka, T. Nunome, and Y. Ishibashi, "Live media synchronization quality of a retransmission-based error recovery scheme," in Conf. Rec. IEEE ICC'00, pp. 1535--1541, June 2000.]]

[17]

S. Deering, "Host extension for IP multicasting," RFC 1112, Aug. 1989.]]

Digital Library

[18]

Y.-H. Chu, S. G. Rao, and H. Zhang, "A case for end system multicast," in Proc. ACM SIGMETRICS'00, pp. 1--12, June 2000.]]

Digital Library

Cited By

Amedayenou TIshibashi YHuang PTateiwa Y(2022)Human Perception of Ellipsoids for Networked Haptic Virtual EnvironmentsProceedings of the 10th International Conference on Computer and Communications Management10.1145/3556223.3556243(132-138)Online publication date: 29-Jul-2022
https://dl.acm.org/doi/10.1145/3556223.3556243
Ma JIshibashi YHuang PTateiwa YPsannis K(2021)QoE Assessment of Angle Perception with Haptics for Networked Virtual Environments2021 2nd International Conference on Electronics, Communications and Information Technology (CECIT)10.1109/CECIT53797.2021.00156(867-872)Online publication date: Dec-2021
https://doi.org/10.1109/CECIT53797.2021.00156
Lwin HIshibashi YMya K(2020)Influence of Voice Delay on Human Perception of Group Synchronization Error for Remote Learning : One-way Communication Case2020 IEEE Conference on Computer Applications(ICCA)10.1109/ICCA49400.2020.9022835(1-5)Online publication date: Feb-2020
https://doi.org/10.1109/ICCA49400.2020.9022835
Show More Cited By

Index Terms

Inter-stream synchronization between haptic media and voice in collaborative virtual environments

Recommendations

Group synchronization control over haptic media in a networked real-time game with collaborative work
NetGames '06: Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games

This paper deals with group (or inter-destination) synchronization control over haptic media in the case where two groups each of which consists of two players play a networked real-time game in which the two players in each group work with each other ...
Influences of Inter-Stream Synchronization Error on Collaborative Work in Haptic and Visual Environments
HAPTICS '08: Proceedings of the 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems

This paper deals with a haptic media and video transfer system in which users can touch and move a real object located at a remote place by using haptic interface devices while watching video of the object. Making use of the system, the users can do ...
Media synchronization control with prediction in a remote haptic calligraphy system
ACE '07: Proceedings of the international conference on Advances in computer entertainment technology

This paper presents a remote haptic calligraphy systemwhich can control a remote haptic interface device with another haptic interface device. In the system, a teacher can instruct a student at a remote location how to use a calligraphy brush while ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

October 2004

1028 pages

ISBN:1581138938

DOI:10.1145/1027527

General Chairs:
Henning Schulzrinne
Columbia University
,
Nevenka Dimitrova
Philips Research
,
Program Chairs:
Angela Sasse
UCL
,
Sue Moon
KAIST
,
Rainer Lienhart
U Augsburg

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM04

Sponsor:

MM04: 2004 12th Annual ACM International Conference on Multimedia

October 10 - 16, 2004

NY, New York, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
524
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Amedayenou TIshibashi YHuang PTateiwa Y(2022)Human Perception of Ellipsoids for Networked Haptic Virtual EnvironmentsProceedings of the 10th International Conference on Computer and Communications Management10.1145/3556223.3556243(132-138)Online publication date: 29-Jul-2022
https://dl.acm.org/doi/10.1145/3556223.3556243
Ma JIshibashi YHuang PTateiwa YPsannis K(2021)QoE Assessment of Angle Perception with Haptics for Networked Virtual Environments2021 2nd International Conference on Electronics, Communications and Information Technology (CECIT)10.1109/CECIT53797.2021.00156(867-872)Online publication date: Dec-2021
https://doi.org/10.1109/CECIT53797.2021.00156
Lwin HIshibashi YMya K(2020)Influence of Voice Delay on Human Perception of Group Synchronization Error for Remote Learning : One-way Communication Case2020 IEEE Conference on Computer Applications(ICCA)10.1109/ICCA49400.2020.9022835(1-5)Online publication date: Feb-2020
https://doi.org/10.1109/ICCA49400.2020.9022835
Jalal LMurroni M(2020)On the Impact of Single and Multiple Effects on Quality of Experience for Multisensorial TV in Smart Home2020 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB49480.2020.9379734(1-6)Online publication date: 27-Oct-2020
https://doi.org/10.1109/BMSB49480.2020.9379734
Kontogiannis SKokkonis GKazanidis IDossis MValsamidis S(2020)Cultural IoT Framework Focusing on Interactive and Personalized Museum SightseeingTowards Cognitive IoT Networks10.1007/978-3-030-42573-9_10(151-181)Online publication date: 26-Mar-2020
https://doi.org/10.1007/978-3-030-42573-9_10
Lwin HIshibashi YMya K(2019)Human Perception of Group Synchronization Error for Remote Learning: One-way Communication Case2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW)10.1109/ICCE-TW46550.2019.8991984(1-2)Online publication date: May-2019
https://doi.org/10.1109/ICCE-TW46550.2019.8991984
Jalal LMartini MMurroni M(2019)Qoe for Multi-Sensorial Media in Smart Home: Challenges Ahead2019 8th European Workshop on Visual Information Processing (EUVIP)10.1109/EUVIP47703.2019.8946215(76-81)Online publication date: Oct-2019
https://doi.org/10.1109/EUVIP47703.2019.8946215
Sithu MIshibashi Y(2018)Media Synchronization Control in Multimedia CommunicationDigital Multimedia10.4018/978-1-5225-3822-6.ch083(1727-1763)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-3822-6.ch083
Jalal LMurroni MPopescu V(2018)Experimental setup for IoT — Based multi sensorial media2018 Baltic URSI Symposium (URSI)10.23919/URSI.2018.8406735(80-84)Online publication date: May-2018
https://doi.org/10.23919/URSI.2018.8406735
Jalal LAnedda MPopescu VMurroni M(2018)QoE Assessment for IoT-Based Multi Sensorial Media BroadcastingIEEE Transactions on Broadcasting10.1109/TBC.2018.282391464:2(552-560)Online publication date: Jun-2018
https://doi.org/10.1109/TBC.2018.2823914
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents