Article

Universal synchronization scheme for distributed audio-video capture on heterogeneous computing platforms

Authors:

Rainer Lienhart,

Igor Kozintsev,

Stefan WehrAuthors Info & Claims

MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia

Pages 263 - 266

https://doi.org/10.1145/957013.957067

Published: 02 November 2003 Publication History

Get Access

Abstract

We propose a universal synchronization scheme for distributed audio-video capture on heterogeneous computing devices such as laptops, tablets, PDAs, cellular phones, audio recorders, and camcorders. These devices typically possess sensors such as microphones and possibly cameras. In order to combine them wirelessly into a distributed sensing and computing system, it is necessary to provide relative time synchronization among the distributed sensors. In this work we propose a setup and an algorithm that provide synchronization between sampling times for a network of distributed multi-channel audio sensors connected to general purpose computing (GPC) platforms. Extensive experimental results on distributed acoustic Blind Source Separation (BSS) algorithms validate the performance of our synchronization scheme.

References

[1]

Jeremy Elson, Lewis Girod, and Deborah Estrin. Fine-Grained Network Time Synchronization using Reference Broadcasts. 5th Symposium on OS Design and Implementation, Boston, MA, Dec. 2002.

Digital Library

Google Scholar

[2]

F.M. Gardner. Interpolation in Digital Modems - Part I: Fundamentals, IEEE Transactions on Communications, Vol. 41, No. 3, pp. 501--507, March 1993.

Crossref

Google Scholar

[3]

L. Lamport, P.M. Melliar-Smith. Synchronizing Clocks in the Presence of Faults. JACM, Vol. 32, No. 1, pp. 52--78, 1985.

Digital Library

Google Scholar

[4]

D. Mills. Internet time synchronization: the network time protocol. IEEE Transactions on Communications, Vol. 39, No. 10, pp. 1482--1493, Oct 1991.

Crossref

Google Scholar

[5]

R. Lienhart, I. Kozintsev, S. Wehr, M. Yeung. On The Importance of Exact Synchronization for Distributed Audio Signal Processing. ICASSP2003, Apr. 2003.

Google Scholar

[6]

M. Mock, R. Frings, E. Nett, S. Trikaliotis. Clock synchronization for wireless local area networks. IEEE 12th Euromicro Conf. on Real-Time Systems, pp. 183 --189, 2000.

Digital Library

Google Scholar

[7]

L. Parra, C. Spence: On-line Blind Source Separation of Non-Stationary Signals, J. of VLSI Signal Processing, vol. 26, no. 1/2, pp. 39--46, Aug. 2000.

Digital Library

Google Scholar

[8]

D. D. Rife, J. Vanderkooy: Transfer-Function Measurement with Maximum-Length Sequences. J. Audio Eng. Soc., vol. 37, no. 6, Jun. 1989.

Google Scholar

[9]

GPS Timing Data & Information -- http://tycho.usno.navy.mil/ gps_datafiles.html

Google Scholar

Cited By

View all

Fagá RMaximino FFurtado BMartins JCattelan RPimentel MTrinta FPorfírio PGoularte RPontin de Mattos Fortes R(2009)A context information structure using peer-to-peer networks with the TV usersProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858491(1-8)Online publication date: 5-Oct-2009
https://dl.acm.org/doi/10.1145/1858477.1858491
Lichtenauer JValstar MShen JPantic M(2009)Cost-Effective Solution to Synchronized Audio-Visual Capture Using Multiple SensorsProceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance10.1109/AVSS.2009.92(324-329)Online publication date: 2-Sep-2009
https://dl.acm.org/doi/10.1109/AVSS.2009.92
Lienhart RKozintsev IBudnikov DChikalov IRaykar V(2005)Providing Common Time and Space in Distributed AV-Sensor Networks by Self-CalibrationIntelligent Multimedia Processing with Soft Computing10.1007/3-540-32367-8_21(453-473)Online publication date: 2005
https://doi.org/10.1007/3-540-32367-8_21
Show More Cited By

Index Terms

Universal synchronization scheme for distributed audio-video capture on heterogeneous computing platforms
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Synchronization of multi-camera video recordings based on audio
MM '07: Proceedings of the 15th ACM international conference on Multimedia

An increasing number of people regularly capture video in social occasions like weddings, parties and holiday trips. As a result, multiple video recordings are made from a single event providing different view angles and wider coverage. This gives an ...
Distributed audio synchronization scheme using audio endpoint inWASNs
WOWMOM '11: Proceedings of the 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks

In Wireless Audio Sensor Networks (WASNs), many applications such as target tracking, data fusion and localization, often require precise synchronization among audio streams. Extensive researches have been done under the assumption that wireless channel ...
Adaptive Audio Synchronization Scheme Based on Feedback Loop with Local Clock in Wireless Audio Sensor Networks
ICPADS '10: Proceedings of the 2010 IEEE 16th International Conference on Parallel and Distributed Systems

Wireless Audio Sensor Networks (WASNs) can provide event detection, object tracking and emergency response through cooperative audio sensor nodes. Effective collaboration of audio sensors requires precise synchronization among audio streams. Some ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia

November 2003

670 pages

ISBN:1581137222

DOI:10.1145/957013

General Chairs:
Lawrence Rowe
University of California, Berkeley
,
Harrick Vin
University of Texas, Austin
,
Program Chairs:
Thomas Plagemann
University of Oslo
,
Prashant Shenoy
University of Massachusetts, Amherst
,
John R. Smith
IBM T.J. Watson Research Center

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM03

Sponsor:

MM03: 2003 11th Annual ACM International Conference on Multimedia

November 2 - 8, 2003

CA, Berkeley, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
510
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Fagá RMaximino FFurtado BMartins JCattelan RPimentel MTrinta FPorfírio PGoularte RPontin de Mattos Fortes R(2009)A context information structure using peer-to-peer networks with the TV usersProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858491(1-8)Online publication date: 5-Oct-2009
https://dl.acm.org/doi/10.1145/1858477.1858491
Lichtenauer JValstar MShen JPantic M(2009)Cost-Effective Solution to Synchronized Audio-Visual Capture Using Multiple SensorsProceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance10.1109/AVSS.2009.92(324-329)Online publication date: 2-Sep-2009
https://dl.acm.org/doi/10.1109/AVSS.2009.92
Lienhart RKozintsev IBudnikov DChikalov IRaykar V(2005)Providing Common Time and Space in Distributed AV-Sensor Networks by Self-CalibrationIntelligent Multimedia Processing with Soft Computing10.1007/3-540-32367-8_21(453-473)Online publication date: 2005
https://doi.org/10.1007/3-540-32367-8_21
Wehr SKozintsev ILienhart RKellermann W(2004)Synchronization of Acoustic Sensors for Distributed Ad-Hoc Audio Networks and its Use for Blind Source SeparationIEEE Sixth International Symposium on Multimedia Software Engineering10.1109/MMSE.2004.79(18-25)Online publication date: 2004
https://doi.org/10.1109/MMSE.2004.79

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Synchronization of multi-camera video recordings based on audio

Distributed audio synchronization scheme using audio endpoint inWASNs

Adaptive Audio Synchronization Scheme Based on Feedback Loop with Local Clock in Wireless Audio Sensor Networks