article

Video editing with pen-based technology

Authors:

Nuno CorreiaAuthors Info & Claims

Multimedia Tools and Applications, Volume 76, Issue 5

Pages 6889 - 6914

https://doi.org/10.1007/s11042-016-3329-y

Published: 01 March 2017 Publication History

Abstract

The manipulation of video content is still a difficult task due to its complexity and richness. This paper applies pen-based technology to video editing, with the goal to improve such interaction. In this research, digital ink is replaced by video content, aiming to provide a more familiar and creative interaction for video editing and to study how pen gestures can be used on this context as well as what kind of changes are needed in the interface. The concept was implemented in a Tablet PC prototype and evaluated by expert and non-expert users. The user feedback shows that this approach proved to be natural and at the same time to foster user creativity as measured by the Creative Support Index.

References

[1]

Benedek J, Miner T (2002) Measuring desirability: new methods for evaluating desirability in a usability lab setting. In: Proceedings of UPA usability professional association conference. Microsoft Corporation

[2]

Cabral D, Correia N (2009) Pen-based video annotations: a proposal and a prototype for tablet pcs. In: Proceedings of the 12th IFIP TC13 Human-computer interaction international conference, part II, vol 5727. Springer, Berlin, pp 17---20

Digital Library

[3]

Cabral D, Valente JG, Arago U, Fernandes C, Correia N (2012) Evaluation of a multimodal video annotator for contemporary dance. In: Proceedings of the 11th international working conference on advanced visual interfaces, AVI'12. ACM, New York, pp 572---579

Digital Library

[4]

Carroll EA, Latulipe C, Fung R, Terry M (2009) Creativity factor evaluation: towards a standardized survey metric for creativity support. In: Proceedings of the seventh ACM conference on creativity and cognition, C&C '09. ACM, New York, pp 127---136, (to appear in print).

Digital Library

[5]

Casares J, Long AC, Myers BA, Bhatnagar R, Stevens SM, Dabbish L, Yocum D, Corbett A (2002) Simplifying video editing using metadata. In: Proceedings of the 4th conference on designing interactive systems, DIS '02. ACM, New York, pp 157---166, (to appear in print).

Digital Library

[6]

Chandler G (2012) Cut by cut: editing your film or video, 2nd edn. Michael Wiese Produtions, Studio City

[7]

Cherry E, Latulipe C (2014) Quantifying the creativity support of digital tools through the creativity support index. ACM Trans Comput-Hum Interact 21 (4):21:1---21:25.

Digital Library

[8]

Dancyger K (2011) The technique of film and video editing: history, theory, and practice, 5th edn. Focal Press

[9]

Davis M (2003) Editing out video editing. MultiMedia IEEE 10(2):54---64.

Digital Library

[10]

Diakopoulos N, Essa I (2006) Videotater: an approach for pen-based digital video segmentation and tagging. In: Proceedings of the 19th annual ACM symposium on User interface software and technology, UIST '06. ACM, New York, pp 221---224, (to appear in print).

Digital Library

[11]

Girgensohn A, Boreczky J, Chiu P, Doherty J, Foote J, Golovchinsky G, Uchihashi S, Wilcox L (2000) A semi-automatic approach to home video editing. In: Proceedings of the 13th annual ACM symposium on user interface software and technology, UIST '00. ACM, New York, pp 81---89, (to appear in print).

Digital Library

[12]

Goldman DB, Curless B, Salesin D, Seitz SM (2006) Schematic storyboarding for video visualization and editing. ACM Trans Graph 25(3):862---871.

Digital Library

[13]

Goldman DR (2007) A framework for video annotation, visualization, and interaction. Ph.D. thesis, University of Washington

Digital Library

[14]

Hinckley K, Chen XA, Benko H (2013) Motion and context sensing techniques for pen computing. In: Proceedings of the 2013 graphics interface conference, GI '13. http://dl.acm.org/citation.cfm?id=2532129.2532143. Canadian Information Processing Society, Toronto, pp 71---78

Digital Library

[15]

Hinckley K, Yatani K, Pahud M, Coddington N, Rodenhouse J, Wilson A, Benko H, Buxton B (2010) Pen + touch = new tools. In: Proceedings of the 23nd annual ACM symposium on user interface software and technology, UIST '10. ACM, New York, pp 27---36, (to appear in print).

Digital Library

[16]

Hürst W, Götz G (2008) Interface designs for pen-based mobile video browsing. In: Proceedings of the 7th ACM conference on designing interactive systems, DIS '08. ACM, New York, pp 395---404, (to appear in print).

Digital Library

[17]

Jokela T, Mäkelä K, Karukka M (2007) Empirical observations on video editing in the mobile context. In: Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology, Mobility '07. ACM, New York, pp 482---489, (to appear in print).

Digital Library

[18]

Lienhart R (1999) Abstracting home video automatically. In: Proceedings of the seventh ACM international conference on multimedia (Part 2), MULTIMEDIA '99. ACM, New York, pp 37---40, (to appear in print).

Digital Library

[19]

Liu S, Guimbretière F (2012) Flexaura: a flexible near-surface range sensor. In: Proceedings of the 25th annual ACM symposium on user interface software and technology, UIST '12. ACM, New York, pp 327---330, (to appear in print).

Digital Library

[20]

Mackay W, Pagani D (1994) Video mosaic: laying out time in a physical space. In: Proceedings of the second ACM international conference on multimedia, MULTIMEDIA '94. ACM, New York, pp 165---172, (to appear in print).

Digital Library

[21]

Mackay WE, Davenport G (1989) Virtual video editing in interactive multimedia applications. Commun ACM 32(7):802---810.

Digital Library

[22]

Marshall CC (2010) Reading and writing the electronic book. Morgan and Claypool Publishers

Digital Library

[23]

Martin T (2012) Interactive quadruped animation. Master's thesis, University of, California, Santa Barbara

[24]

Meyer A (1995) Pen computing: a technology overview and a vision. ACM SIGCHI Bull 27(3):46---90.

Digital Library

[25]

Nakanishi Y, Ishii Y, Koike H, Oka K, Sato Y (2004) Enhancedmovie: movie editing on an augmented desk as a large-sized display. In: Adjunct proceedings of the 17th annual ACM symposium on user interface software and technology, UIST Adjunct Proceedings '04. ACM. UIST ARCHIVE

[26]

Potel MJ, Sayre RE (1976) Interacting with the galatea film analysis system. ACM SIGGRAPH Comput Graph 10(2):52---59.

Digital Library

[27]

Ramos G, Balakrishnan R (2003) Fluid interaction techniques for the control and annotation of digital video. In: Proceedings of the 16th annual ACM symposium on user interface software and technology, UIST '03. ACM, New York, pp 105---114, (to appear in print).

Digital Library

[28]

Ramos G, Balakrishnan R (2005) Zliding: fluid zooming and sliding for high precision parameter manipulation. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, UIST '05. ACM, New York, pp 143---152, (to appear in print).

Digital Library

[29]

Ramos G, Boulos M, Balakrishnan R (2004) Pressure widgets. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI '04. ACM, New York, pp 487---494, (to appear in print).

Digital Library

[30]

Reiffel L (1971) Superimposed dynamic television display system, us patent 3617630

[31]

Rubine D (1991) Specifying gestures by example. ACM SIGGRAPH Comput Graph 25(4):329---337.

Digital Library

[32]

Ryokai K, Marti S, Ishii H (2004) I/o brush: drawing with everyday objects as ink. In: Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '04. ACM, New York, pp 303---310, (to appear in print).

Digital Library

[33]

Silva J, Cabral D, Fernandes C, Correia N (2012) Real-time annotation of video objects on tablet computers. In: Proceedings of the 11th international conference on mobile and ubiquitous multimedia, MUM '12. ACM, New York, pp 19:1---19:9, (to appear in print).

Digital Library

[34]

Song H, Benko H, Guimbretiere F, Izadi S, Cao X, Hinckley K (2011) Grips and gestures on a multi-touch pen. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI '11. ACM, New York, pp 1323---1332, (to appear in print).

Digital Library

[35]

Thompson R, Bowen CJ (2009) Grammar of the edit, 2nd edn. Focal Press, Burlington

[36]

Vaucelle C, Africano D, Davenport G, Wiberg M, Fjellstrom O (2005) Moving pictures: looking out/looking in. In: ACM SIGGRAPH 2005 educators program, SIGGRAPH '05. ACM, New York, pp 27:1---27:7, (to appear in print).

Digital Library

[37]

Vaucelle C, Davenport G (2004) A system to compose movies for cross-cultural storytelling: textable movie. In: Proceedings of the second international conference on technologies for interactive digital storytelling and entertainment, lecture notes in computer science, TIDSE 2004. Springer-Verlag, Berlin, pp 126---131

[38]

Viviani C, Baptiste M, Gili JA, Logette L, Sauvaget D et al (2011) Dictionnaire mondial du Cinèma. Larousse, Paris

[39]

Vogel D, Balakrishnan R (2010) Direct pen interaction with a conventional graphical user interface. Human-Comput Interact 25(4):324---388.

[40]

Weda H, Campanella M (2007) Use study on a home video editing system. In: Proceedings of the 21st British HCI group annual conference on people and computers: HCI...but not as we know it - volume 2, BCS-HCI '07. http://dl.acm.org/citation.cfm?id=1531407.1531439. British Computer Society, Swinton, pp 123---126

Digital Library

[41]

Weher K, Poon A (1994) Marquee: a tool for real-time video logging. In: Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, CHI '94. ACM, New York, pp 58---64, (to appear in print).

Digital Library

[42]

Yeo BL, Yeung MM (1997) Retrieving and visualizing video. Commun ACM 40(12):43---52.

Digital Library

[43]

Zigelbaum J, Horn MS, Shaer O, Jacob RJK (2007) The tangible video editor: collaborative video editing with active tokens. In: Proceedings of the 1st international conference on tangible and embedded interaction, TEI '07. ACM, New York, pp 43---46, (to appear in print).

Digital Library

Cited By

Tilekbay BYang SLewkowicz MSuryapranata AKim J(2024)ExpressEdit: Video Editing with Natural Language and SketchingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645164(515-536)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645164
Hu XHuang YLiu BWu RHu YQuigley AFan MYu CShi Y(2023)SmartRecorder: An IMU-based Video Tutorial Creation by Demonstration System for Smartphone Interaction TasksProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584069(278-293)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584069
Cabral D(2022)Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen TiltProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3570598(285-287)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3570598
Show More Cited By

Video editing with pen-based technology
1. Human-centered computing

Recommendations

Videoink: a pen-based approach for video editing
UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

Due the growth of video sharing, its manipulation is important, however still a hard task. In order to improve it, this work proposes a pen-based approach, called VideoInk. The concept exploits the painting metaphor, replacing digital ink with video ...
Pen + Mid-Air: An Exploration of Mid-Air Gestures to Complement Pen Input on Tablets
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

In this paper, we report on a series of studies, exploring the potential of pen and mid-air input on tablets. We describe a field study with an early prototype of a drawing application and follow-up inquiries, such as the development and comparison of ...
Technology and Digital Art: Creating video art with evolutionary algorithms

The boundaries of art are subjective, but the impetus for art is often associated with creativity, regarded with wonder and admiration along human history. Most interesting activities and their products are a result of creativity. The main goal of our ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 76, Issue 5

March 2017

1428 pages

ISSN:1380-7501

Issue’s Table of Contents

Copyright © Copyright © 2017 Springer Science+Business Media New York.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 March 2017

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tilekbay BYang SLewkowicz MSuryapranata AKim J(2024)ExpressEdit: Video Editing with Natural Language and SketchingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645164(515-536)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645164
Hu XHuang YLiu BWu RHu YQuigley AFan MYu CShi Y(2023)SmartRecorder: An IMU-based Video Tutorial Creation by Demonstration System for Smartphone Interaction TasksProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584069(278-293)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584069
Cabral D(2022)Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen TiltProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3570598(285-287)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3570598
Rodrigues RNeves Madeira RCorreia N(2021)Studying Natural User Interfaces for Smart Video Annotation towards Ubiquitous EnvironmentsProceedings of the 20th International Conference on Mobile and Ubiquitous Multimedia10.1145/3490632.3490672(158-168)Online publication date: 5-Dec-2021
https://dl.acm.org/doi/10.1145/3490632.3490672
Cabral DRamos MCampos PJorge JFerreira AMarquardt NChevalier F(2020)Applying Pen Pressure, Tilt and Touch Interactions to Data VisualizationsCompanion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces10.1145/3380867.3426198(57-60)Online publication date: 8-Nov-2020
https://dl.acm.org/doi/10.1145/3380867.3426198

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents