Cited By
View all- Zhang XBa XHu FYuan J(2024)EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera SwitchingSensors10.3390/s2416540124:16(5401)Online publication date: 21-Aug-2024
Cinemassist: An Intelligent Interactive System for Real-Time Cinematic Composition Design
Authors: 
Rui He, Ying Cao, Johan F. Hoorn, Huaxin WeiAuthors Info & Claims
Article No.: 75, Pages 1 - 7
Abstract
Designing cinematic compositions, which involves moving cameras through a scene, is essential yet challenging in filmmaking. Machinima filmmaking provides a real-time virtual environment for exploring different compositions, but it still requires significant cinematography skills and creativity. To address this, we introduce Cinemassist, a tool that helps users develop camera trajectories in a 3D animation by generating multiple composition proposals for creative exploration. Preliminary user study indicates that our system can generate useful design suggestions for experts and novices, and facilitate users’ exploration and evaluation during the cinematic composition design process.
Supplemental Material
- Download
- 4.32 MB
- Transcript
- Download
- 35.90 MB
- Transcript
- Download
- 31.41 MB
- Transcript
References
[1]
H Porter Abbott. 2002. The Cambridge introduction to narrative. Cambridge University Press.
[2]
Shivam Sharma Karan Bilakhiya Aman Gupta, Amey Band. 2020. text2emotion. https://pypi.org/project/text2emotion/
[3]
Hideaki Anno. 2021. Evangelion: 3.0+1.01 Thrice Upon a Time [Film]. IMDb (2021).
[4]
Ido Arev, Hyun Soo Park, Yaser Sheikh, Jessica Hodgins, and Ariel Shamir. 2014. Automatic Editing of Footage from Multiple Social Cameras. ACM Trans. Graph. 33, 4, Article 81 (jul 2014), 11 pages. https://doi.org/10.1145/2601097.2601198
[5]
Daniel Arijon. 1991. Grammar of the film language. Silman-James Press.
[6]
J. Aumont, University of Texas Press, A. Bergala, M. Marie, R. Neupert, and M. Vernet. 1992. Aesthetics of Film. University of Texas Press. https://books.google.com.hk/books?id=nmpZAAAAMAAJ
[7]
Rogerio Bonatti, Arthur Bucker, Sebastian Scherer, Mustafa Mukadam, and Jessica Hodgins. 2021. Batteries, camera, action! Learning a semantic control space for expressive robot cinematography. In 2021 IEEE International Conference on Robotics and Automation (ICRA). 7302–7308. https://doi.org/10.1109/ICRA48506.2021.9560745
[8]
Christopher Bowen. 2013. Grammar of the Shot. Routledge.
[9]
Nicholas Davis, Boyang Li, Brian O’Neill, Mark Riedl, and Michael Nitsche. 2011. Distributed Creative Cognition in Digital Filmmaking. In Proceedings of the 8th ACM Conference on Creativity and Cognition (Atlanta, Georgia, USA) (C&C ’11). Association for Computing Machinery, New York, NY, USA, 207–216. https://doi.org/10.1145/2069618.2069654
[10]
Nicholas Davis, Alexander Zook, Brian O’Neill, Brandon Headrick, Mark Riedl, Ashton Grosz, and Michael Nitsche. 2013. Creativity support for novice digital filmmaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 651–660.
[11]
Edirlei E. S. de Lima, Cesar T. Pozzer, Marcos C. d’Ornellas, Angelo E. M. Ciarlini, Bruno Feijó, and Antonio L. Furtado. 2009. Virtual Cinematography Director for Interactive Storytelling. In Proceedings of the International Conference on Advances in Computer Entertainment Technology (Athens, Greece) (ACE ’09). Association for Computing Machinery, New York, NY, USA, 263–270. https://doi.org/10.1145/1690388.1690432
[12]
Inan Evin, Perttu Hämäläinen, and Christian Guckelsberger. 2022. Cine-AI: Generating Video Game Cutscenes in the Style of Human Directors. Proceedings of the ACM on Human-Computer Interaction 6, CHI PLAY (2022), 1–23.
[13]
Gerhard Fischer. 2004. Social creativity: turning barriers into opportunities for collaborative design. In Proceedings of the eighth conference on Participatory design: Artful integration: interweaving media, materials and practices-Volume 1. 152–161.
[14]
Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the landscape of creativity support tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–18.
[15]
Jonas Frich, Michael Mose Biskjaer, and Peter Dalsgaard. 2018. Twenty years of creativity research in human-computer interaction: Current state and future directions. In Proceedings of the 2018 Designing Interactive Systems Conference. 1235–1257.
[16]
Francis Glebas. 2012. Directing the story: professional storytelling and storyboarding techniques for live action and animation. Routledge.
[17]
Mirko Gschwindt, Efe Camci, Rogerio Bonatti, Wenshan Wang, Erdal Kayacan, and Sebastian Scherer. 2019. Can a Robot Become a Movie Director? Learning Artistic Principles for Aerial Cinematography. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 1107–1114. https://doi.org/10.1109/IROS40897.2019.8967592
[18]
Li-wei He, Michael F Cohen, and David H Salesin. 1996. The virtual cinematographer: A paradigm for automatic real-time camera control and directing. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. 217–224.
[19]
Chong Huang, Fei Gao, Jie Pan, Zhenyu Yang, Weihao Qiu, Peng Chen, Xin Yang, Shaojie Shen, and Kwang-Ting Cheng. 2018. ACT: An Autonomous Drone Cinematography System for Action Scenes. In 2018 IEEE International Conference on Robotics and Automation (ICRA). 7039–7046. https://doi.org/10.1109/ICRA.2018.8460703
[20]
Arnav Jhala and R Michael Young. 2011. Intelligent machinima generation for visual storytelling. In Artificial Intelligence for Computer Games. Springer, 151–170.
[21]
Hongda Jiang, Bin Wang, Xi Wang, Marc Christie, and Baoquan Chen. 2020. Example-driven virtual cinematography by learning camera behaviors. ACM Transactions on Graphics (TOG) 39, 4 (2020), 45–1.
[22]
Niels Joubert, Jane L. E, Dan B Goldman, Floraine Berthouzoz, Mike Roberts, James A. Landay, and Pat Hanrahan. 2016. Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles. arxiv:1610.01691 [cs.GR]
[23]
Aki Kubota. 2021. Hideaki Anno: The Final Challenge of Evangelion [Film]. NHK (2021).
[24]
Nicole E Lemon. 2012. Previsualization in Computer Animated Filmmaking. Ph. D. Dissertation. The Ohio State University.
[25]
Christophe Lino, Marc Christie, Fabrice Lamarche, Schofield Guy, and Patrick Olivier. 2010. A real-time cinematography system for interactive 3d environments. In SCA’10 Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 139–148.
[26]
Henry Lowood and Michael Nitsche. 2011. The machinima reader. MIT Press.
[27]
Paul Marino. 2004. 3D game-based filmmaking: The art of machinima. Paraglyph Press.
[28]
Marcos Mateu-Mestre and Jeffrey Katzenberg. 2010. Framed ink: Drawing and composition for visual storytellers. Design Studio Press.
[29]
R. McKee. 1997. Story: Substance, Structure, Style and the Principles of Screenwriting. HarperCollins Publishers.
[30]
Manshad Abbasi Mohsin and Anatoly Beltiukov. 2019. Summarizing emotions from text using Plutchik’s wheel of emotions. In 7th Scientific Conference on Information Technologies for Intelligent Decision Making Support (ITIDS 2019). Atlantis Press, 291–294.
[31]
K. L. Bhanu Moorthy, Moneish Kumar, Ramanathan Subramanian, and Vineet Gandhi. 2020. GAZED– Gaze-Guided Cinematic Editing of Wide-Angle Monocular Video Recordings. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3313831.3376544
[32]
Ben Shneiderman. 2002. Creativity support tools. Commun. ACM 45, 10 (2002), 116–120.
[33]
T. Sobchack and V.C. Sobchack. 1987. An Introduction to Film. Little, Brown. https://books.google.com.hk/books?id=SwMbAQAAIAAJ
[34]
Anh Truong, Floraine Berthouzoz, Wilmot Li, and Maneesh Agrawala. 2016. QuickCut: An Interactive Tool for Editing Narrated Video. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 497–507. https://doi.org/10.1145/2984511.2984569
Index Terms
- Cinemassist: An Intelligent Interactive System for Real-Time Cinematic Composition Design
Recommendations
An Interactive System for Supporting Creative Exploration of Cinematic Composition Designs
UIST '24: Proceedings of the 37th Annual ACM Symposium on User Interface Software and TechnologyDesigning cinematic compositions, which involves moving cameras through a scene, is essential yet challenging in filmmaking. Machinima filmmaking provides real-time virtual environments for exploring different compositions flexibly and efficiently. ...
Firebolt: A System for Automated Low-Level Cinematic Narrative Realization
Interactive StorytellingAbstractCreation of machine generated cinematics currently requires a significant amount of human author time or manually coding domain operators such that they may be realized by a rendering system. We present FireBolt, an automated cinematic realization ...
Toward intelligent support of authoring machinima media content: story and visualization
INTETAIN '08: Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINmentThe Internet and the availability of authoring tools have enabled a greater community of media content creators, including nonexperts. However, while media authoring tools often make it technically feasible to generate, edit and share digital media ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 395Total Downloads
- Downloads (Last 12 months)395
- Downloads (Last 6 weeks)47
Reflects downloads up to 14 Dec 2024
Other Metrics
Citations
Cited By
View all- Zhang XBa XHu FYuan J(2024)EmotionCast: An Emotion-Driven Intelligent Broadcasting System for Dynamic Camera SwitchingSensors10.3390/s2416540124:16(5401)Online publication date: 21-Aug-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format