research-article

Is Virtual Reality Product Development different?: An Empirical Study on VR Product Development Practices

Authors:

Sai Anirudh Karre,

Y. Raghu ReddyAuthors Info & Claims

ISEC '19: Proceedings of the 12th Innovations in Software Engineering Conference (formerly known as India Software Engineering Conference)

Article No.: 3, Pages 1 - 11

https://doi.org/10.1145/3299771.3299772

Published: 14 February 2019 Publication History

Abstract

With the rise of Virtual Reality (VR) footprint in many organizations, it was unclear if traditional software engineering practices are still exercised during VR product development. As part of our research, we conducted a year-long multi-level exploratory study to understand the various software development practices within VR product development teams. An empirical study on VR practitioners from 6 different countries was done to examine their development strategies, methods, and models adopted along with the various challenges faced during the course of VR product release. We found that VR practitioners adopted hybrid Software Engineering approaches in VR product development. In this paper, we present our insights from the empirical study and stress on the need for a diverse software development model for VR products.

References

[1]

2017. ISO/IEC/IEEE International Standard - Systems and Software Engineering--Life Cycle Management--Part 5: Software Development Planning. ISO/IEC/IEEE 24748-5:2017(E) (June 2017), 1--48.

[2]

2018. Market Research Report: Augmented/Virtual Reality Report Q2 2018. Digi-Capital (2018), 1--234.

[3]

2018. Oculus Developer Program. (2018). https://developer.oculus.com/oculus-start/ Accessed: 2018-04-30.

[4]

Steve Adolph, Wendy Hall, and Philippe Kruchten. 2011. Using grounded theory to study the experience of software development. Empirical Software Engineering 16, 4(01 Aug 2011), 487--513.

Digital Library

[5]

Maram Al-Mousa, Hend S. Al-Khalifa, and Hana AlSobayel. 2017. Requirements Elicitation and Prototyping of a Fully Immersive Virtual Reality Gaming System for Upper Limb Stroke Rehabilitation in Saudi Arabia. Mobile Information Systems 2017 (2017), 7507940:1--7507940:12.

[6]

Saiqa Aleem, Luiz Fernando Capretz, and Faheem Ahmed. 2016. Game development software engineering process life cycle: a systematic review. Journal of Software Engineering Research and Development 4, 1 (09 Nov 2016), 6.

[7]

Ejder Bastug, Mehdi Bennis, Muriel Médard, and Mérouane Debbah. 2017. Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers. IEEE Communications Magazine 55, 6 (2017), 110--117.

Digital Library

[8]

Jason W. Bay. 2014. Turning Video Gamers into Software Developers. IEEE Computer 47, 10 (2014), 99--101.

Digital Library

[9]

A. Begel, N. Nagappan, C. Poile, and L. Layman. 2009. Coordination in large-scale software teams. In 2009 ICSE Workshop on Cooperative and Human Aspects on Software Engineering. 1--7.

Digital Library

[10]

Gary Burnett. 2000. Information exchange in virtual communities: a typology. Information research 5, 4 (2000).

[11]

Sridhar Chimalakonda and Kesav V. Nori. 2014. On the Nature of Roles in Software Engineering. In Proceedings of the 7th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE 2014). ACM, New York, NY, USA, 91--94.

Digital Library

[12]

Lorenz B. Dehn, Leona Kater, Martina Piefke, Mario Botsch, Martin Driessen, and T. Beblo. 2018. Training in a comprehensive everyday-like virtual reality environment compared to computerized cognitive training for patients with depression. Computers in Human Behavior 79 (2018), 40--52.

Digital Library

[13]

A. Cardoso F. Mattioli, D. Caetano and E. Lamounier. 2015. On the Agile Development of Virtual Reality Systems. Int'l Conf. Software Eng. Research and Practice (2015), 10--16.

[14]

Bin Han and Jianfeng Xie. 2011. Thesis: Practical Experience: Adopt Agile Methodology Combined With Kanban For Virtual Reality Development. Dept of CS, University of Gothenburg Publications (2011), 1--16.

[15]

Tobias Huber, Tom Wunderling, Markus Paschold, Hauke Lang, Werner Kneist, and Christian Hansen. 2018. Highly immersive virtual reality laparoscopy simulation: development and future aspects. Int. J. Computer Assisted Radiology and Surgery 13, 2 (2018), 281--290.

[16]

Sankar Jayaram, Hugh I. Connacher, and Kevin W. Lyons. 1997. Virtual assembly using virtual reality techniques. Computer-Aided Design 29, 8 (1997), 575--584.

[17]

C. M. Kanode and H. M. Haddad. 2009. Software Engineering Challenges in Game Development. In 2009 Sixth International Conference on Information Technology: New Generations. 260--265.

Digital Library

[18]

N. S. A. Karim, F. A. Ammar, and R. Aziz. 2017. Ethical Software: Integrating Code of Ethics into Software Development Life Cycle. In 2017 International Conference on Computer and Applications (ICCA). 290--298.

[19]

R. Kneuper. 2017. Sixty Years of Software Development Life Cycle Models. IEEE Annals of the History of Computing 39, 3 (2017), 41--54.

Digital Library

[20]

K. Mania, S. Ellis, M. Billinghurst, and A. Steed. 2002. Usability evaluation techniques for virtual reality technologies. In Proceedings IEEE Virtual Reality 2002. 299--299.

Digital Library

[21]

Rose M. Marra, Joi L. Moore, and Aimee K. Klimczak. 2004. Content analysis of online discussion forums: A comparative analysis of protocols. Educational Technology Research and Development 52, 2 (01 Jun 2004), 23.

[22]

Neeraj Mathur and Sai Anirudh Karre. 2018. VR Empirical Study Supplementary Resources. {Last Accessed}:07-15-2018. https://goo.gl/iY7JuV

[23]

J.M. Morse. 1994. Critical Issues in Qualitative Research Methods. SAGE Publications.

[24]

Emerson Murphy-Hill, Thomas Zimmermann, and Nachiappan Nagappan. 2014. Cowboys, Ankle Sprains, and Keepers of Quality: How is Video Game Development Different from Software Development?. In Proceedings of the 36th International Conference on Software Engineering (ICSE 2014). ACM, New York, NY, USA, 1--11.

Digital Library

[25]

Ann Osborne O'Hagan and Rory V. O'Connor. 2015. Towards an Understanding of Game Software Development Processes: A Case Study. In Systems, Software and Services Process Improvement - 22nd European Conference, EuroSPI 2015, Ankara, Turkey, September 30-October 2, 2015. Proceedings. 3--16.

[26]

Ann "Osborne O'Hagan, Gerry Coleman, and Rory V." O'Connor. "2014". "Software Development Processes for Games: A Systematic Literature Review". "Springer Berlin Heidelberg", "182--193".

[27]

U. Pakdeetrakulwong, P. Wongthongtham, and W. V. Siricharoen. 2014. Recommendation systems for software engineering: A survey from software development life cycle phase perspective. In The 9th International Conference for Internet Technology and Secured Transactions (ICITST-2014). 137--142.

[28]

Edoardo Patti, Angelo Mollame, David Erba, Daniele Dalmasso, Anna Osello, Enrico Macii, and Andrea Acquaviva. 2017. Information Modeling for Virtual and Augmented Reality. IT Professional 19, 3 (2017), 52--60.

Digital Library

[29]

Fabio Petrillo and Marcelo Pimenta. 2010. Is Agility out There?: Agile Practices in Game Development. In Proceedings of the 28th ACM International Conference on Design of Communication (SIGDOC '10). ACM, New York, NY, USA, 9--15.

Digital Library

[30]

R. Ramadan and Y. Widyani. 2013. Game development life cycle guidelines. In 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS). 95--100.

[31]

B. Randell. 1979. Software Engineering in 1968. In Proceedings of the 4th International Conference on Software Engineering (ICSE '79). IEEE Press, Piscataway, NJ, USA, 1--10. http://dl.acm.org/citation.cfm?id=800091.802915

Digital Library

[32]

Ulas, Murat Yilmaz, and Veysi Isler. 2017. A Literature Survey: Is it Necessary to Develop a New Software Development Methodology for Virtual Reality Projects? J. UCS 23, 8 (2017), 725--754.

[33]

Claes Wohlin, Martin Höst, and Kennet Henningsson. 2003. Empirical Research Methods in Software Engineering. Springer Berlin Heidelberg, Berlin, Heidelberg, 7--23.

[34]

Yu Yuan. 2018. Paving the Road for Virtual and Augmented Reality {Standards}. IEEE Consumer Electronics Magazine 7, 1 (2018), 117--128.

Cited By

Karre SReddy YMittal R(2024)RE Methods for Virtual Reality Software Product Development: A Mapping StudyACM Transactions on Software Engineering and Methodology10.1145/364959533:4(1-31)Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1145/3649595
Karre SMittal RReddy R(2023)Requirements Elicitation for Virtual Reality Products - A Mapping StudyProceedings of the 16th Innovations in Software Engineering Conference10.1145/3578527.3578536(1-11)Online publication date: 23-Feb-2023
https://dl.acm.org/doi/10.1145/3578527.3578536
Karre SPareek VMittal RReddy R(2022)A Role Based Model Template for Specifying Virtual Reality SoftwareProceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering10.1145/3551349.3560514(1-5)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3551349.3560514
Show More Cited By

Index Terms

Is Virtual Reality Product Development different?: An Empirical Study on VR Product Development Practices
1. Software and its engineering
  1. Software creation and management
    1. Software development process management
      1. Software development methods
        Design patterns

Recommendations

Understanding Software Quality Metrics for Virtual Reality Products - A Mapping Study
ISEC '21: Proceedings of the 14th Innovations in Software Engineering Conference (formerly known as India Software Engineering Conference)

Virtual Reality (VR) Software is becoming more mainstream in recent years. It has provided an opportunity for VR practitioners to explore new domains and deliver cutting edge products. The success of the VR products depends primarily on the product ...
Adopting virtual reality as a medium for software development process education
ICSSP '18: Proceedings of the 2018 International Conference on Software and System Process

Software development is a complex process of collaborative endeavour which requires hands-on experience starting from requirement analysis through to software testing and ultimately demands continuous maintenance so as to mitigate risks and uncertainty. ...
RE Methods for Virtual Reality Software Product Development: A Mapping Study
Software practitioners use various methods in Requirements Engineering (RE) to elicit, analyze, and specify the requirements of enterprise products. The methods impact the final product characteristics and influence product delivery. Ad-hoc usage of the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ISEC '19: Proceedings of the 12th Innovations in Software Engineering Conference (formerly known as India Software Engineering Conference)

February 2019

238 pages

ISBN:9781450362153

DOI:10.1145/3299771

General Chair:
Ravindra Naik
TCS Research, Pune
,
Program Chairs:
Santonu Sarkar
BITS-Pilani, Goa
,
Thomas Hildebrandt
Univ. of Copenhagen, Denmark
,
Atul Kumar
IBM Research India
,
Publications Chair:
Richa Sharma
BMU, Gurugram

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

iSOFT: iSOFT
ACM: Association for Computing Machinery
Microsoft: Microsoft
ACM India: ACM India

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 February 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ISEC'19

ISEC'19: 12th Innovations in Software Engineering Conference

February 14 - 16, 2019

Pune, India

Acceptance Rates

Overall Acceptance Rate 76 of 315 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
409
Total Downloads

Downloads (Last 12 months)80
Downloads (Last 6 weeks)11

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Karre SReddy YMittal R(2024)RE Methods for Virtual Reality Software Product Development: A Mapping StudyACM Transactions on Software Engineering and Methodology10.1145/364959533:4(1-31)Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1145/3649595
Karre SMittal RReddy R(2023)Requirements Elicitation for Virtual Reality Products - A Mapping StudyProceedings of the 16th Innovations in Software Engineering Conference10.1145/3578527.3578536(1-11)Online publication date: 23-Feb-2023
https://dl.acm.org/doi/10.1145/3578527.3578536
Karre SPareek VMittal RReddy R(2022)A Role Based Model Template for Specifying Virtual Reality SoftwareProceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering10.1145/3551349.3560514(1-5)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3551349.3560514
Kuri MKarre SReddy Y(2021)Understanding Software Quality Metrics for Virtual Reality Products - A Mapping StudyProceedings of the 14th Innovations in Software Engineering Conference (formerly known as India Software Engineering Conference)10.1145/3452383.3452391(1-11)Online publication date: 25-Feb-2021
https://dl.acm.org/doi/10.1145/3452383.3452391
Karre SMathur NReddy Y(2020)Understanding usability evaluation setup for VR products in industryACM SIGAPP Applied Computing Review10.1145/3381307.338130919:4(17-27)Online publication date: 28-Jan-2020
https://dl.acm.org/doi/10.1145/3381307.3381309
Andrade SNunes FDelamaro M(2019)Towards the Systematic Testing of Virtual Reality Programs2019 21st Symposium on Virtual and Augmented Reality (SVR)10.1109/SVR.2019.00044(196-205)Online publication date: Oct-2019
https://doi.org/10.1109/SVR.2019.00044

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents