Guidelines for Practicing Responsible Innovation in HPC: A Sociotechnical Approach

1. Aarts, A.C.T.: Methodology of mathematical modeling [lecture notes], January 2010. https://www.win.tue.nl/iadan/model/modelB/Methodology_Mathematical_Modeling_MI_2010.pdf

2. Baldwin, D., Walker, H.M., Henderson, P.B.: The roles of mathematics in computer science. ACM Inroads 4(4), 74–80 (2013). https://doi.org/10.1145/2537753.2537777

3. Bellman, K., et al.: Socially-sensitive systems design: Exploring social potential. IEEE Technol. Soc. Mag. 36(3), 72–80 (2017). https://doi.org/10.1109/MTS.2017.2728727

4. Califf, M.E., Goodwin, M.: Effective incorporation of ethics into courses that focus on programming. SIGCSE Bull. 37(1), 347–351 (2005). https://doi.org/10.1145/1047124.1047464

5. Celi, L.A., et al.: Sources of bias in artificial intelligence that perpetuate healthcare disparities – a global review. PLOS Digit. Health 1(3) (2022). https://doi.org/10.1371/journal.pdig.0000022

6. BSSw Community: Productivity and Sustainability Improvement Planning (PSIP), January 2020. https://bssw.io/blog_posts/productivity-and-sustainability-improvement-planning-psip. Accessed 22 Feb 2023

7. Davis, T., Rajamanickam, S.: Ethical concerns of code generation through artificial intelligence. SIAM News 55(10) (2022)

   Google Scholar 

8. Delobelle, P., Tokpo, E.K., Calders, T., Berendt, B.: Measuring fairness with biased rulers: a survey on quantifying biases in pretrained language models (2021). https://arxiv.org/abs/2112.07447, https://doi.org/10.48550/ARXIV.2112.07447

9. Elliott, G., Müller, U.K.: Minimizing the impact of the initial condition on testing for unit roots. J. Econometrics 135(1), 285–310 (2006). https://www.sciencedirect.com/science/article/pii/S0304407605001740, https://doi.org/10.1016/j.jeconom.2005.07.024

10. Gentzsch, W.: Towards ubiquitous HPC - passing HPC into the hands of every engineer and scientist. HPC Wire, 7 January 2016. https://www.hpcwire.com/2016/01/07/towards-ubiquitous-hpc/

11. Gewirtz, D.: I asked chatGPT to write a Wordpress plugin I needed. It did it in less than 5 minutes. ZDNET, February 2023. https://www.zdnet.com/article/i-asked-chatgpt-to-write-a-wordpress-plugin-i-needed-it-did-it-in-less-than-5-minutes/

12. Gonsiorowski, E., et al.: PSIP progress tracking card catalog [GitHub repository]. https://github.com/bssw-psip/ptc-catalog. Accessed 22 Feb 2023

13. Hammond, P., Ahmad, B., Tan, B., Dolan-Gavitt, B., Karri, R.: Asleep at the keyboard? Assessing the security of GitHub copilot’s code contributions. arxiv:2108.09293, December 2021. https://arxiv.org/pdf/2108.09293.pdf

14. Heroux, M.A., et al.: Lightweight software process improvement using Productivity and Sustainability Improvement Planning (PSIP). Tools and Techniques for High Performance Computing (2020). https://www.springerprofessional.de/en/lightweight-software-process-improvement-using-productivity-and-/17832686

15. Hess, D.J., et al.: A comparative, sociotechnical design perspective on responsible innovation: multidisciplinary research and education on digitized energy and automated vehicles. J. Respons. Innov. (2021). https://par.nsf.gov/biblio/10296932, https://doi.org/10.1080/23299460.2021.1975377

16. Hind, M.: IBM factsheets further advances trust in AI, July 2020. https://www.ibm.com/blogs/research/2020/07/aifactsheets/

17. Johnson, D.G., Verdicchio, M.: Ethical AI is not about AI. Commun. ACM 66(2), 32–34 (2023). https://doi.org/10.1145/3576932

18. Lee, J., Le, T., Chen, J., Lee, D.: Do language models plagiarize? In: Proceedings of the ACM Web Conference 2023 (WWW’23) Austin, TX, USA. Association for Computing Machinery, New York (2023). https://pike.psu.edu/publications/www23.pdf

19. Leydens, J.A., Johnson, K., Claussen, S., Blacklock, J., Moskal, B.M., Cordova, O: Measuring change over time in sociotechnical thinking: a survey/validation model for sociotechnical habits of mind. In: 2018 ASEE Annual Conference and Exposition, Salt Lake City, Utah, June 2018. ASEE Conferences (2018)

    Google Scholar 

20. Moore, J.: Towards a more representative politics in the ethics of computer science. In: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, FAT* ’20, pp. 414–424. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3351095.3372854

21. Oetzel, J., Pant, S., Rao, N.: Methods for intercultural communication research. Communication (2016). https://oxfordre.com/communication/display/10.1093/acrefore/9780190228613.001.0001/acrefore-9780190228613-e-202

22. National Academies of Sciences Engineering and Medicine. Fostering Responsible Computing Research: Foundations and Practices. The National Academies Press, Washington, DC (2022). https://doi.org/10.17226/26507

23. National Institute of Standards and Technology. Artificial Intelligence Risk Management Framework, January 2023. https://doi.org/10.6028/NIST.AI.100-1

24. ACM Committee on Professional Ethics. ACM code of ethics and professional conduct (2018). https://www.acm.org/code-of-ethics

25. Rabier, F., Klinker, E., Courtier, P., Hollingsworth, A.: Sensitivity of forecast errors to initial conditions. Q. J. Roy. Meteorol. Soc. 122(529), 121–150 (1996). https://doi.org/10.1002/qj.49712252906

26. Raybourn, E.M., et al.: PSIP toolkit: a lightweight process for incremental software process improvement, June 2021. https://www.osti.gov/biblio/1872186, https://doi.org/10.2172/1872186

27. Raybourn, E.M., Moulton, J.D., Hungerford, A.: Scaling productivity and innovation on the path to exascale with a “Team of Teams’’ approach. In: Nah, F.F.-H., Siau, K. (eds.) HCII 2019. LNCS, vol. 11589, pp. 408–421. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22338-0_33

    Chapter  Google Scholar 

28. Rigolot, C.: Transdisciplinarity as a discipline and a way of being: complementarities and creative tensions. Human. Soc. Sci. Commun. 7 (2020). https://doi.org/10.1057/s41599-020-00598-5

29. Saltz, J., et al.: Integrating ethics within machine learning courses. ACM Trans. Comput. Educ. 19(4) (2019). https://doi.org/10.1145/3341164

30. Saltz, J.S., Dewar, N.I., Heckman, R.: Key concepts for a data science ethics curriculum. In: Proceedings of the 49th ACM Technical Symposium on Computer Science Education, SIGCSE ’18, pp. 952–957. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3159450.3159483

31. Scoles, S.: New exascale supercomputer can do a quintillion calculations a second. Sci. Am. (2023). https://www.scientificamerican.com/article/new-exascale-supercomputer-can-do-a-quintillion-calculations-a-second/

32. Seino, T., Clarkson, P.C., Downton, A., Gronn, D., Horne, M.: Understanding the role of assumptions in mathematical modeling: analysis of lessons with emphasis on ‘the awareness of assumptions’. Build. Connect. Theory Res. Pract. 664–671 (2005)

    Google Scholar 

33. Shankland, S.: Computing guru criticizes chatGPT AI tech for making things up, February 2023. https://www.cnet.com/tech/computing/computing-guru-criticizes-chatgpt-ai-tech-for-making-things-up/

34. Steghofer, J.-P., Diaconescu, A., Marsh, S., Pitt, J.: The next generation of socio-technical systems: realizing the potential, protecting the value [introduction]. IEEE Technol. Soc. Mag. 36(3), 46–47 (2017). https://doi.org/10.1109/MTS.2017.2728726

35. Sukhija, N., Bautista, E., Butz, D., Whitney, C.: Towards anomaly detection for monitoring power consumption in HPC facilities. In: Proceedings of the 14th International Conference on Management of Digital EcoSystems, MEDES ’22, pp. 1–8. Association for Computing Machinery, New York (2022). https://doi.org/10.1145/3508397.3564826

36. IDEAS-ECP Team and Collaborators. Advancing scientific productivity through better scientific software: developer productivity and software sustainability report, January 2020. https://www.exascaleproject.org/wp-content/uploads/2020/01/IDEAS-ECP.Report.v1.0.pdf

37. Wilson, E.B., Worcester, J.: The law of mass action in epidemiology. Proc. Natl. Acad. Sci. 31(1), 24–34 (1945). https://doi.org/10.1073/pnas.31.1.24

38. Scientific Computing World: HPC researchers rank ‘availability of resources’ as their primary challenge (2020). https://www.scientific-computing.com/news/hpc-researchers-rank-availability-resources-their-primary-challenge/

39. Xu, W., Dainoff, M.: Enabling human-centered AI: a new junction and shared journey between AI and HCI communities. Interactions, January–February 2023. https://interactions.acm.org/archive/view/january-february-2023/enabling-human-centered-ai-a-new-junction-and-shared-journey-between-ai-and-hci-communities

40. Zachary, G.P.: The hidden logic of ethical innovation, February 2022. https://techonomy.com/the-hidden-logic-of-ethical-innovation/

Download references