Article

Predicting build failures using social network analysis on developer communication

Authors:

Adrian Schroter,

Daniela Damian,

Thanh NguyenAuthors Info & Claims

ICSE '09: Proceedings of the 31st International Conference on Software Engineering

Pages 1 - 11

https://doi.org/10.1109/ICSE.2009.5070503

Published: 16 May 2009 Publication History

Abstract

A critical factor in work group coordination, communication has been studied extensively. Yet, we are missing objective evidence of the relationship between successful coordination outcome and communication structures. Using data from IBM's Jazz™ project, we study communication structures of development teams with high coordination needs. We conceptualize coordination outcome by the result of their code integration build processes (successful or failed) and study team communication structures with social network measures. Our results indicate that developer communication plays an important role in the quality of software integrations. Although we found that no individual measure could indicate whether a build will fail or succeed, we leveraged the combination of communication structure measures into a predictive model that indicates whether an integration will fail. When used for five project teams, our predictive model yielded recall values between 55% and 75%, and precision values between 50% to 76%.

References

[1]

V. R. Basili, L. C. Briand, and W. L. Melo. A validation of object-oriented design metrics as quality indicators. IEEE Trans. Softw. Eng., 22(10):751-761, 1996.

Digital Library

[2]

R. M. Bell. Predicting the location and number of faults in large software systems. IEEE Trans. Softw. Eng., 31(4):340- 355, 2005.

Digital Library

[3]

C. Bird, A. Gourley, P. Devanbu, M. Gertz, and A. Swaminathan. Mining email social networks. In Proc. of the 2006 Int. workshop on Mining Soft. repositories, pages 137-143, 2006.

Digital Library

[4]

R. Burt. Structural Holes: The Social Structure of Competition . Harvard University Press, August 1995.

[5]

M. Cataldo, M. Bass, J. D. Herbsleb, and L. Bass. On Coordination Mechanisms in Global Software Development. In Proc. of the 2nd Int. Conf. on Global Soft. Eng., pages 71- 80, 2007.

Digital Library

[6]

B. Curtis, H. Krasner, and N. Iscoe. A Field Study of the Software Design Process for Large Systems. Communications of the ACM, 31(11), 1988.

Digital Library

[7]

D. Damian, L. Izquierdo, J. Singer, and I. Kwan. Awareness in the wild: Why communication breakdowns occur. In Proc. of the 2nd Int. Conf. on Global Soft. Eng., pages 81-90, 2007.

Digital Library

[8]

C. R. B. de Souza, D. Redmiles, L.-T. Cheng, D. Millen, and J. Patterson. How a good software practice thwarts collaboration: the multiple roles of apis in software development. In Proc. of the 12th ACM SIGSOFT Int. symposium on Foundations of Soft. Eng., pages 221-230, 2004.

Digital Library

[9]

C. R. B. de Souza, D. Redmiles, L.-T. Cheng, D. Millen, and J. Patterson. Sometimes you need to see through walls: a field study of application programming interfaces. In Proc. of the Computer Supported Cooperative Work, pages 63-71, 2004.

Digital Library

[10]

G. Denaro, S. Morasca, and M. Pezzè. Deriving models of software fault-proneness. In Proc. of the 14th Int. Conf. on Soft. Eng. and knowledge Eng., pages 361-368, 2002.

Digital Library

[11]

L. C. Freeman. Centrality in social networks: Conceptual clarification. Social Networks, 1(3):215-239, 1979.

[12]

R. Frost. Jazz and the Eclipse Way of Collaboration. IEEE Software, 24(06):114-117, 2007.

Digital Library

[13]

S. R. Fussell, R. E. Kraut, F. J. Lerch, W. L. Scherlis, M. M. McNally, and J. J. Cadiz. Coordination, overload and team performance: effects of team communication strategies. In Proc. of the Computer Supported Cooperative Work, 1998.

Digital Library

[14]

P. A. Gloor, R. Laubacher, S. B. C. Dynes, and Y. Zhao. Visualization of communication patterns in collaborative innovation networks - analysis of some w3c working groups. In Proc. of the 12th Int. Conf. on Information and knowledge management, 2003.

Digital Library

[15]

C. N. Gonzalez-Brambila and F. Veloso. Social capital in academic engineers. In Portland Int. Center for Management of Eng. and Technology, 5-9 Aug. 2007.

[16]

A. Griffin and J. R. Hauser. Patterns of Communication Among Marketing, Engineering and Manufactoring-A Comparison Between Two New Product Teams. Management Science, 38(3), 1992.

Digital Library

[17]

R. E. Grinter, J. D. Herbsleb, and D. E. Perry. The Geography of Coordination: Dealing with Distance in R&D Work. In Proc. of the Int. Conf. on Supporting Group Work, pages 306-315, 1999.

Digital Library

[18]

A. Hargadon and R. I. Sutton. Technology brokering and innovation in a product development firm. Administrative Science Quarterly, 42(4), 1997.

[19]

A. E. Hassan and K. Zhang. Using Decision Trees to Predict the Certification Result of a Build. In Proc. of the 21st IEEE/ACM Int. Conf. on Automated Soft. Eng., pages 189- 198, 2006.

Digital Library

[20]

T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction . Springer, 3 edition, July 2003.

[21]

J. D. Herbsleb and R. E. Grinter. Splitting the organization and integrating the code: Conway's law revisited. In Proc. of the 21st Int. Conf. on Soft. Eng., pages 85-95, 1999.

Digital Library

[22]

J. D. Herbsleb and A. Mockus. An Empirical Study of Speed and Communication in Globally Distributed Software Development. IEEE Transactions on Soft. Eng., 29(6):481- 494, June 2003.

Digital Library

[23]

J. D. Herbsleb, A. Mockus, and J. A. Roberts. Collaboration in Software Engineering Projects: A Theory of Coordination. In Int. Conf. on Information Systems, 2006.

[24]

P. Hinds and C. McGrath. Structures that Work: Social Structure, Work Structure and Coordination Ease in Geographically Distributed Teams. In Proc. of the 20th Conf. on Computer Supported Cooperative Work, pages 343-352, 2006.

Digital Library

[25]

H. Holmstrom, E. O. Conchuir, P. J. Ågerfalk, and B. Fitzgerald. Global Software Development Challenges: A Case Study on Temporal, Geographical and Socio-Cultural Distance. In Proc. of the 1st Int. Conf. on Global Soft. Eng., pages 3-11, 2006.

Digital Library

[26]

L. Hossain, A.Wu, and K. K. S. Chung. Actor centrality correlates to project based coordination. In Proc. of the 20th anniversary Conf. on Computer Supported Cooperative Work, pages 363-372, 2006.

Digital Library

[27]

S. Kim, J. Whitehead, and Y. Zhang. Classifying software changes: Clean or buggy? IEEE Transactions on Soft. Eng., 34(2):181-196, 2008.

Digital Library

[28]

R. E. Kraut and L. A. Streeter. Coordination in Software Development. Communications of the ACM, 38(3):69-81, March 1995.

Digital Library

[29]

A. Meneely, L. Williams, W. Snipes, and J. Osborne. Predicting Failures with Developer Networks and Social Network Analysis. In Proc. of the 16th ACM SIGSOFT Int. Symposium on Foundations of Soft. Eng., 2008.

Digital Library

[30]

A. Mockus and D. M. Weiss. Predicting risk of software changes. Bell Labs Technical Journal, 5(2):169-180, 2000.

[31]

N. Nagappan and T. Ball. Use of relative code churn measures to predict system defect density. In ICSE '05: Proc. of the 27th Int. Conf. on Soft. Eng., May 2005.

Digital Library

[32]

N. Nagappan, T. Ball, and A. Zeller. Mining metrics to predict component failures. In Proc. of the 28th Int. Conf. on Soft. Eng., pages 452-461, 2006.

Digital Library

[33]

M. B. Pinto and J. K. Pinto. Project Team Communication and Cross-Functional Cooperation in New Program Development. Journal of Product Innovation Management, 7(3), 1990.

[34]

M. Pinziger, N. Nagappan, and B. Murphy. Can Developer Social Networks Predict Failures? In Proc. of the 16th ACM SIGSOFT Int. Symposium on Foundations of Soft. Eng., 2008.

Digital Library

[35]

R. Reagans and E. W. Zuckerman. Networks, Diversity, and Productivity: The Social Capital of Corporate R&D Teams. Organization Science, 12(4), 2001.

Digital Library

[36]

D. L. Rulke and J. Galaskiewicz. Distribution of Knowledge, Group Network Structure, and Group Performance. Management Science, 46(5):612-625, 2000.

Digital Library

[37]

A. Sarma and A. van der Hoek. Towards awareness in the large. In Proc. of the Int. Conf. on Global Soft. Eng., pages 127-131, 2006.

Digital Library

[38]

A. Schröter, T. Zimmermann, and A. Zeller. Predicting Component Failures at Design Time. In Proc. of the 5th Int. Symposium on Empirical Soft. Eng., pages 18-27, September 2006.

Digital Library

[39]

S. Siegel. Nonparametric Statistics for the Behavioral Sciences . 1st edition, 1956.

[40]

W. Souder. Managing Relations Between R&D and Marketing in New Product Development Projects. Journal of Product Innovation Management, 5(1), 1988.

[41]

S. Wasserman and K. Faust. Social Network Analysis: Methods and Applications. Cambridge University Press, November 1994.

[42]

T. Zimmermann and N. Nagappan. Predicting defects using network analysis on dependency graphs. In Proc. of the 30th Int. Conf. on Soft. Eng., pages 531-540, May 2008.

Digital Library

Cited By

Schreiber R(2024)Organizational Influence on Security Development in Open-Source Software ProjectsInternational Journal of Systems and Software Security and Protection10.4018/IJSSSP.35665915:1(1-20)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.4018/IJSSSP.356659
Weeraddana NAlfadel MMcIntosh S(2024)Dependency-Induced Waste in Continuous Integration: An Empirical Study of Unused Dependencies in the npm EcosystemProceedings of the ACM on Software Engineering10.1145/36608231:FSE(2632-2655)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3660823
Fallahzadeh EBavand ARigby PChandra SBlincoe KTonella P(2023)Accelerating Continuous Integration with Parallel Batch TestingProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616255(55-67)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616255
Show More Cited By

Index Terms

Predicting build failures using social network analysis on developer communication
1. General and reference
  1. Cross-computing tools and techniques
    1. Reliability
2. Software and its engineering
  1. Software creation and management
    1. Collaboration in software development
      1. Programming teams
  2. Software organization and properties
    1. Extra-functional properties
      1. Software reliability

Recommendations

Predicting build outcome with developer interaction in Jazz
ICSE '10: Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2

Investigating the human aspect of software development is becoming prominent in current research. Studies found that the misalignment between the social and technical dimensions of software work leads to losses in developer productivity and defects. We ...
Predicting failures with developer networks and social network analysis
SIGSOFT '08/FSE-16: Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering

Software fails and fixing it is expensive. Research in failure prediction has been highly successful at modeling software failures. Few models, however, consider the key cause of failures in software: people. Understanding the structure of developer ...
College students social media use and communication network heterogeneity

This study examined whether and how the usage of social media can influence college students' level of network heterogeneity and how network heterogeneity is associated with levels of bridging/bonding social capital and subjective well-being. In ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '09: Proceedings of the 31st International Conference on Software Engineering

May 2009

643 pages

ISBN:9781424434534

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

IEEE Computer Society

United States

Publication History

Published: 16 May 2009

Check for updates

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
1,492
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schreiber R(2024)Organizational Influence on Security Development in Open-Source Software ProjectsInternational Journal of Systems and Software Security and Protection10.4018/IJSSSP.35665915:1(1-20)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.4018/IJSSSP.356659
Weeraddana NAlfadel MMcIntosh S(2024)Dependency-Induced Waste in Continuous Integration: An Empirical Study of Unused Dependencies in the npm EcosystemProceedings of the ACM on Software Engineering10.1145/36608231:FSE(2632-2655)Online publication date: 12-Jul-2024
https://dl.acm.org/doi/10.1145/3660823
Fallahzadeh EBavand ARigby PChandra SBlincoe KTonella P(2023)Accelerating Continuous Integration with Parallel Batch TestingProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3616255(55-67)Online publication date: 30-Nov-2023
https://dl.acm.org/doi/10.1145/3611643.3616255
Jin XServant F(2023)HybridCISave: A Combined Build and Test Selection Approach in Continuous IntegrationACM Transactions on Software Engineering and Methodology10.1145/357603832:4(1-39)Online publication date: 26-May-2023
https://dl.acm.org/doi/10.1145/3576038
Joblin MEckl BBock TSchmid ASiegmund JApel S(2023)Hierarchical and Hybrid Organizational Structures in Open-source Software Projects: A Longitudinal StudyACM Transactions on Software Engineering and Methodology10.1145/356994932:4(1-29)Online publication date: 26-May-2023
https://dl.acm.org/doi/10.1145/3569949
Liu BZhang HMa WLi GLi SShen H(2023)The Why, When, What, and How About Predictive Continuous Integration: A Simulation-Based InvestigationIEEE Transactions on Software Engineering10.1109/TSE.2023.333051049:12(5223-5249)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TSE.2023.3330510
Yang YXia XLo DBi TGrundy JYang X(2022)Predictive Models in Software Engineering: Challenges and OpportunitiesACM Transactions on Software Engineering and Methodology10.1145/350350931:3(1-72)Online publication date: 9-Apr-2022
https://dl.acm.org/doi/10.1145/3503509
Wang YLiu YCui WTang JZhang HWalston DZhang D(2021)Returning to the Office During the COVID-19 Pandemic Recovery: Early Indicators from ChinaExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451685(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451685
Dey TMousavi SPonce EFry TVasilescu BFilippova AMockus A(2020)Detecting and Characterizing Bots that Commit CodeProceedings of the 17th International Conference on Mining Software Repositories10.1145/3379597.3387478(209-219)Online publication date: 29-Jun-2020
https://dl.acm.org/doi/10.1145/3379597.3387478
Jin XServant FRothermel GBae D(2020)A cost-efficient approach to building in continuous integrationProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380437(13-25)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380437
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents