research-article

Statistical translation of English texts to API code templates

Authors:

Anh Tuan Nguyen,

Peter C. Rigby,

Thanh Van Nguyen,

Tien N. NguyenAuthors Info & Claims

ICSE-C '17: Proceedings of the 39th International Conference on Software Engineering Companion

Pages 331 - 333

https://doi.org/10.1109/ICSE-C.2017.81

Published: 20 May 2017 Publication History

Abstract

We develop T2Api, a context-sensitive, graph-based statistical translation approach that takes as input an English description of a programming task and synthesizes the corresponding API code template for the task. We train T2Api to statistically learn the alignments between English and APIs and determine the relevant API elements. The training is done on StackOverflow, which is a bilingual corpus on which developers discuss programming problems in two types of language: English and programming language. T2Api considers both the context of the words in the input query and the context of API elements that often go together in the corpus. The derived API elements with their relevance scores are assembled into an API usage by GraSyn, our novel graph-based API synthesis algorithm that generates a graph representing an API usage from a large code corpus. Importantly, it is capable of generating new API usages from previously seen sub-usages.

References

[1]

E. Duala-Ekoko and M. P. Robillard, "Asking and answering questions about unfamiliar APIs: An exploratory study," in Proceedings of the 34th International Conference on Software Engineering, ser. ICSE'12. IEEE Press, 2012, pp. 266--276.

Digital Library

[2]

E. Duala-Ekoko and M. P. Robillard, "Using structure-based recommendations to facilitate discoverability in APIs," in Proceedings of the 25th European Conference on Object-oriented Programming, ser. ECOOP'11. Springer-Verlag, 2011, pp. 79--104.

Digital Library

[3]

X. Gu, H. Zhang, D. Zhang, and S. Kim, "Deep API Learning," in Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, ser. FSE 2016. ACM, 2016, pp. 631--642.

Digital Library

[4]

C. McMillan, M. Grechanik, D. Poshyvanyk, Q. Xie, and C. Fu, "Portfolio: Finding relevant functions and their usage," in Proceedings of the 33rd International Conference on Software Engineering, ser. ICSE'11. ACM, 2011, pp. 111--120.

Digital Library

[5]

C. McMillan, D. Poshyvanyk, and M. Grechanik, "Recommending Source Code Examples via API Call Usages and Documentation," in Proceedings of the 2nd International Workshop on Recommendation Systems for Software Engineering, ser. RSSE '10. ACM, 2010, pp. 21--25.

Digital Library

[6]

W. Zheng, Q. Zhang, and M. Lyu, "Cross-library API recommendation using Web search engines," in Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ser. ESEC/FSE '11. ACM, 2011, pp. 480--483.

Digital Library

[7]

W.-K. Chan, H. Cheng, and D. Lo, "Searching Connected API Subgraph via Text Phrases," in Proceedings of the 20th International Symposium on the Foundations of Software Engineering, ser. FSE '12. ACM, 2012, pp. 10:1--10:11.

Digital Library

[8]

R. P. L. Buse and W. Weimer, "Synthesizing API Usage Examples," in Proceedings of the 34th International Conference on Software Engineering, ser. ICSE '12. IEEE Press, 2012, pp. 782--792.

Digital Library

[9]

M. Raghothaman, Y. Wei, and Y. Hamadi, "Swim: Synthesizing what i mean: Code search and idiomatic snippet synthesis," in Proceedings of the 38th International Conference on Software Engineering, ser. ICSE'16. ACM, 2016, pp. 357--367.

Digital Library

[10]

T. Gvero and V. Kuncak, "Synthesizing Java expressions from free-form queries," in Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications, ser. OOPSLA 2015. ACM, 2015, pp. 416--432.

Digital Library

[11]

A. Desai, S. Gulwani, V. Hingorani, N. Jain, A. Karkare, M. Marron, S. R, and S. Roy, "Program synthesis using natural language," in Proceedings of the 38th International Conference on Software Engineering, ser. ICSE'16. ACM, 2016, pp. 345--356.

Digital Library

[12]

A. T. Nguyen and T. N. Nguyen, "Graph-based statistical language model for code," in Proceedings of the 37th International Conference on Software Engineering - Volume 1, ser. ICSE '15. IEEE Press, 2015, pp. 858--868.

Digital Library

[13]

P. F. Brown, V. J. D. Pietra, S. A. D. Pietra, and R. L. Mercer, "The mathematics of statistical machine translation: parameter estimation," Comput. Linguist., vol. 19, no. 2, pp. 263--311, Jun. 1993.

Digital Library

[14]

P. Koehn, F. J. Och, and D. Marcu, "Statistical phrase-based translation," in Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1, ser. NAACL '03. Association for Computational Linguistics, 2003, pp. 48--54.

Digital Library

[15]

T. Nguyen, P. C. Rigby, A. T. Nguyen, M. Karanfil, and T. N. Nguyen, "T2API: Synthesizing API Code Usage Templates from English Texts with Statistical Translation," in Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, ser. FSE 2016. ACM, 2016, pp. 1013--1017.

Digital Library

[16]

"T2APIDemo," https://www.youtube.com/watch?v=Q8Kec6MHGY0&feature=youtu.be.

Cited By

Phan HJannesari A(2022)Heterogeneous Graph Neural Networks for Software Effort EstimationProceedings of the 16th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3544902.3546248(103-113)Online publication date: 19-Sep-2022
https://dl.acm.org/doi/10.1145/3544902.3546248
Lamothe MGuéhéneuc YShang W(2021)A Systematic Review of API Evolution LiteratureACM Computing Surveys10.1145/347013354:8(1-36)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1145/3470133
Zhai JXu XShi YTao GPan MMa SXu LZhang WTan LZhang XRothermel GBae D(2020)CPCProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380427(1359-1371)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380427
Show More Cited By

Recommendations

T2API: synthesizing API code usage templates from English texts with statistical translation
FSE 2016: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering

In this work, we develop T2API, a statistical machine translation-based tool that takes a given English description of a programming task as a query, and synthesizes the API usage template for the task by learning from training data. T2API works in two ...
English to Malayalam translation: a statistical approach
A2CWiC '10: Proceedings of the 1st Amrita ACM-W Celebration on Women in Computing in India

This paper underlines a methodology for translating text from English into the Dravidian language, Malayalam using statistical models. By using a monolingual Malayalam corpus and a bilingual English/Malayalam corpus in the training phase, the machine ...
Orthographic and morphological processing for English---Arabic statistical machine translation

Much of the work on statistical machine translation (SMT) from morphologically rich languages has shown that morphological tokenization and orthographic normalization help improve SMT quality because of the sparsity reduction they contribute. In this ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE-C '17: Proceedings of the 39th International Conference on Software Engineering Companion

May 2017

558 pages

ISBN:9781538615898

General Chair:
Sebastian Uchitel
University of Buenos Aires, Argentina and Imperial College London, UK
,
Program Chairs:
Alessandro Orso
Georgia Institute of Technology
,
Martin Robillard
McGill University, Canada

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS: Computer Society
SADIO: SADIO

Publisher

IEEE Press

Publication History

Published: 20 May 2017

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '17

Sponsor:

SIGSOFT
IEEE-CS
SADIO

ICSE '17: 39th International Conference on Software Engineering

May 20 - 28, 2017

Buenos Aires, Argentina

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
143
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Phan HJannesari A(2022)Heterogeneous Graph Neural Networks for Software Effort EstimationProceedings of the 16th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3544902.3546248(103-113)Online publication date: 19-Sep-2022
https://dl.acm.org/doi/10.1145/3544902.3546248
Lamothe MGuéhéneuc YShang W(2021)A Systematic Review of API Evolution LiteratureACM Computing Surveys10.1145/347013354:8(1-36)Online publication date: 4-Oct-2021
https://dl.acm.org/doi/10.1145/3470133
Zhai JXu XShi YTao GPan MMa SXu LZhang WTan LZhang XRothermel GBae D(2020)CPCProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380427(1359-1371)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380427
Xu XGrundy JLe Goues CLo D(2020)The classification and propagation of program commentsProceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering10.1145/3324884.3418913(1394-1396)Online publication date: 21-Dec-2020
https://dl.acm.org/doi/10.1145/3324884.3418913
Rahman MRigby PPalani DNguyen TStorey MAdams BHaiduc S(2019)Cleaning StackOverflow for machine translationProceedings of the 16th International Conference on Mining Software Repositories10.1109/MSR.2019.00021(79-83)Online publication date: 26-May-2019
https://dl.acm.org/doi/10.1109/MSR.2019.00021
Huang QXia XXing ZLo DWang XHuchard MKästner CFraser G(2018)API method recommendation without worrying about the task-API knowledge gapProceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering10.1145/3238147.3238191(293-304)Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1145/3238147.3238191
Nguyen TTran NPhan HNguyen TTruong LNguyen ANguyen HNguyen TLeavens GGarcia APăsăreanu C(2018)Complementing global and local contexts in representing API descriptions to improve API retrieval tasksProceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3236024.3236036(551-562)Online publication date: 26-Oct-2018
https://dl.acm.org/doi/10.1145/3236024.3236036

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents