Article

Free access

An interactive system for recognizing hand drawn UML diagrams

Authors:

Jeb S. Thorley,

Sean Jy-Shyang ChenAuthors Info & Claims

CASCON '00: Proceedings of the 2000 conference of the Centre for Advanced Studies on Collaborative research

Page 7

Published: 13 November 2000 Publication History

Abstract

Diagrams are widely used by software engineers to capture the structure and organization of software systems. The Unified Modeling Language (UML) is a commonly-used notation for such diagrams. We have designed and implemented a system for the on-line recognition of hand drawn UML diagrams. Input comes from an electronic whiteboard, a mouse, or a data tablet. A sophisticated segmentation algorithm groups pen strokes into symbols, coping with drawing inaccuracies that are common in hand drawn input. The system is organized around a retargetable kernel which provides a general front end for on-line recognition of any iconic notation. The kernel is extended with UML specific enhancements to segmentation, as well as UML specific glyph recognizers. A simple and intuitive graphical user interface allows the user to correct segmentation and recognition errors. Relatively messy freehand UML drawings are interpreted properly.

References

[1]

{1} J. Arvo. Caltech interface tools (cit). www.cs.caltech.edu/~arvo/software.html.]]

[2]

{2} J. Arvo. Computer Aided Serendipity: The Role of Autonomous Assistants in Problem Solving. In Proceedings f Graphics Interface '99, pages 183-192, Kingston, Ontario, Canada, 1999.]]

Digital Library

[3]

{3} J. Arvo and K. Novins. Fluid sketches: Continuous recognition and morphing of simple hand-drawn shapes. Submitted to 13th Annual ACM Symposium on User Interface Software and Technology.]]

Digital Library

[4]

{4} J. Arvo and K. Novins. Smart Text: A Synthesis of Recongnition and Morphing. In AAAI Spring Symposium on Smart Graphics, pages 140-147, Stanford, California, USA, 2000.]]

[5]

{5} L. Chen and P. Yin. A System for On-line Recognition of Handwritten Mathematical Expressions. Computer Processing of Chinese and Oriental Languages, pages 19-39, June 1992.]]

[6]

{6} Michael Thomsen Christian Heide Damm, Klaus Marius Hansen and Michael Tyrsted. The knight project. www.daimi.au.dk/~knight/.]]

[7]

{7} W. Citrin and M. D. Gross. Distributed Architectures for Pen-Based Input and Diagram Recognition. In ACM Conference on Advanced Visual Interfaces '96, 1996.]]

Digital Library

[8]

{8} E Do and M. D. Gross. Thinking with diagrams in architectural design. www.mrccbu.cam.ac.uk/projects/twd/discussion-papers/architecture.html.]]

[9]

{9} J. Rumbaugh G. Booch and I. Jacobson. The Unified Modeling Language User Guide. Addison-Wesley, 1998.]]

Digital Library

[10]

{10} D. Elliman G. Hutton, M. Cripps and C. Higgins. A Strategy for On-line Interpretation of Sketched Engineering Drawings. In Fourth International Conference on Document Analysis and Recognition, pages 771-775, Ulm, Germany, 1997.]]

Digital Library

[11]

{11} G. Goldman and S Zdepski. Grids in Design and CAD. In Proceedings ACADIA 91 - Reality and Virtual Reality, pages 33-43, Los Angles, California, USA, 1991.]]

[12]

{12} G. Goldman and S Zdepski. Grids in Design and CAD. In Proceedings ACADIA '91 - Reality and Virtual Reality, pages 33-43, Los Angles, California, USA, 1991.]]

[13]

{13} M. D. Gross. Why can't cad be more like lego? Automation in Construction Journal, 1996.]]

[14]

{14} J. A. Jorge and M. J. Fonseca. A Simple Approach to Recognise Geometric Shapes Interactively. In 3rd IAPR International Workshop on Graphics Recognition, GREC'99, Jaipur, India, 1999.]]

Digital Library

[15]

{15} H. Kojima and T. Toida. On-line Hand-drawn Line-figure Recognition and its Application. In 9th Intl. Conf. on Pattern Recognition, pages 1138-1142, Rome, Italy, 1988.]]

[16]

{16} A. Kosmala and G. Rigoll. Recognition of On-Line Handwritten Formulas. In 6th International Workshop on Frontiers in Handwriting Recognition, pages 219-228, Taejon, Korea, 1998.]]

[17]

{17} Edward Lank. Describing diagram recognition systems. available at www.cs.queensu.ca/~lank/dr.process.ps.gz.]]

[18]

{18} R. Pooley and P. Stevens. Using UML - Software Engineering with Objects and Components. Addison-Wesley, 1998.]]

Digital Library

[19]

{19} K. Novins S. Smithies and J. Arvo. A Handwriting-Based Equation Editor. In Proceedings f Graphics Interface '99, pages 84-91, Kingston, Ontario, Canada, 1999.]]

Digital Library

[20]

{20} M. V. Stückelberg and D. Doermann. On Musical Score Recognition using Probabilistic Reasoning. In 5th International Conference on Document Analysis and Recognition, pages 115-118, Bangalore, India, 1999.]]

Digital Library

[21]

{21} E. Valveny and E. Martí. Application of Deformable Template Matching to Symbol Recognition in Hand-written Architectural Drawings. In 5th International Conference on Document Analysis and Recognition, pages 483-486, Bangalore, India, 1999.]]

Digital Library

[22]

{22} J. Coronado Y. Dimitriadis and C. de la Maza. A New Interactive Mathematical Editor, Using On-line Handwritten Symbol Recognition, and Error Detection-Correction with an Attribute Grammar. In First International Conference on Document Analysis and Recognition, pages 242-250, Saint Malo, France, 1991.]]

[23]

{23} R. Zannibbi. Recognition of mathematics notation via computer using baseline structure. Master's thesis, Queen's University, 2000.]]

Cited By

Antal GVozár RFerenc R(2024)Toward a New Era of Rapid Development: Assessing GPT-4-Vision's Capabilities in UML-Based Code GenerationProceedings of the 1st International Workshop on Large Language Models for Code10.1145/3643795.3648391(84-87)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3643795.3648391
Zarwin ZSottet JFavre J(2012)Natural modelingProceedings of the 2012 Extreme Modeling Workshop10.1145/2467307.2467309(3-8)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.1145/2467307.2467309
Blagojevic RPlimmer BGrundy JWang Y(2011)Technical SectionComputers and Graphics10.1016/j.cag.2011.07.00235:5(976-991)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.cag.2011.07.002
Show More Cited By

Recommendations

Model Checking UML Activity Diagrams in FDR
ICIS '09: Proceedings of the 2009 Eigth IEEE/ACIS International Conference on Computer and Information Science

The Unified Modeling Language (UML) is the de-facto industrial standard for modeling object-oriented software systems. UML Activity diagrams (ADs) can be used for software modeling and they have under gone significant changes with UML 2.0 specification, ...
Offline text and non-text segmentation for hand-drawn diagrams
PRICAI'16: Proceedings of the 14th Pacific Rim International Conference on Trends in Artificial Intelligence

Writing and drawing are basic forms of human communication. Handwritten and hand-drawn documents are often used at initial stages of a project. For storage and later usage, handwritten documents are often converted into a digital format with a graphics ...
Formalization of UML diagrams and their consistency verification: A Z notation based approach
ISEC '08: Proceedings of the 1st India software engineering conference

In this paper, we have suggested a methodology for formalizing some of the commonly used UML diagrams that are used in different phases of software development in Z notation, establish their relationship and then represent the "formalized" diagrams ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

CASCON '00: Proceedings of the 2000 conference of the Centre for Advanced Studies on Collaborative research

November 2000

227 pages

Sponsors

IBM Canada: IBM Canada
NRC: National Research Council - Canada

Publisher

IBM Press

Publication History

Published: 13 November 2000

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 24 of 90 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
1,313
Total Downloads

Downloads (Last 12 months)129
Downloads (Last 6 weeks)14

Reflects downloads up to 30 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Antal GVozár RFerenc R(2024)Toward a New Era of Rapid Development: Assessing GPT-4-Vision's Capabilities in UML-Based Code GenerationProceedings of the 1st International Workshop on Large Language Models for Code10.1145/3643795.3648391(84-87)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3643795.3648391
Zarwin ZSottet JFavre J(2012)Natural modelingProceedings of the 2012 Extreme Modeling Workshop10.1145/2467307.2467309(3-8)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.1145/2467307.2467309
Blagojevic RPlimmer BGrundy JWang Y(2011)Technical SectionComputers and Graphics10.1016/j.cag.2011.07.00235:5(976-991)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.cag.2011.07.002
Blagojevic RPlimmer BGrundy JWang Y(2010)Building digital ink recognizers using data miningProceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I10.5555/1945758.1945801(358-367)Online publication date: 1-Jun-2010
https://dl.acm.org/doi/10.5555/1945758.1945801
Hammond TDavis RGooch ATory M(2009)Recognizing interspersed sketches quicklyProceedings of Graphics Interface 200910.5555/1555880.1555917(157-166)Online publication date: 25-May-2009
https://dl.acm.org/doi/10.5555/1555880.1555917
Wang TPlimmer BPlimmer B(2009)SmartListProceedings of the 10th International Conference NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction10.1145/1577782.1577793(61-64)Online publication date: 6-Jul-2009
https://dl.acm.org/doi/10.1145/1577782.1577793
Hammond TDavis RMcMains SSloan P(2007)LADDER, a sketching language for user interface developersACM SIGGRAPH 2007 courses10.1145/1281500.1281546(35-es)Online publication date: 5-Aug-2007
https://dl.acm.org/doi/10.1145/1281500.1281546
Hammond TDavis RFinnegan JShreiner D(2006)TahutiACM SIGGRAPH 2006 Courses10.1145/1185657.1185786(25-es)Online publication date: 30-Jul-2006
https://dl.acm.org/doi/10.1145/1185657.1185786
Hammond TDavis R(2005)LADDER, a sketching language for user interface developersComputers and Graphics10.1016/j.cag.2005.05.00529:4(518-532)Online publication date: 1-Aug-2005
https://dl.acm.org/doi/10.1016/j.cag.2005.05.005
Wu JGraham T(2004)The software design boardProceedings of the 2004 international conference on Engineering Human Computer Interaction and Interactive Systems10.1007/11431879_24(363-382)Online publication date: 11-Jul-2004
https://dl.acm.org/doi/10.1007/11431879_24

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents