Article

High quality behavioral verification using statistical stopping criteria

Authors:

A. Hajjar,

T. Chen,

I. Munn,

A. Andrews,

M. BjorkmanAuthors Info & Claims

DATE '01: Proceedings of the conference on Design, automation and test in Europe

Pages 411 - 419

Published: 13 March 2001 Publication History

Get Access

References

[1]

B. Barrera, "Code coverage analysis-essential to a safe design", Electronic Engineering, pp 41-44, November 1998

Google Scholar

[2]

T. Boyle, M. Abrahams, "Measuring ASIC test coverage", Electronic Product Design, pp 41-42, October 1996

Google Scholar

[3]

M. Abrahams, S. Riches, "Optimize ASIC test suites using code-coverage analysis", EDN, pp 149-152, May 1998

Google Scholar

[4]

B. Dickinson, S. Shaw, "Software techniques applied to VHDL design", New Electronics, n9, pp 63-65, May 1995

Google Scholar

[5]

J. Lipman, "Covering your HDL chip-design bets", EDN, pp 65-70, October 1998

Google Scholar

[6]

J. Gately, "Verifying a million gate processor", Integrated System Design, pp 19-24, 1997

Google Scholar

[7]

S. Gokhale, K. Trivedi, "Log-logistic software reliability growth model", University of California, pp 34-41, 1998

Digital Library

Google Scholar

[8]

A. Goel, "Software reliability models: assumptions, limitations, and applicability", Software Eng., v SE-11, n 12, pp 1411-1423, Dec. 1985

Digital Library

Google Scholar

[9]

W. Howden, "Confidence-based reliability and statistical coverage estimation", ISSRE'97, pp 283-291, Nov. 1997

Digital Library

Google Scholar

[10]

W. Howden, "Systems testing and statistical test data coverage", COMPSAC, pp 500-505, Aug. 1997

Digital Library

Google Scholar

[11]

S. Chen, S. Mills, "A binary Markov process model for random testing", Software Eng., v22, n3, pp 218-223, 1996

Digital Library

Google Scholar

[12]

S. Dalal, C. Mallows, "When should one stop testing software?", Journal of the Ameri can Statistical Association, v 83, n 403, pp 872-879, September 1998

Google Scholar

[13]

M. Sahinoglu, "Compound Poisson software reliability model", Software Eng., v18, n7, pp 624-630, July 1992

Digital Library

Google Scholar

[14]

A. von Mayrhauser, et. al., "On choosing test criteria for behavioral level hardware design verification", HLDVT'00, Berkeley, CA, Nov. 2000.

Digital Library

Google Scholar

[15]

D. Mills, "On the statistical validation of computer programs", IBM FSD, Report FSC-72-6015, 1972.

Google Scholar

[16]

J. Musa, "A theory of software reliability and its application", Software Eng. SE-1(3), pp 312-27, 1975

Digital Library

Google Scholar

[17]

M. Sahinoglu, et. al., "On the efficiency of a compound Poisson stopping rule for mixed strategy testing", IEEE Aerospace, Track#7, March 1999

Google Scholar

[18]

M. Sahinoglu, U. Can, "Alternative parameter estimation methods for the compound Poisson software reliability model with clustered failure data", Software Testing, Veri., and Rel., v7, pp 35-57, 1997

Crossref

Google Scholar

[19]

P. Randolph, M. Sahinoglu, "A stopping rule for a compound Poisson random variable", Applied Stochastic Models and Data Analysis, v11, pp 135-143, 1995

Crossref

Google Scholar

[20]

R. Ferguson, B. Korel, "Generating test data for distributed software using the chaining approach", Information and Software Tech., v38, n5, pp 343-353, 1996

Digital Library

Google Scholar

[21]

T. Chen, I. Munn, A. von Mayrhauser, A. Hajjar, "Efficient verification of behavioral models using the sequential sampling technique", VLSI'99, Brazil, 1999

Digital Library

Google Scholar

[22]

J. Musa, et. al., Software reliability: measurement, prediction, application, McGraw-Hill, 1987.

Digital Library

Google Scholar

[23]

T. Chen, et. al., "Achieving the quality for behavioral models with minimum effort", ISQED'00, pp, March 2000

Digital Library

Google Scholar

[24]

T. Chen, M. Sahinoglu, A. von Mayrhauser, A. Hajjar, Ch. Anderson, "How much testing is enough? Applying stop-ping rules to behavioral model testing", HASE'99, Washing-ton, DC, pp 249-256, Nov. 1999

Digital Library

Google Scholar

[25]

A. Hajjar, T. Chen, A. von Mayrhauser, "On statistical Behavior of Branch Coverage in Testing Behavioral VHDL Models", IEEE HLDVT'00, Nov 2000.

Digital Library

Google Scholar

[26]

A. Hajjar, "Bayesian based stopping rules for behavioral VHDL verification", PhD Dissertation, Electrical Eng. Dept., Colorado State Univ., 2000

Google Scholar

Cited By

View all

Tramontana PAmalfitano DAmatucci NMemon AFasolino A(2019)Developing and Evaluating Objective Termination Criteria for Random TestingACM Transactions on Software Engineering and Methodology10.1145/333983628:3(1-52)Online publication date: 18-Jul-2019
https://dl.acm.org/doi/10.1145/3339836
Gal RKermany ESaleh BZiv ABehm MHickerson B(2017)Template Aware CoverageProceedings of the 54th Annual Design Automation Conference 201710.1145/3061639.3062324(1-6)Online publication date: 18-Jun-2017
https://dl.acm.org/doi/10.1145/3061639.3062324
Birnbaum AFournier LMittermaier SZiv A(2011)Reverse coverage analysisProceedings of the 7th international Haifa Verification conference on Hardware and Software: verification and testing10.1007/978-3-642-34188-5_17(190-202)Online publication date: 6-Dec-2011
https://dl.acm.org/doi/10.1007/978-3-642-34188-5_17
Show More Cited By

Index Terms

High quality behavioral verification using statistical stopping criteria
1. Hardware
  1. Hardware validation
    1. Functional verification
2. Mathematics of computing
  1. Probability and statistics
    1. Distribution functions

Recommendations

Improving The Efficiency and Quality of Simulation-Based Behavioral Model Verification Using Dynamic Bayesian Criteria
ISQED '02: Proceedings of the 3rd International Symposium on Quality Electronic Design

In order to improve the effectiveness of simulation-based behavioral verification, it is important to determine when to stop the current test strategy and to switch to an expectantly more rewarding test strategy. The location of a stopping point is ...
On statistical behavior of branch coverage in testing behavioral VHDL models
HLDVT '00: Proceedings of the IEEE International High-Level Validation and Test Workshop (HLDVT'00)

During behavioral model verification, it is important to determine the stopping point for the current test strategy and for moving to a different test strategy. It has been shown that the location of the stopping point is highly dependent on the ...
An Accurate Coverage Forecasting Model for Behavioral Model Verification
DELTA '02: Proceedings of the The First IEEE International Workshop on Electronic Design, Test and Applications (DELTA '02)

Statistically forecasting potential returns in terms of code coverage for a given set of test cases (patterns) to be applied to a behavioral model can improve the overall effectiveness of behavioral model verification. In this paper, we present a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

DATE '01: Proceedings of the conference on Design, automation and test in Europe

March 2001

756 pages

ISBN:0769509932

Editors:
Wolfgang Nebel
Oldenburg Univ. and OFFIS, Germany
,
Ahmed Jerraya
TIMA, Grenoble, France

Publisher

IEEE Press

Publication History

Published: 13 March 2001

Check for updates

Author Tags

Qualifiers

Article

Conference

DATE01

Sponsor:

EDAA
IFIP WG 10.5
EDAC
SIGDA
IEEE-CS\TTTC
IEEE-CS\DATC
The Russian Academy of Sciences

DATE01: Design, Automation and Test in Europe

Munich, Germany

Acceptance Rates

Overall Acceptance Rate 518 of 1,794 submissions, 29%

Upcoming Conference

DATE '25

Sponsor:
sigda

Design, Automation and Test in Europe

March 31 - April 2, 2025

Lyon , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
195
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tramontana PAmalfitano DAmatucci NMemon AFasolino A(2019)Developing and Evaluating Objective Termination Criteria for Random TestingACM Transactions on Software Engineering and Methodology10.1145/333983628:3(1-52)Online publication date: 18-Jul-2019
https://dl.acm.org/doi/10.1145/3339836
Gal RKermany ESaleh BZiv ABehm MHickerson B(2017)Template Aware CoverageProceedings of the 54th Annual Design Automation Conference 201710.1145/3061639.3062324(1-6)Online publication date: 18-Jun-2017
https://dl.acm.org/doi/10.1145/3061639.3062324
Birnbaum AFournier LMittermaier SZiv A(2011)Reverse coverage analysisProceedings of the 7th international Haifa Verification conference on Hardware and Software: verification and testing10.1007/978-3-642-34188-5_17(190-202)Online publication date: 6-Dec-2011
https://dl.acm.org/doi/10.1007/978-3-642-34188-5_17
Azatchi HFournier LMarcus EUr SZiv AZohar K(2006)Advanced Analysis Techniques for Cross-Product CoverageIEEE Transactions on Computers10.1109/TC.2006.17355:11(1367-1379)Online publication date: 1-Nov-2006
https://dl.acm.org/doi/10.1109/TC.2006.173
Lachish OMarcus EUr SZiv AAckland B(2002)Hole analysis for functional coverage dataProceedings of the 39th annual Design Automation Conference10.1145/513918.514119(807-812)Online publication date: 10-Jun-2002
https://dl.acm.org/doi/10.1145/513918.514119

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Improving The Efficiency and Quality of Simulation-Based Behavioral Model Verification Using Dynamic Bayesian Criteria

On statistical behavior of branch coverage in testing behavioral VHDL models

An Accurate Coverage Forecasting Model for Behavioral Model Verification