Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Improving New Users’ Query Performance: Deterring Premature Stopping of Query Revision with Information for Forming Ex Ante Expectations

Published: 01 September 2012 Publication History

Abstract

As the volume of data in organizational databases grows, organizations are seeking to use this data to improve organizational success. To this end, users are being asked to query these databases to provide information to help answer questions posed by key management personnel. Users who have had extensive experience with an organization’s data can often detect the presence of errors in their queries when query results do not correspond to their ex ante expectations. New users, however, are less familiar with the data they will be querying. Having no, or limited, ex ante expectations for query results, new users may be unaware that the result produced by their query is incorrect. Unwarranted confidence in the correctness of their queries predisposes these users to stop looking for query errors even when their queries still contain errors. This behavior, premature stopping of query revision, prompts investigating whether new users’ query performance would improve if they were not only provided with, but used, readily available information to form ex ante expectations. Our results demonstrated a threshold effect in new users heeding information for forming ex ante expectations. That is, the mere availability of information for forming ex ante expectations made no difference in query performance. When admonishing users to heed ex ante information, however, there was an associated increase in the accuracy of their queries. These results suggest that users unfamiliar with a particular database might make fewer query errors if they not only received readily available information but were then prompted to use the information to form ex ante expectations for query results.

References

[1]
Ballou, D. P. and Pazer, H. L. 1990. A framework for the analysis of error in conjunctive, multi--criteria, satisficing decision processes. Decision Sci. 21, 752--770.
[2]
Ballou, D. P. and Tayi, G. K. 1999. Enhancing data quality in data warehouse environments. Comm. ACM 42, 73--78.
[3]
Biros, D. P., George, J. F., and Zmud, R. W. 2002. Inducing sensitivity to deception in order to improve decision making performance: A field study. MIS Quart. 26, 119--144.
[4]
Borthick, A. F., Bowen, P. L., Jones, D. R., and Tse, M. H. K. 2001. The effects of information request ambiguity and construct incongruence on query development. Decision Supp. Syst. 32, 3--25.
[5]
Brass, S. and Goldberg, G. 2006. Semantic errors in SQL queries: A quite complete list. The J. Syst. Softw. 79, 630--644.
[6]
Connolly, T. and Gilani, N. 1982. Information search in judgment tasks: A regression model and some preliminary findings. Organ. Behav. Hum. Decision Perform. 30, 330--350.
[7]
Cooper, B. L., Watson, H. J., Wixom, B. H., and Goodhue, D. L. 2000. Data warehousing supports corporate strategy at First American Corporation. MIS Quart. 24, 547--567.
[8]
Festinger, L. 1957. A Theory of Cognitive Dissonance. Row, Peterson and Company, Evanston, IL.
[9]
Fisher, C. W., Chengalur--Smith, I., and Ballou, D. P. 2003. The impact of experience and time on the use of data quality information in decision making. Inf. Syst. Res. 14, 170--188.
[10]
Gigerenzer, G. 2001. The adaptive toolbox: Toward a Darwinian rationality. In Nebraska Symposium on Motivation, vol. 47, 113--143.
[11]
Halstead, M. H. 1977. Elements of Software Science. Elsevier, Amsterdam.
[12]
Hill, M. and Barnes, W. 2011. End--user computing applications. CPA J., 67--71.
[13]
Kahan, J., Rapoport, A., and Jones, L. 1967. Decision making in a sequential search task. Percept. Psychophysics 2, 374--376.
[14]
Klein, B. D., Goodhue, D. L., and Davis, G. B. 1997. Can humans detect errors in data? Impact of base rates, incentives, and goals. MIS Quart. 21, 169--194.
[15]
Mehle, T. 1982. Hypothesis generation in an automobile malfunction inference task. Acta Psychol. 52, 87--106.
[16]
Montgomery, D. C. 1984. Design and Analysis of Experiments. John Wiley and Sons, New York.
[17]
Rapoport, A. and Tversky, A. 1970. Choice behavior in an optional stopping task. Organiz. Behav. Hum. Perform. 5, 105--120.
[18]
Ribeiro, R. A. and Moreira, A. M. 2003. Fuzzy query interface for a business database. Int. J. Hum.-Comput. Studies 58, 363--391.
[19]
Ricketts, J. A. 1990. Powers--of--ten information biases. MIS Quart. 14, 63--77.
[20]
Roy, M. C. and Lerch, F. J. 1996. Overcoming ineffective mental representations in base--rate problems. Infor. Syst. Res. 7, 233--247.
[21]
Smelcer, J. B. 1995. User errors in database query composition. Int. J. Hum.--Comput. Studies 42, 353--381.
[22]
Tabachnick, B. and Fidell, L. 2001. Using Multivariate Statistics. Allyn and Bacon, Boston, MA.
[23]
Wixom, B. and Watson, H. 2001. An empirical investigation of the success factors for data warehousing. MIS Quart. 25, 17--41.

Cited By

View all
  • (2017)A Static Code Smell Detector for SQL Queries Embedded in Java Code2017 IEEE 17th International Working Conference on Source Code Analysis and Manipulation (SCAM)10.1109/SCAM.2017.19(147-152)Online publication date: Sep-2017

Recommendations

Reviews

Dimitrios Zissis

We have all asked questions in our daily conversations for which we have received unexpected or wrong responses. This is not uncommon in the digital world either, even when related to forming queries for databases. Formulating a correct database query is a complex and challenging issue even for experienced users. Furthermore, even a syntactically correct query may return unreasonable results, due to undetected conceptual errors in the formation of the query. Experienced users always validate these results against their knowledge of the field. A problem arises when novice users formulate queries that are syntactically correct, but may return unexpected data, because they lack the prior knowledge to validate the results. This paper explores the benefits and drawbacks of supplying these users with the prior information required to form ex ante expectations of query results. The authors experiment with providing users not only with prior period information, but also with engaging messages on how to make use of that information to validate their results. It is interesting that, according to the authors' findings, the mere availability of information for forming ex ante expectations led to no difference in query information. Users seem to ignore information without encouragement and engaging messages. To assess the reasonableness of their results, the authors conducted a series of interesting experiments, which suggest that new users of databases might make fewer errors not only if they receive prior period information, but also if they are encouraged to use the information to form ex ante expectations for query results. In my opinion, this paper presents a comprehensive and sound statement with wider implications beyond training users to query databases. User training is a critical issue to the success of all software, especially in business environments. According to these findings, user training that is designed with interventions and encouraging, engaging messages is less likely to be ignored by users. This is a well-written paper and the authors are obviously experts on the issue. I would recommend it to anyone designing user training or user interfaces. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Data and Information Quality
Journal of Data and Information Quality  Volume 3, Issue 4
September 2012
40 pages
ISSN:1936-1955
EISSN:1936-1963
DOI:10.1145/2348828
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2012
Accepted: 01 June 2012
Revised: 01 May 2012
Received: 01 June 2010
Published in JDIQ Volume 3, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Confidence
  2. database querying
  3. information request
  4. query accuracy
  5. stopping rule
  6. threshold effect

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2017)A Static Code Smell Detector for SQL Queries Embedded in Java Code2017 IEEE 17th International Working Conference on Source Code Analysis and Manipulation (SCAM)10.1109/SCAM.2017.19(147-152)Online publication date: Sep-2017

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media