Article

Free access

Active learning using adaptive resampling

Authors:

Vijay S. Iyengar,

Chidanand Apte,

Tong ZhangAuthors Info & Claims

KDD '00: Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining

Pages 91 - 98

https://doi.org/10.1145/347090.347110

Published: 01 August 2000 Publication History

PDF eReader

References

[1]

N. Abe and H. Mamitsuka. Query learning strategies using boosting and bagging. In Proceedings of the International Conference on Machine Learning, pages 1-9, 1998.

Digital Library

Google Scholar

[2]

D. Angluin. Queries and concept learning. Machine Learning, 2(4):319-342, 1988.

Crossref

Google Scholar

[3]

C. Apte, F. Damerau, and S. Weiss. Automated learning of decision rules for text categorization. ACM Transactions on Information Systems, 12(3):233-251, July 1994.

Digital Library

Google Scholar

[4]

E. Bauer and R. Kohavi. An empirical comparison of voting classifiucation algorithms: Bagging, boosting, and variants. Machine Learning, 36:105-142, 1999.

Digital Library

Google Scholar

[5]

M. Berry and G. Lino. Data Mining Techniques: For Marketing, Sales, and Customer Support. John Wiley and Sons, Inc., 1997.

Digital Library

Google Scholar

[6]

C. Blake, E. Keogh, and C. Merz. UCI repository of machine learning databases. University of California, Irvine, Dept. of Information and Computer Science, URL=http://www.ics.uci.edu/ mlearn/- MLRespository.html, 1998.

Google Scholar

[7]

L. Breiman. Arcing classifiers. The Annals of Statistics, 26(3):801-849, 1998.

Crossref

Google Scholar

[8]

W. Cochran. Sampling Techniques. John Wiley and Sons, Inc., 1977.

Google Scholar

[9]

D. Cohn, L. Atlas, and R.Ladner. Training connectionist networks with queries and selective sampling. In Advances in Neural Information Processing Systems 2. Morgan Kaufmann, 1990.

Digital Library

Google Scholar

[10]

D. Cohn, L. Atlas, and R.Ladner. Improved generalization with active learning. Machine Learning, 15:201-221, 1994.

Digital Library

Google Scholar

[11]

D. Cohn, Z. Ghahramani, and M. Jordan. Active learning with statistical models. Journal of Artificial Intelligence Research, 4:129-145, 1996.

Digital Library

Google Scholar

[12]

D. Cohn, Z. Ghahramani, and M. Jordan. Active learning with mixture models. In Multiple model approaches to modeling and control. Taylor and Francis, 1997.

Google Scholar

[13]

T. G. Dietterich. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting and randomization. Machine Learning, 40(2), August 2000.

Digital Library

Google Scholar

[14]

Y. Freund. Sifting informative examples from a random source. In Advances in Neural Information Processing, pages 85-89, 1994.

Google Scholar

[15]

Y. Freund and R. Schapire. Experiments with a new boosting algorithm. In Proceedings of the International Conference on Machine Learning, pages 148-156. Morgan Kaufmann, 1996.

Digital Library

Google Scholar

[16]

Y. Freund, H. Seung, E. Shamir, and N. Tishby. Information, prediction, and query by committee. In Advances in Neural Information Processing Systems 5, pages 337-344. Morgan Kaufmann, 1992.

Digital Library

Google Scholar

[17]

Y. Freund, H. Seung, E. Shamir, and N. Tishby. Selective sampling using the query by committee algorithm. Machine Learning, 28:133-168, 1997.

Digital Library

Google Scholar

[18]

J. Friedman, T. Hastie, and R. Tibshirani. Additive logistic regression: A statistical view of boosting. Technical Report Technical Report, Stanford University, Dept. of Statistics, July 1998.

Google Scholar

[19]

N. Kushmerick. Learning to remove internet advertisements. In Proceedings of the Third International Conference onAutonomous Agents, pages 175-181, 1999.

Digital Library

Google Scholar

[20]

D. Lewis. Reuters 21578 data set. URL=http://www.research.att.com/lewis/- reuters21578.html.

Google Scholar

[21]

D. Lewis and J. Catlett. Heterogeneous uncertainty sampling for supervised learning. In Proceedings of the Eleventh International Conference onMachine Learning, pages 148-156, 1994.

Digital Library

Google Scholar

[22]

D. Lewis and W. Gale. A sequential algorithm for training text classifiers. In Proceedings of the Seventeenth Annual ACM-SIGR Conference on Research and Development in Information Retrieval, pages 3-12, 1994.

Digital Library

Google Scholar

[23]

R. Liere and P. Tadepalli. Active learning with committees for text categorization. In Proceedings of the Fourteenth National Conference on Artificial Intelligence, pages 591-596, 1997.

Digital Library

Google Scholar

[24]

A. McCallum and K. Nigam. Employing em in pool-based active learning for text classification. In Proceedings of the Fifteenth International Conference on Machine Learning, pages 350-358, 1998.

Digital Library

Google Scholar

[25]

F. Provost, D. Jensen, and T. Oates. Efficient progressive sampling. In Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data mining, pages 23-32, 1999.

Digital Library

Google Scholar

[26]

R. Schapire, Y. Freund, P. Bartlett, and W. Lee. Boosting the margin: A new explanation for the effectiveness of voting methods. The Annals of Statistics, 26(5):1651-1686, 1998.

Crossref

Google Scholar

[27]

H. Seung, M. Opper, and H. Sompolinsky. Query by committee. In Proceedings of the Fifth ACM Workshop on Computational Learning Theory, pages 287-294, 1992.

Digital Library

Google Scholar

[28]

S. Weiss, C. Apte, F. Damerau, D. Johnson, F. Oles, T. Goetz, and T. Hampp. Maximizing text-mining performance. IEEE Intelligent Systems and their applications, 14(4):63-69, July/August 1999.

Digital Library

Google Scholar

[29]

S. Weiss and N. Indurkhya. Data-miner software kit (DMSK). URL=http://www.data-miner.com, 1998.

Google Scholar

[30]

S. M. Weiss and C. A. Kulikowski. Computer Systems that Learn. Morgan Kaufmann, 1991.

Digital Library

Google Scholar

[31]

Y. Yang and J. Pedersen. A comparitive study on feature selection in text categorization. In ICML'97, Proceedings of the Fourteenth International Conference on Machine Learning, pages 412-420, 1997.

Digital Library

Google Scholar

Cited By

View all

Karl Ferdinand Loder A(2023)Predicting the Number of “Active” Students: A Method for Preventive University ManagementJournal of College Student Retention: Research, Theory & Practice10.1177/15210251231201394Online publication date: 14-Sep-2023
https://doi.org/10.1177/15210251231201394
Wu YLi XZhang XKang YSun CLiu XFrommholz IHopfgartner FLee MOakes MLalmas MZhang MSantos R(2023)Community-Based Hierarchical Positive-Unlabeled (PU) Model Fusion for Chronic Disease PredictionProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3614818(2747-2756)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3583780.3614818
Tharwat ASchenck W(2022)A Novel Low-Query-Budget Active Learner with Pseudo-Labels for Imbalanced DataMathematics10.3390/math1007106810:7(1068)Online publication date: 26-Mar-2022
https://doi.org/10.3390/math10071068
Show More Cited By

Index Terms

Active learning using adaptive resampling
1. Computing methodologies
  1. Machine learning
    1. Learning paradigms
      1. Supervised learning
        Supervised learning by classification
    2. Machine learning approaches
      1. Classification and regression trees
2. Information systems
  1. Information systems applications
    1. Data mining

Recommendations

Applying active learning to assertion classification of concepts in clinical text

Supervised machine learning methods for clinical natural language processing (NLP) research require a large number of annotated samples, which are very expensive to build because of the involvement of physicians. Active learning, an approach that ...
Machine learning paradigms for utility-based data mining
UBDM '05: Proceedings of the 1st international workshop on Utility-based data mining

In this talk, I will describe a number of machine learning paradigms that are relevant to utility-based data mining, and review some key techniques and results in each.
Active Learning with Adaptive Heterogeneous Ensembles
ICDM '09: Proceedings of the 2009 Ninth IEEE International Conference on Data Mining

One common approach to active learning is to iteratively train a single classifier by choosing data points based on its uncertainty, but it is nontrivial to design uncertainty measures unbiased by the choice of classifier. Query by committee suggests ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

KDD '00: Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining

August 2000

537 pages

ISBN:1581132336

DOI:10.1145/347090

Chairmen:
Raghu Ramakrishnan
Univ. of Wisconsin
,
Sal Stolfo
Columbia Univ., New York, NY
,
Roberto Bayardo
IBM Almaden Research Center, San Jose, CA
,
Ismail Parsa
Epsilon

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

KDD00

Sponsor:

KDD00: The Second Annual International Conference on Knowledge Discovery in Data

August 20 - 23, 2000

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
1,494
Total Downloads

Downloads (Last 12 months)163
Downloads (Last 6 weeks)25

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Karl Ferdinand Loder A(2023)Predicting the Number of “Active” Students: A Method for Preventive University ManagementJournal of College Student Retention: Research, Theory & Practice10.1177/15210251231201394Online publication date: 14-Sep-2023
https://doi.org/10.1177/15210251231201394
Wu YLi XZhang XKang YSun CLiu XFrommholz IHopfgartner FLee MOakes MLalmas MZhang MSantos R(2023)Community-Based Hierarchical Positive-Unlabeled (PU) Model Fusion for Chronic Disease PredictionProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3614818(2747-2756)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3583780.3614818
Tharwat ASchenck W(2022)A Novel Low-Query-Budget Active Learner with Pseudo-Labels for Imbalanced DataMathematics10.3390/math1007106810:7(1068)Online publication date: 26-Mar-2022
https://doi.org/10.3390/math10071068
Kyeremeh FZhi FYi YGyamfi ENti I(2022)Solar PV Power Forecasting with a Hybrid LSTM-AdaBoost Ensemble2022 IEEE/IET International Utility Conference and Exposition (IUCE)10.1109/IUCE55902.2022.10079424(1-7)Online publication date: 3-Nov-2022
https://doi.org/10.1109/IUCE55902.2022.10079424
Alizadeh ASinghal MBehzadan VTavallali PRanganath A(2022)Stochastic Induction of Decision Trees with Application to Learning Haar Trees2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA55696.2022.00137(825-830)Online publication date: Dec-2022
https://doi.org/10.1109/ICMLA55696.2022.00137
Ben Hamida SHmida HBorgi ARukoz M(2021)Adaptive sampling for active learning with genetic programmingCognitive Systems Research10.1016/j.cogsys.2020.08.00865(23-39)Online publication date: Jan-2021
https://doi.org/10.1016/j.cogsys.2020.08.008
Lu WMa CLi P(2020)Research on Sample Selection of Urban Rail Transit Passenger Flow Forecasting Based on SCBP AlgorithmIEEE Access10.1109/ACCESS.2020.29935958(89425-89438)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2993595
Tharwat ASchenck W(2020)Balancing Exploration and Exploitation: A novel active learner for imbalanced dataKnowledge-Based Systems10.1016/j.knosys.2020.106500210(106500)Online publication date: Dec-2020
https://doi.org/10.1016/j.knosys.2020.106500
Kalaivani KMaheswari N(2017)Predicting disease using information integration platform for large data2017 International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS)10.1109/ICECDS.2017.8389581(971-975)Online publication date: Aug-2017
https://doi.org/10.1109/ICECDS.2017.8389581
Kim HRoh JLee HKim GLee SLee MOmori TOsawa HPark HYoung J(2015)Active Learning for Large-scale Object ClassificationProceedings of the 3rd International Conference on Human-Agent Interaction10.1145/2814940.2814989(251-254)Online publication date: 21-Oct-2015
https://dl.acm.org/doi/10.1145/2814940.2814989
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Applying active learning to assertion classification of concepts in clinical text

Machine learning paradigms for utility-based data mining

Active Learning with Adaptive Heterogeneous Ensembles