Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleNovember 2024
Efficient distributed continual learning for steering experiments in real-time
Future Generation Computer Systems (FGCS), Volume 162, Issue Chttps://doi.org/10.1016/j.future.2024.07.016AbstractDeep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training suffers ...
Highlights- Motivate benefits of rehearsal-based continual learning for scientific applications.
- Define rehearsal buffers and introduce extensions for data-parallel training.
- Present key design principles, including asynchronous buffer ...
- research-articleNovember 2024
Advancing continual lifelong learning in neural information retrieval: Definition, dataset, framework, and empirical evaluation
Information Sciences: an International Journal (ISCI), Volume 687, Issue Chttps://doi.org/10.1016/j.ins.2024.121368AbstractContinual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning methods ...
Highlights- A continual learning framework is proposed and implemented for continuous neural information retrieval tasks.
- A dataset called Topic-MSMARCO, containing diverse topics for continual neural information retrieval tasks, is provided.
- ...
- research-articleNovember 2024
Consistent representation joint adaptive adjustment for incremental zero-shot learning
AbstractZero-shot learning aims to recognize objects from novel concepts through the model trained on seen class data and assisted by the semantic descriptions. Though it breaks the serious reliance on training data, it still fails to deal with the ...
Highlights- We summarize the IZSL challenges as task-recency bias and seen-class bias.
- We propose to learn consistent representation joint an adaptive adjustment strategy.
- The method needs limited memory footprint to store the fixed scale ...
- ArticleNovember 2024
Regularized Continual Learning for Large-Scale Language Models via Probing
Natural Language Processing and Chinese ComputingPages 29–41https://doi.org/10.1007/978-981-97-9437-9_3AbstractThe rapid development of large-scale language models has garnered widespread interest from both academia and industry. Efficiently applying those models across various domains is now posing a challenge to researchers. High training costs and the ...
- research-articleOctober 2024
A Human-Centered View of Continual Learning: Understanding Interactions, Teaching Patterns, and Perceptions of Human Users Toward a Continual Learning Robot in Repeated Interactions
- Ali Ayub,
- Zachary De Francesco,
- Jainish Mehta,
- Khaled Yaakoub Agha,
- Patrick Holthaus,
- Chrystopher L. Nehaniv,
- Kerstin Dautenhahn
ACM Transactions on Human-Robot Interaction (THRI), Volume 13, Issue 4Article No.: 52, Pages 1–39https://doi.org/10.1145/3659110Continual learning (CL) has emerged as an important avenue of research in recent years, at the intersection of Machine Learning (ML) and Human–Robot Interaction (HRI), to allow robots to continually learn in their environments over long-term interactions ...
-
- ArticleNovember 2024
Feature Refinement and Calibration for Continual Visual Search
AbstractContinual visual search has attracted increasing attention due to its practicality. It aims to continuously extract embeddings for new-emerging gallery data while keeping previously generated embeddings unchanged. The primary challenge lies in ...
- research-articleOctober 2024
PackMASNet: An information integration approach for quality inspection in industry 5.0
Expert Systems with Applications: An International Journal (EXWA), Volume 255, Issue PBhttps://doi.org/10.1016/j.eswa.2024.124582AbstractIndustry 5.0 (I5.0) is increasingly governed by Operation Technology and Information Technology. It hosts Deep Learning (DL) solutions as a premier tool for the informatization of Quality Inspection (QI) of Mass Produced Products (MPP) and Mass ...
Highlights- A customer order-driven informatization framework for mass-customized products.
- A hybrid PackMASNet scheme that minimizes mass-produced and customized products’ performance degradation.
- Lightweight Cosine-similarity threshold-based ...
- ArticleOctober 2024
Exploring Wearable Emotion Recognition with Transformer-Based Continual Learning
Artificial Intelligence in Pancreatic Disease Detection and Diagnosis, and Personalized Incremental Learning in MedicinePages 86–101https://doi.org/10.1007/978-3-031-73483-0_8AbstractThe rapid advancement of wearable technology has enabled continuous, real-time health monitoring through devices such as smartwatches and fitness trackers. These devices generate vast amounts of biometric data, including heart rate, galvanic skin ...
- ArticleOctober 2024
Continual Domain Incremental Learning for Privacy-Aware Digital Pathology
- Pratibha Kumari,
- Daniel Reisenbüchler,
- Lucas Luttner,
- Nadine S. Schaadt,
- Friedrich Feuerhake,
- Dorit Merhof
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024Pages 34–44https://doi.org/10.1007/978-3-031-72390-2_4AbstractIn recent years, there has been remarkable progress in the field of digital pathology, driven by the ability to model complex tissue patterns using advanced deep-learning algorithms. However, the robustness of these models is often severely ...
- articleOctober 2024
Synergistic insights: Exploring continuous learning and explainable AI in handwritten digit recognition
AbstractDeep Neural Networks achieve outstanding results; however, their reliance on a static environment with fixed data poses challenges in dynamic scenarios where data continuously evolves. Being capable of learning, adapting, and generalizing ...
- research-articleOctober 2024
Concept Accumulation and Gradient-Guided Adaption for continual learning in evolving streaming
AbstractLearning algorithms in modern information systems often operate in dynamic environments where data is collected as transient data streams. Processing data streams imposes new computational requirements on algorithms compared to static data mining,...
Highlights- A novel hybrid architecture for evolving streaming classification is proposed, which combines the advantages of ensemble learning and neural network.
- A chunk-mode drift detector for monitoring drift occurring in infinite streaming data ...
- ArticleOctober 2024
Lifelong Histopathology Whole Slide Image Retrieval via Distance Consistency Rehearsal
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024Pages 274–284https://doi.org/10.1007/978-3-031-72083-3_26AbstractContent-based histopathological image retrieval (CBHIR) has gained attention in recent years, offering the capability to return histopathology images that are content-wise similar to the query one from an established database. However, in clinical ...
- ArticleOctober 2024
SiFT: A Serial Framework with Textual Guidance for Federated Learning
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024Pages 655–665https://doi.org/10.1007/978-3-031-72117-5_61AbstractDeep learning has been extensively used in various medical scenarios. However, the data-hungry nature of deep learning poses significant challenges in the medical domain, where data is often private, scarce, and imbalanced. Federated learning ...
- ArticleOctober 2024
Continually Tuning a Large Language Model for Multi-domain Radiology Report Generation
- Yihua Sun,
- Hee Guan Khor,
- Yuanzheng Wang,
- Zhuhao Wang,
- Hongliang Zhao,
- Yu Zhang,
- Longfei Ma,
- Zhuozhao Zheng,
- Hongen Liao
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024Pages 177–187https://doi.org/10.1007/978-3-031-72086-4_17AbstractLarge language models (LLMs) have demonstrated potential across various tasks, including vision-language applications like chest X-ray (XR) report generation (RG) in healthcare. Recent RG approaches focus on optimizing model performance for a ...
- research-articleNovember 2024
Continual learning for seizure prediction via memory projection strategy
- Yufei Shi,
- Shishi Tang,
- Yuxuan Li,
- Zhipeng He,
- Shengsheng Tang,
- Ruixuan Wang,
- Weishi Zheng,
- Ziyi Chen,
- Yi Zhou
Computers in Biology and Medicine (CBIM), Volume 181, Issue Chttps://doi.org/10.1016/j.compbiomed.2024.109028AbstractDespite extensive algorithms for epilepsy prediction via machine learning, most models are tailored for offline scenarios and cannot handle actual scenarios where data changes over time. Catastrophic forgetting(CF) for learned ...
Highlights- Proposed Patient-IL adapts to dynamic patient increase for seizure prediction, facilitating EEG-based incremental learning studies.
- Proposed MP strategy tackles CF in epilepsy prediction due to EEG data interference, integrating ...
- ArticleOctober 2024
Adapt Without Forgetting: Distill Proximity from Dual Teachers in Vision-Language Models
AbstractMulti-modal models such as CLIP possess remarkable zero-shot transfer capabilities, making them highly effective in continual learning tasks. However, this advantage is severely compromised by catastrophic forgetting, which undermines the valuable ...
- ArticleOctober 2024
Preventing Catastrophic Forgetting Through Memory Networks in Continuous Detection
AbstractModern pre-trained architectures struggle to retain previous information while undergoing continuous fine-tuning on new tasks. Despite notable progress in continual classification, systems designed for complex vision tasks such as detection or ...
- ArticleOctober 2024
- ArticleOctober 2024
Continual Learning for Remote Physiological Measurement: Minimize Forgetting and Simplify Inference
AbstractRemote photoplethysmography (rPPG) has gained significant attention in recent years for its ability to extract physiological signals from facial videos. While existing rPPG measurement methods have shown satisfactory performance in intra-dataset ...
- ArticleOctober 2024
Anytime Continual Learning for Open Vocabulary Classification
AbstractWe propose an approach for anytime continual learning (AnytimeCL) for open vocabulary image classification. The AnytimeCL problem aims to break away from batch training and rigid models by requiring that a system can predict any set of labels at ...