Dec 8, 2023 · In this paper, we propose Lyrics, a novel multi-modal pre-training and instruction fine-tuning paradigm that bootstraps vision-language alignment.

In this paper, we propose Lyrics, a novel multi-modal pre-training and instruction fine-tuning paradigm that bootstraps vision-language alignment from fine- ...

Dec 8, 2023 · A novel multi-modal pre-training and instruction fine-tuning paradigm that bootstraps vision-language alignment from fine-grained cross-modal collaboration.

Aug 19, 2024 · Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects. Junyu Lu, Ruyi Gan, Di Zhang ...

Lyrics introduces a visual refiner that consists of an image tagging module, an object detection module, and a semantic segmentation module to extract local ...

Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects. J. Lu, R. Gan, D. Zhang, X. Wu, Z. Wu, R. Sun ...

Apr 14, 2024 · This paper introduces a novel approach to improving the fine-grained alignment between large language models and visual representations.

Feb 8, 2024 · Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects · no code implementations • 8 Dec ...

Aug 15, 2024 · Lyrics & Multi-scale Querying Transformer ... Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects

Jan 27, 2024 · Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects · no code implementations • 8 Dec ...