Jan 10, 2023 · We report new mixed-modal scaling laws that unify the contributions of individual modalities and the interactions between them. Specifically, ...
We present an extensive empirical study of scaling laws for mixed-modal generative language models over tokens. We assume that every modality can be represented ...
Jan 10, 2023 · We discover a set of scaling laws describing the competition between arbitrary modalities.
Jul 23, 2023 · We report new mixed-modal scaling laws that unify the contributions of individual modalities and the interactions between them. Specifically, we ...
Jan 12, 2023 · We report new mixed-modal scaling laws that unify the contributions of individual modalities and the interactions between them. Specifically, ...
This work proposes nested use of the scaling laws of training steps, model sizes, and the data mixing law to enable predicting the performance of large models.
Armen Aghajanyan on X: "I'm excited to present: Scaling Laws for ...
twitter.com › ArmenAgha › status
Jan 11, 2023 · In this paper we explore the scaling properties of mixed-modal generative models, discovering new scaling laws that unify the contributions of individual ...
My collection of machine learning papers. Contribute to rosinality/ml-papers development by creating an account on GitHub.
People also ask
What are scaling laws in LLMs?
What are neural scaling laws?
What is a scale law?
What is the scaling law in physics?
Jan 12, 2023 · In this paper authors explore the scaling properties of mixed-modal generative models, discovering new scaling laws that unify the ...
6 days ago · Explore scaling laws in AI, which reveal how model performance improves with larger models, more data, and compute power.