default search action
Kushal Tirumala
Person information
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
2020 – today
- 2024
- [c5]Amro Abbas, Evgenia Rusak, Kushal Tirumala, Wieland Brendel, Kamalika Chaudhuri, Ari S. Morcos:
Effective pruning of web-scale datasets based on complexity of concept clusters. ICLR 2024 - [i13]Amro Abbas, Evgenia Rusak, Kushal Tirumala, Wieland Brendel, Kamalika Chaudhuri, Ari S. Morcos:
Effective pruning of web-scale datasets based on complexity of concept clusters. CoRR abs/2401.04578 (2024) - [i12]Andrey Gromov, Kushal Tirumala, Hassan Shapourian, Paolo Glorioso, Daniel A. Roberts:
The Unreasonable Ineffectiveness of the Deeper Layers. CoRR abs/2403.17887 (2024) - [i11]Vasu Sharma, Karthik Padthe, Newsha Ardalani, Kushal Tirumala, Russell Howes, Hu Xu, Po-Yao Huang, Shang-Wen Li, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer:
Text Quality-Based Pruning for Efficient Training of Language Models. CoRR abs/2405.01582 (2024) - [i10]Florian Bordes, Richard Yuanzhe Pang, Anurag Ajay, Alexander C. Li, Adrien Bardes, Suzanne Petryk, Oscar Mañas, Zhiqiu Lin, Anas Mahmoud, Bargav Jayaraman, Mark Ibrahim, Melissa Hall, Yunyang Xiong, Jonathan Lebensold, Candace Ross, Srihari Jayakumar, Chuan Guo, Diane Bouchacourt, Haider Al-Tahan, Karthik Padthe, Vasu Sharma, Hu Xu, Xiaoqing Ellen Tan, Megan Richards, Samuel Lavoie, Pietro Astolfi, Reyhane Askari Hemmat, Jun Chen, Kushal Tirumala, Rim Assouel, Mazda Moayeri, Arjang Talattof, Kamalika Chaudhuri, Zechun Liu, Xilun Chen, Quentin Garrido, Karen Ullrich, Aishwarya Agrawal, Kate Saenko, Asli Celikyilmaz, Vikas Chandra:
An Introduction to Vision-Language Modeling. CoRR abs/2405.17247 (2024) - [i9]Aaditya K. Singh, Yu Yang, Kushal Tirumala, Mostafa Elhoushi, Ari S. Morcos:
Brevity is the soul of wit: Pruning long files for code generation. CoRR abs/2407.00434 (2024) - [i8]Chunting Zhou, Lili Yu, Arun Babu, Kushal Tirumala, Michihiro Yasunaga, Leonid Shamis, Jacob Kahn, Xuezhe Ma, Luke Zettlemoyer, Omer Levy:
Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model. CoRR abs/2408.11039 (2024) - 2023
- [c4]Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari Morcos:
D4: Improving LLM Pretraining via Document De-Duplication and Diversification. NeurIPS 2023 - [i7]Amro Abbas, Kushal Tirumala, Daniel Simig, Surya Ganguli, Ari S. Morcos:
SemDeDup: Data-efficient learning at web-scale through semantic deduplication. CoRR abs/2303.09540 (2023) - [i6]Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari S. Morcos:
D4: Improving LLM Pretraining via Document De-Duplication and Diversification. CoRR abs/2308.12284 (2023) - [i5]Yu Yang, Aaditya K. Singh, Mostafa Elhoushi, Anas Mahmoud, Kushal Tirumala, Fabian Gloeckle, Baptiste Rozière, Carole-Jean Wu, Ari S. Morcos, Newsha Ardalani:
Decoding Data Quality via Synthetic Corruptions: Embedding-guided Pruning of Code Data. CoRR abs/2312.02418 (2023) - 2022
- [c3]Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela:
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks. ACL (demo) 2022: 174-181 - [c2]Alexander R. Farhang, Jeremy D. Bernstein, Kushal Tirumala, Yang Liu, Yisong Yue:
Investigating Generalization by Controlling Normalized Margin. ICML 2022: 6324-6336 - [c1]Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, Armen Aghajanyan:
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models. NeurIPS 2022 - [i4]Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela:
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks. CoRR abs/2204.01906 (2022) - [i3]Alexander R. Farhang
, Jeremy Bernstein, Kushal Tirumala, Yang Liu, Yisong Yue:
Investigating Generalization by Controlling Normalized Margin. CoRR abs/2205.03940 (2022) - [i2]Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, Armen Aghajanyan:
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models. CoRR abs/2205.10770 (2022) - 2020
- [i1]Rahil Bathwal, Pavan Chitta, Kushal Tirumala, Vignesh Varadarajan:
Ensemble Machine Learning Methods for Modeling COVID19 Deaths. CoRR abs/2010.04052 (2020)
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from ,
, and
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and
to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from .
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-10-04 20:03 CEST by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by: