Dean E. Alvarez

Dean E. Alvarez

he/him

CS PhD student @ UIUC

Publications

You can also find my articles on my Google Scholar profile.

Demos and Posters

Hypergraph of Text: a Mathematical Structure for Organizing and Analyzing Big Text Data

Published in 2024 IEEE International Conference on Big Data (BigData), 2009

In this paper we propose Hypergraph of Text (HoT), a novel mathmatical structure for organizing and analyzing text data

Recommended citation: D. E. Alvarez and C. Zhai, "Hypergraph of Text: a Mathematical Structure for Organizing and Analyzing Big Text Data," 2024 IEEE International Conference on Big Data (BigData), Washington, DC, USA, 2024, pp. 8605-8607, doi: 10.1109/BigData62323.2024.10824995.
Download Paper

Preprints

STAT: Shrinking Transformers After Training

Published in arXiv, 2024

We present STAT: a simple algorithm to prune transformer models without any fine-tuning. STAT eliminates both attention heads and neurons from the network, while preserving accuracy by calculating a correction to the weights of the next layer.

Recommended citation: STAT: Shrinking Transformers After Training. M Flynn, A Wang, DE Alvarez, C De Sa, A Damle - arXiv preprint arXiv:2406.00061, 2024
Download Paper