Posts by Collection

portfolio

publications

Hypergraph of Text: a Mathematical Structure for Organizing and Analyzing Big Text Data

Published in 2024 IEEE International Conference on Big Data (BigData), 2009

In this paper we propose Hypergraph of Text (HoT), a novel mathmatical structure for organizing and analyzing text data

Recommended citation: D. E. Alvarez and C. Zhai, "Hypergraph of Text: a Mathematical Structure for Organizing and Analyzing Big Text Data," 2024 IEEE International Conference on Big Data (BigData), Washington, DC, USA, 2024, pp. 8605-8607, doi: 10.1109/BigData62323.2024.10824995.
Download Paper

STAT: Shrinking Transformers After Training

Published in arXiv, 2024

We present STAT: a simple algorithm to prune transformer models without any fine-tuning. STAT eliminates both attention heads and neurons from the network, while preserving accuracy by calculating a correction to the weights of the next layer.

Recommended citation: STAT: Shrinking Transformers After Training. M Flynn, A Wang, DE Alvarez, C De Sa, A Damle - arXiv preprint arXiv:2406.00061, 2024
Download Paper

talks

teaching

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.