I complain when a company's behaved poorly, so only fair to praise when they do well. I had a short-notice emergency that led me to not take a @SouthwestAir flight, and they waived their no-show policy to refund. Much appreciated.
0
0
3
1,014
Scientific progress requires investigating a diverse set of ideas. Do we still have that in natural language processing and AI? In this short (3min) video snippet, I raise this question during a panel at the top NLP conference this past summer. youtube.com/watch?v=1ZPjTZ…
2
2
14
4,250
Rebecca’s latest podcast episode is with a bestselling author and expert on US college admissions.
0
0
1
695
Should we think of LLMs as cognitive models? This talk goes beyond the "argument from amazingness" to a more careful assessment of what it means to model human language processing, and why thinking of LLMs as cognitive models might or might not make sense.
youtu.be/Gt7IAT9lgrQ
youtu.be/Gt7IAT9lgrQ
0
0
8
1,073
To be presented at ACL 2025: Large Language Models Are Biased Because They Are Large Language Models.
Article: doi.org/10.1162/coli_a…
Short (8min) video: youtube.com/watch?v=WLSuhe…
#ACL2025NLP #NLProc #LLMs
Article: doi.org/10.1162/coli_a…
Short (8min) video: youtube.com/watch?v=WLSuhe…
#ACL2025NLP #NLProc #LLMs
0
15
50
3,280
In earlier work, we showed that neural topic model evaluation was broken, and those models didn't improve over classical methods the way people thought. This new paper provides a replacement paradigm that's grounded in the real-world requirements of qualitative content analysis.
(Repost due to mistaken deletion😢):
Evaluating topic models (& doc clustering methods) is hard. In fact, since our paper critiquing standard eval practices 4 years ago, there hasn't been a good replacement metric
That ends today! Our ACL paper introduces a new evaluation🧵
2
3
5
915
Also: "results from the human evaluation indicate that a classical model (LDA, Blei et al., 2003) performs at least as well, if not better, than its modern equivalents." MALLET, with suitable preprocessing (stoplist, phrasal tokens) still has serious legs!
0
0
2
168
Philip Resnik retweeted
Also joint work with @psresnik and @boydgraber. This work concludes a "trilogy" of topic model evaluation papers
paper 1: dl.acm.org/doi/10.5555/35…
thread 1: x.com/miserlis_/stat…
paper 2: aclanthology.org/2022.findings-…
thread 2: x.com/miserlis_/stat…
paper 1: dl.acm.org/doi/10.5555/35…
thread 1: x.com/miserlis_/stat…
paper 2: aclanthology.org/2022.findings-…
thread 2: x.com/miserlis_/stat…
When evaluating a method, it makes sense to ask: what's the method used for?
In our Findings of EMNLP paper "Are Neural Topic Models Broken?", we draw from content analysis to inform topic model evaluation metrics
@Pranav__Goel @rupak_53 @psresnik
arxiv.org/abs/2210.16162
1/11
0
2
4
873
Philip Resnik retweeted
Researchers @UofMaryland are examining how and why some misleading narratives proliferate via strategic use of certain mainstream news articles. The paper—coauthored by Pranav Goel, @_Jon_Green, @davidlazer & @psresnik—was published @NatureHumBehav.
nature.com/articles/s4156…
nature.com/articles/s4156…
1
5
7
983
Looking for guidance on raising successful kids in a complicated world? Rebecca Resnik's new podcast is (objectively, even if I'm personally biased!) a great place to go. podcasts.apple.com/us/podcast/cul…
0
0
6
447
going live in 15 with @SanderSchulhoff, @DenisPeskoff, and @psresnik 💫
Come say hi :)
youtube.com/live/FreXovgG-…
0
1
6
1,356
Just out on arXiv: my paper arguing that harmful biases are an inherent consequence of the underlying assumptions in any large language model, as LLMs are currently formulated. To the extent this is true, those assumptions badly need to be revisited. arxiv.org/abs/2406.13138
0
17
71
4,707
I am beyond thrilled to report that my first PhD grad, Mona Diab, has been named a new Fellow of the Association for Computational Linguistics, along with four other terrific scholars. Congratulations to @MonaDiab77!
3
3
104
7,594
Philip Resnik retweeted
Honored my paper with @psresnik was accepted to Findings of #EMNLP2023! Many psycholinguistics studies use LLMs to estimate the probability of words in context. But LLMs process statistically derived subword tokens, while human processing does not. Does the disconnect matter? 🧵
14
25
125
18,828
Philip Resnik retweeted
📢CLPsych Shared Task '24
🗓️Registration deadline: December 10th
ℹ️If you are interested in working with LLMs for "explaining stuff" or in #NLProc for mental health, check out the @CLPsychOrg page!
clpsych.org/shared-task-20…
Team:@AtzilDana @jennycwchim @i_t_s_dimitris @xrysoflhs
🗓️Registration deadline: December 10th
ℹ️If you are interested in working with LLMs for "explaining stuff" or in #NLProc for mental health, check out the @CLPsychOrg page!
clpsych.org/shared-task-20…
Team:@AtzilDana @jennycwchim @i_t_s_dimitris @xrysoflhs
0
11
14
3,653
I'm excited to be among the co-authors for this new article, which provides a tutorial introduction to the Eelbrain toolkit. Eelbrain is a *great* bridge for computational linguists interested in neuroscience. elifesciences.org/articles/85012
0
3
20
2,252
Great work led by @umdclip undergrad Sander Schulhoff, plus the video overview is fun.
Website: paper.hackaprompt.com
Paper (accepted to EMNLP): paper.hackaprompt.com/HackAPrompt.pdf
Explanatory video:
youtu.be/tmKgL0eELKM
0
0
2
609
A valuable read for anyone interested in @CLPsych (and more broadly anyone interested in LLMs' connection with psychology and mental health). doi.org/10.1038/s44159… Hats off to @ddemszky and colleagues.
0
3
14
1,548
Philip Resnik retweeted
CLPsych 2024 is collocated with EACL and the first CFP is out. We are looking forward to seeing your submissions clpsych.org
1
10
16
3,620