Suzan Verberne 🤹♀️ retweeted
Domain-specific Information Retrieval
@suzan et al. present a monograph on search in the legal, health and biomedical, academic, and patent domains, covering tasks, datasets, long-document challenges, retrieval methods, and the role of LLMs.
📝 arxiv.org/abs/2611.08228
@suzan et al. present a monograph on search in the legal, health and biomedical, academic, and patent domains, covering tasks, datasets, long-document challenges, retrieval methods, and the role of LLMs.
📝 arxiv.org/abs/2611.08228
0
4
44
1,985
Suzan Verberne 🤹♀️ retweeted
How long does a finding about LLMs stay true?
We re-tested 50 widely cited findings about LLM behavior (various biases, hallucination, etc). Within 15 months, most no longer held or had substantially reduced effects.
LLM findings has short shelf life zou-group.github.io/llm-claims-she…
Great job by @oq_35!
We re-tested 50 widely cited findings about LLM behavior (various biases, hallucination, etc). Within 15 months, most no longer held or had substantially reduced effects.
LLM findings has short shelf life zou-group.github.io/llm-claims-she…
Great job by @oq_35!
1/n Within 15 months of publication, most of the LLM claims we tested either no longer held or showed substantially diminished effects. How long does our knowledge of AI hold up? In our new study, we revisit 50 findings to see what fades, what persists, and what gets stronger. 🧵
49
239
1,139
110,178
Suzan Verberne 🤹♀️ retweeted
In the first step of a roadmap to bring Anthology search in-house, we have implemented an author index, accessible both from the main page navigation bar and from the people page: aclanthology.org/people/.
2
1
27
3,431
Suzan Verberne 🤹♀️ retweeted
Okay so, we just found that over 50 papers published at @Neurips 2025 have AI hallucinations
I don't think people realize how bad the slop is right now
It's not just that researchers from @GoogleDeepMind, @Meta, @MIT, @Cambridge_Uni are using AI - they allowed LLMs to generate papers and didn't notice at all.
It's insane that these made it through peer review👇
I don't think people realize how bad the slop is right now
It's not just that researchers from @GoogleDeepMind, @Meta, @MIT, @Cambridge_Uni are using AI - they allowed LLMs to generate papers and didn't notice at all.
It's insane that these made it through peer review👇
277
1,366
6,204
1,007,976
Suzan Verberne 🤹♀️ retweeted
Happy to share that our paper "Generative Retrieval with Few-shot Indexing" has been accepted at #ECIR2026, with @arian_ask, @maliannejadi, @zhaochun_ren, Evangelos Kanoulas and @suzan.
A training-free generative retrieval method with strong performance and much faster indexing
A training-free generative retrieval method with strong performance and much faster indexing
0
3
9
1,081
Suzan Verberne 🤹♀️ retweeted
Ik wilde weten waarom Elon Musks chatbot Grok onlangs compleet ontspoorde, allerhande antisemitische stereotypen begon uit te braken, en zichzelf MechaHitler begon te noemen. Wat blijkt: het rabiate buitenbeentje onder de chatbots is gewoon zo getraind. nrc.nl/nieuws/2025/07…
0
3
4
849
Suzan Verberne 🤹♀️ retweeted
Huge congratulations to @macavaney on receiving the prestigious ACM SIGIR Early Career Researcher Award in the research category! This well-deserved recognition highlights the excellence & impact of his work in the IR community 👏🎉#sigir2025
Cc @GlasgowCS @UofGlasgow @ACMSIGIR
Cc @GlasgowCS @UofGlasgow @ACMSIGIR
1
15
69
8,158
Suzan Verberne 🤹♀️ retweeted
The #SIGIR2025 Best Paper just awarded to the WARP engine for fast late interaction!
Congrats to Luca Scheerer🎉 WARP was his @ETH_en MS thesis, completed while visiting us at @StanfordNLP.
Incidentally, it's the fifth Paper Award for a ColBERT paper since 2020!*
Luca did an and executing this. See the thread below for some relevant links.
*Though it's notable that this is actually the first among these awards with ColBERT(v1/v2) authors😅😅
Congrats to Luca Scheerer🎉 WARP was his @ETH_en MS thesis, completed while visiting us at @StanfordNLP.
Incidentally, it's the fifth Paper Award for a ColBERT paper since 2020!*
Luca did an and executing this. See the thread below for some relevant links.
*Though it's notable that this is actually the first among these awards with ColBERT(v1/v2) authors😅😅
📢 If you’re at #SIGIR2025 this week, make sure to be at Luca Scheerer’s paper talk:
“WARP: An Efficient Engine for Multi-Vector Retrieval” (Wednesday 11am)
WARP makes PLAID, the famous ludicrously fast ColBERT engine, another 3x faster on CPUs.
With the usual ColBERT quality!
5
32
181
28,811
Suzan Verberne 🤹♀️ retweeted
Shameless self-promotion! Check out the book on #GenIR edited by @ryen_white and me (with 9 chapters written by highly distinguished scholars) at the @SpringerNature booth at #SIGIR2025 link.springer.com/book/10.1007/9…
0
9
27
1,426
Suzan Verberne 🤹♀️ retweeted
Honored to be recognized as one of the top reviewers @ACMSIGIR —and even more thrilled to meet BM25’s dad in person! #SIGIR2025
2
2
42
1,532
Suzan Verberne 🤹♀️ retweeted
Wow, honored to be named an Excellent PC Member at @SIGIRConf!
Glad my obsessive... I mean detailed... reviewing style paid off. 🤓✨
Huge thanks to the chairs for the recognition and congrats to all the other reviewers!
#SIGIR #SIGIR2025 #Award #BestReviewer
Glad my obsessive... I mean detailed... reviewing style paid off. 🤓✨
Huge thanks to the chairs for the recognition and congrats to all the other reviewers!
#SIGIR #SIGIR2025 #Award #BestReviewer
0
1
14
803
Suzan Verberne 🤹♀️ retweeted
A good thought-provoking panel at the start of @SIGIRConf 2025 #SIGIR2025 "Is Search Dead? The Rise or Demise of Search in the Era of LLMs". Many valuable points on the topic from an excellent team of panelists.
2
1
3
718
Suzan Verberne 🤹♀️ retweeted
At the opening of #sigir2025; @frrncl opened the conference with also an address from ACM President Yannis Ioannidis.
0
3
17
780
Suzan Verberne 🤹♀️ retweeted
** AZC-rellen
dat je zo bang
bent voor
overlast dat je
zelf alvast je
woonplaats
vernielt **
#Loesje #Coevorden
dat je zo bang
bent voor
overlast dat je
zelf alvast je
woonplaats
vernielt **
#Loesje #Coevorden
91
420
1,425
78,144
Suzan Verberne 🤹♀️ retweeted
Suspect some of this has now been implemented with AI Overviews. Looking forward to more thoughts from IR professors at this year's European Summer School for Information Retrieval next week.
LLMs for IR lecture delivered by @suzan at ESSIR 2024. Highlights the recent AI Overviews debacle. Suggests search engines need to pre-qualify the documents which are returned for reliability / credibility for AI Overviews
0
1
3
609
Suzan Verberne 🤹♀️ retweeted
If, due to exceptional circumstances, you are not able to travel to Padua to present your paper, please contact the chairs at sigir2025-pp@dei.unipd.it on May 30th CEST the latest to discuss possible solutions.
sigir2025.dei.unipd.it/inpresence-pol…
sigir2025.dei.unipd.it/inpresence-pol…
0
4
4
1,108
Suzan Verberne 🤹♀️ retweeted
In only two years LLM-based relevance assessment has gone from rejections because it’s crazy and dangerous to rejections because it is boring and standard.
1
2
26
1,105
Suzan Verberne 🤹♀️ retweeted
ModernBERT 🤜 🤛 ColBERT = ModernColBERT
ModernColBERT is the latest state-of-the-art text-based late interaction model by @LightOnIO.
- Based on the ModernBERT-base encoder
- Outperforms ColBERT-small on the BEIR retrieval benchmark
Here’s a quick notebook I threw together e ModernColBERT with @weaviate_io:
github.com/weaviate/recip…
ModernColBERT is the latest state-of-the-art text-based late interaction model by @LightOnIO.
- Based on the ModernBERT-base encoder
- Outperforms ColBERT-small on the BEIR retrieval benchmark
Here’s a quick notebook I threw together e ModernColBERT with @weaviate_io:
github.com/weaviate/recip…
3
48
238
20,390
Suzan Verberne 🤹♀️ retweeted
ECIR 2025 was a great success. Hoping to make a memorable #ECIR2026 with the dream team of @suzan and @zhaochun_ren … We will be preparing to welcoming all of us to Delft.
1
3
24
1,894