In Computer Science, the reputation of conferences often exceeds the reputation of journals, with strict peer-review guidelines and a typical acceptance rate of 20% of submitted papers. Below is a list of conferences I was involved in as author, keynote speaker, editor or PC member. The list includes abbreviations, full name, a description, and Impact factors or CORE conference ratings[^8] given in parentheses. The highest rating (A*) is awarded to only 7% of conference venues. The ratings are based on acceptance rate, H-index of program committee and H-index of researchers publishing at these venues.
List of conferences I participate in, the communities they address, and CORE conference ratings.
It is customary in my field that the first author is the main contibuting student, while the last author is the senior author who is funding the student. To be more precise, I annotate my role in publication preparation as follows:
Advisor to UNH students who are first authors.
Advisor to external students who are first authors.rformed.
Primary author of a paper based on work performed independent of students.
Coauthor with equal contribution of a paper based on work of external students or collaborators.
Collaborator/coauthor on a paper primarily written by external students or collaborators.
The following papers were published or accepted during my tenure period. Additional publications are listed on the CV.
Conference, Workshop, and Journal publications:
Please click on the pdf link for the fulltext publication.
Series on EXAM/Rubric-based evaluation for retrieve / generate systems:
Farzi, Naghmeh, and Laura Dietz. 2024b. “Pencils down! Automatic Rubric-Based Evaluation of Retrieve/Generate Systems.” In Proceedings of the International Conference on the Theory of Information Retrieval. https://www.cs.unh.edu/~dietz/papers/farzi2024pencils.pdf.(Unranked, Adviser & Primary) Research demonstrating that Question-based RUBRIC methods, using LLMs to self-rate answerability is a promising evaluation approach for integrating human judges in automatic evaluation. pdf - data & code
Farzi, Naghmeh, and Laura Dietz. 2024a. “EXAM++: LLM-Based Answerability Metrics for IR Evaluation.” In Proceedings of LLM4Eval: The First Workshop on Large Language Models for Evaluation in Information Retrieval. https://www.cs.unh.edu/~dietz/papers/farzi2024exampp.pdf.(Workshop, Adviser & Primary) Research exploring different approaches for using questions in automatic evaluation (self-rated answerability vs question answering with answer verification; automatic question banks vs manual question banks; impact on fine-tuning vs extractive prompts). pdf - data & code
Dietz, Laura. 2024. “A Workbench for Autograding Retrieve/Generate Systems.” In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’24) - Resource and Reproducibility Papers. https://doi.org/https://doi.org/10.1145/3626772.3657871.(A*, Primary) Workbench resource that implements different RUBRIC / EXAM methods for evaluation, including several direct relevance labeling baselines. Play with the workbench, and send us a postcard or a pull request!! pdf - data & code
Series on using LLMs for Evaluation, debating various forms of theoretical issues:
Faggioli, Guglielmo, Laura Dietz, Charles Clarke, Gianluca Demartini, Matthias Hagen, Claudia Hauff, Noriko Kando, et al. 2024. “Who Determines What Is Relevant? Humans or AI? Why Not Both? A Spectrum of Human-AI Collaboration in Assessing Relevance.” Communications of the ACM. https://doi.org/10.1145/3624730.(Unranked, Coauthor) CACM
Faggioli, Guglielmo, Laura Dietz, Charles LA Clarke, Gianluca Demartini, Matthias Hagen, Claudia Hauff, Noriko Kando, et al. 2023. “Perspectives on Large Language Models for Relevance Judgment.” In Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval, 39–50. https://www.cs.unh.edu/~dietz/appendix/perspectives-on-large-language-models-for-relevance.pdf.(Unranked, Coauthor, Best Paper Award at ICTIR 2023)
Series on using wikipedia entities for information retrieval systems.
Oza, Pooja, and Laura Dietz. 2023. “Entity Embeddings for Entity Ranking: A Replicability Study.” In Advances in Information Retrieval, Proceedings of the 45th European Conference on Information Retrieval (ECIR 2023). Lecture Notes in Computer Science. (A, Adviser) pdf - data & code
Kashyapi, Sumanta, and Laura Dietz. 2022b. “Topic-Mono-BERT: A Joint Retrieval-Clustering System for Retrieving Overview Passages.” In Proceedings of the 14th Annual Meeting of the Forum for Information Retrieval Evaluation, 54–59. https://dl.acm.org/doi/abs/10.1145/3574318.3574336. (Unranked, Adviser) pdf - data & code
Chatterjee, Shubham, and Laura Dietz. 2022b. “Predicting Guiding Entities for Entity Aspect Linking.” In Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 3848–52. https://dl.acm.org/doi/abs/10.1145/3511808.3557671. (A, Adviser) pdf - data & code
Dietz, Laura, Shubham Chatterjee, Connor Lennox, Sumanta Kashyapi, Pooja Oza, and Ben Gamari. 2022. “Wikimarks: Harvesting Relevance Benchmarks from Wikipedia.” In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). https://trema-unh.github.io/wikimarks/. (A*, Primary) pdf - data
Chatterjee, Shubham, and Laura Dietz. 2022a. “BERT-ER: Query-Specific BERT Entity Representations for Entity Ranking.” In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). (A*, Advisor) pdf - appendix
Kashyapi, Sumanta, and Laura Dietz. 2022a. “Query-Specific Subtopic Clustering.” In In the ACM/IEEE Joint Conference on Digital Libraries in 2022 (JCDL’22). https://doi.org/10.1145/3529372.3530923. (A*, Advisor) pdf - appendix
Koohfar, Sepideh, Adam Wymore, William McDowell, and Laura Dietz. 2021. “Temporal Context Transformers for Multi-Horizon Prediction of Solute Concentration Responses.” In AGU Fall Meeting Abstracts, Session on Advances in Data-Driven Approaches to Forecasting Hydrologic Data: Statistical and Artificial Intelligence Models. (Unranked, Advisor) pdf
Sander, David, and Laura Dietz. 2021. “EXAM: How to Evaluate Retrieve-and-Generate Systems for Users Who Do Not (yet) Know What They Want.” In Proceedings of the 2nd International Conference on Design of Experimental Search & Information REtrieval Systems (DESIRES). https://www.cs.unh.edu/~dietz/papers/sander2021exam.pdf. (Unranked, Coauthor) pdf - appendix – video
Chatterjee, Shubham, and Laura Dietz. 2021. “Entity Retrieval Using Fine-Grained Entity Aspects.” In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 1662–66. https://www.cs.unh.edu/~dietz/papers/chatterjee2021entity.pdf. (A*, Advisor) pdf - appendix – data
Ramsdell, Jordan, and Laura Dietz. 2020. “A Large Test Collection for Entity Aspect Linking.” In Proceedings of the 29th ACM International Conference on Information & Knowledge Management (CIKM), 3109–16. https://www.cs.unh.edu/~dietz/papers/ramsdell2020large.pdf. (A, Advisor) pdf - dataset – video
Nanni, Federico, Simone Paolo Ponzetto, and Laura Dietz. 2020. “Toward Comprehensive Event Collections.” International Journal on Digital Libraries 21 (2): 215–29. https://www.cs.unh.edu/~dietz/papers/nanni2020toward.pdf. – CiteScore 1.93, (External Advisor)
Dietz, Laura, and Jeff Dalton. 2020. “Humans Optional? Automatic Large-Scale Test Collections for Entity, Passage, and Entity-Passage Retrieval [Special Issue on Trends in Information Retrieval Evaluation].” Datenbank-Spektrum, 1–12. https://www.cs.unh.edu/~dietz/papers/dietz2020humans.pdf. (Citescore unavailable, Primary) Preprint – DOI
Gamari, Ben, and Laura Dietz. 2020b. “Alligator Collector: A Latency-Optimized Garbage Collector for Functional Programming Languages.” In Proceedings of the 2020 ACM SIGPLAN International Symposium on Memory Management (ISMM), 87–99. https://www.cs.unh.edu/~dietz/papers/gamari2020alligator.pdf. (A, Coauthor) pdf – appendix
Gamari, Ben, and Laura Dietz. 2020a. “A Low-Latency Garbage Collector for GHC (Demo).” In Proceedings of the 13th ACM SIGPLAN International Symposium on Haskell. https://www.cs.unh.edu/~dietz/papers/gamari2020alligatordemo.pdf. (Unranked, Coauthor)
Chatterjee, Shubham, and Laura Dietz. 2019. “Why Does This Entity Matter? Support Passage Retrieval for Entity Retrieval.” In Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR), 221–24. https://www.cs.unh.edu/~dietz/papers/chatterjee2019does.pdf. (Unranked, Advisor) pdf – appendix
Dietz, Laura. 2019. “ENT Rank: Retrieving Entities for Topical Information Needs Through Entity-Neighbor-Text Relations.” In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 215–24. https://www.cs.unh.edu/~dietz/papers/dietz2019ent.pdf. (A*, Primary) pdf – appendix – video
Litschko, Robert, Goran Glavaš, Ivan Vulic, and Laura Dietz. 2019. “Evaluating Resource-Lean Cross-Lingual Embedding Models in Unsupervised Retrieval.” In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 1109–12. https://www.cs.unh.edu/~dietz/papers/litschko2019evaluating.pdf. (A*, Collaborator)
Dalton, Jeff, Shahrzad Naseri, Laura Dietz, and James Allan. 2019. “Local and Global Query Expansion for Hierarchical Complex Topics.” In Proceedings of the European Conference on Information Retrieval (ECIR). Springer. https://www.cs.unh.edu/~dietz/papers/dalton2019local.pdf. (A, Collaborator)
Weiland, Lydia, Ioana Hulpuş, Simone Paolo Ponzetto, Wolfgang Effelsberg, and Laura Dietz. 2018. “Knowledge-Rich Image Gist Understanding Beyond Literal Meaning.” Data & Knowledge Engineering 117: 114–32. https://www.cs.unh.edu/~dietz/papers/weiland2018knowledge.pdf. – CiteScore 1.8, 70% (External Advisor)
Nanni, Federico, Simone Paolo Ponzetto, and Laura Dietz. 2018. “Entity-Aspect Linking: Providing Fine-Grained Semantics of Entities in Context.” In Proceedings of the 18th ACM/IEEE Joint Conference on Digital Libraries (JCDL), 49–58. ACM. https://www.cs.unh.edu/~dietz/papers/nanni2018entity.pdf. (A*, External Advisor), best paper award. pdf – appendix
Nanni, Federico, Mahmoud Osman, Yi-Ru Cheng, Simone Paolo Ponzetto, and Laura Dietz. 2018. “UKParl: A Data Set for Topic Detection with Semantically Annotated Text.” In The International Conference on Language Resources and Evaluation (LREC). ACL. https://www.cs.unh.edu/~dietz/papers/nanni2018ukparl.pdf. (C, External Advisor) pdf – data
Nanni, Federico, Laura Dietz, and Simone Paolo Ponzetto. 2017. “Toward a Computational History of Universities: Evaluating Text Mining Methods for Interdisciplinarity Detection from PhD Dissertation Abstracts.” Digital Scholarship in the Humanities 33 (3): 612–20. https://www.cs.unh.edu/~dietz/papers/nanni2017toward.pdf. – CiteScore 0.86 , 80% (External Advisor)
Nanni, Federico, Bhaskar Mitra, Matt Magnusson, and Laura Dietz. 2017. “Benchmark for Complex Answer Retrieval.” In Proceedings of the 2017 ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR), 293–96. https://www.cs.unh.edu/~dietz/papers/nanni2017benchmark.pdf. (Unranked, External Advisor) pdf – ArXiv.
Nanni, Federico, Nikolay Marinov, Simone Paolo Ponzetto, and Laura Dietz. 2017. “Building Entity-Centric Event Collections for Supporting Research in Political and Social History.” In Digital Humanities. https://www.cs.unh.edu/~dietz/papers/nanni2017building2.pdf. (Unranked, External Advisor)
Kadry, Amina, and Laura Dietz. 2017. “Open Relation Extraction for Support Passage Retrieval: Merit and Open Issues.” In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 1149–52. ACM. https://www.cs.unh.edu/~dietz/papers/kadry2017open.pdf. (A*, External Advisor) Paper - Poster - Online Appendix
Nanni, Federico, Simone Paolo Ponzetto, and Laura Dietz. 2017. “Building Entity-Centric Event Collections.” In Proceedings of the 17th ACM/IEEE Joint Conference on Digital Libraries, 199–208. IEEE Press. https://www.cs.unh.edu/~dietz/papers/nanni2017building.pdf. (A*, External Advisor)
Weiland, Lydia, Ioana Hulpus, Simone Paolo Ponzetto, and Laura Dietz. 2017. “Using Object Detection, NLP, and Knowledge Bases to Understand the Message of Images.” In International Conference on Multimedia Modeling (MMM), 405–18. Springer, Cham. https://www.cs.unh.edu/~dietz/papers/weiland2017using.pdf. (C, External Advisor)
Weiland, Lydia, Ioana Hulpus, Simone Paolo Ponzetto, and Laura Dietz. 2016. “Understanding the Message of Images with Knowledge Base Traversals.” In Proceedings of the 2016 ACM International Conference on the Theory of Information Retrieval (ICTIR), 199–208. ACM. https://www.cs.unh.edu/~dietz/papers/weiland2016understanding.pdf. (Unranked, Exeernal Advisor)
Nanni, Federico, Laura Dietz, Stefano Faralli, Goran Glavaš, and Simone Paolo Ponzetto. 2016. “Capturing Interdisciplinarity in Academic Abstracts.” D-Lib Magazine 22 (9/10): 9. https://www.cs.unh.edu/~dietz/papers/nanni2016capturing.pdf. – CiteScore 0.86 / 70% (External Advisor)
Peer-reviewed workshop publications:
Koohfar, Sepideh, and Laura Dietz. 2022b. “An Adaptive Temporal Attention Mechanism to Address Distribution Shifts.” In NeurIPS 2022 Workshop on Robustness in Sequence Modeling. https://openreview.net/pdf?id=5aIwxkn0MzC. (Adviser) pdf - data & code
Koohfar, Sepideh, and Laura Dietz. 2022a. “Adjustable Context-Aware Transformer.” In 7th Workshop on Advanced Analytics and Learning on Temporal Data at the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (AATLD@ECML). https://project.inria.fr/aaltd22/files/2022/08/AALTD22_paper_4854.pdf. ( Adviser) pdf - data & code
Kashyapi, Sumanta, and Laura Dietz. 2021a. “Learn the Big Picture: Representation Learning for Clustering.” In Workshop on Representation Learning for NLP (RepL4NLP) at ACL 2021. ACL. https://www.cs.unh.edu/~dietz/papers/kashyapi2021learn.pdf. (Advisor) pdf – anthology
Oza, Pooja, and Laura Dietz. 2021. “Which Entities Are Relevant for the Story?” In Proceedings of the Fourth International Workshop on Narrative Extraction from Texts Held in Conjunction with the 43rd European Conference on Information Retrieval (Text2Story). https://www.cs.unh.edu/~dietz/papers/pooja2021entity.pdf. (Advisor) pdf – alt – video
Magnusson, Matthew, and Laura Dietz. 2019a. “An Analysis of Deep Contextual Word Embeddings and Neural Architectures for Toponym Mention Detection in Scientific Publications.” In NAACL Workshop on Workshop on Extracting Structured Knowledge from Scientific Publications (ESSP). https://www.cs.unh.edu/~dietz/papers/magnusson2019an.pdf. (Advisor)
Magnusson, Matthew, and Laura Dietz. 2019b. “UNH at SemEval-2019 Task 12: Toponym Resolution in Scientific Papers.” In The 2019 International Workshop on Semantic Evaluation Colocated with NAACL (SemEval). https://www.cs.unh.edu/~dietz/papers/magnusson2019unh.pdf. (Advisor)
Basu, Chumki, Laura Dietz, and Christiane Fellbaum. 2018. “WordNetContext: Information Retrieval-Friendly Access to WordNet Senses.” In Joint Proceedings of the First International Workshop on Professional Search (ProfS 2018); the Second Workshop on Knowledge Graphs and Semantics for Text Retrieval, Analysis, and Understanding (KG4IR); and the International Workshop on Data Search (DATA:SEARCH’18) Co-located with (ACM SIGIR 2018), 63–64. https://www.cs.unh.edu/~dietz/papers/basu2018wordnetcontext.pdf. (Coauthor)
Dietz, Laura, and John Foley. 2017. “On the Equivalence of Generative and Discriminative Formulations of the Sequential Dependence Model.” In SIGIR Workshop on Axiomatic Thinking for Information Retrieval and Related Tasks (ATIR). https://www.cs.unh.edu/~dietz/papers/dietz2017equivalence.pdf. (Primary)
In my research field, all proposals for workshops, tutorials, and special issues are peer-reviewed and selective.
Organized workshops and conference tutorials:
Organized evaluation tracks:
Organizers of evaluation tracks (which are accepted through peer review), are invited to write one overview paper per year.
Trade Publication:
Additionally, I contributed Section 7 on “Generated Information Objects” to the strategic report in IR. The SWIRL tradition is to anonymize individual contributions in the overall report.
Notebook papers:
We published non-peer-reviewed TREC notebook papers describing the systems we contributed to the shared tasks, as is customary for the TREC conference.
Publications before joining UNH:
Nanni, Federico; Dietz, Laura; Faralli, Stefano; Glavas, Goran, Ponzetto, Simone Paolo. Capturing Interdisciplinarity in Academic Abstracts. Workshop on Mining Scientific Publications at JCDL, 2016.
Nanni, Federico; Ponzetto, Simone Paolo; Dietz, Laura. Entity Relatedness for Retrospective Analyses of Global Events. NLP+CSS Workshop at WebSci, 2016. .pdf – appendix
Schuhmacher, Michael; Roth, Benjamin; Ponzetto, Simone Paolo; Dietz, Laura. Finding Relevant Relations in Relevant Documents. In Proceedings of European Conference on Information Retrieval (ECIR), 2016. .pdf
Dietz, Laura; Schuhmacher, Michael. An Interface Sketch for Queripidia: Query-driven Knowledge Portfolios from the Web. Proceedings of the Workshop for Exploiting Semantic Annotations in IR (ESAIR) at CIKM, 2015. .pdf – demo
Schuhmacher, Michael; Dietz, Laura; Ponzetto, Simone Paolo. Ranking Entities for Web Queries Through Text and Knowledge. Proceedings of ACM International Conference on Information and Knowledge Management (CIKM), 2015. .pdf – appendix
Dietz, Laura; Schuhmacher, Michael; Ponzetto, Simone Paolo. Queripidia: Query-specific Wikipedia Construction. In Proceedings fo the Automatic Knowledge Base Construction Workshop (AKBC) at NIPS 2014. .pdf
Dietz, Laura. Entity Linking wth Document Retrieval and Vice Versa. Invited talk at University of Illinois, Urbana-Chamaign, USA. October 22, 2014.
Dalton, Jeffrey; Dietz, Laura; Allan, James: Entity Query Feature Expansion using Knowledge Base Links. In Proceedings of the 37th Annual International ACM SIGIR conference, Gold Coast, Queensland, Australia, July 6-11, 2014. .pdf – appendix
Dietz, Laura; Dalton, Jeffrey; Croft, W. Bruce: A Graphical Model for Entity-based Document Retrieval. Poster at New England Machine Learning Day, Boston, USA, May 13, 2014. .pdf – .svg
Dalton, Jeffrey; Dietz, Laura: UMass CIIR at TAC KBP 2013 Entity Linking: Query Expansion using Urban Dictionary. Text Analysis Conference (TAC), Gaithersburg, MD, USA, November 19-20, 2013. .pdf
Dietz, Laura; Dalton, Jeffrey: UMass at TREC 2013 Knowledge Base Acceleration Track: Bi-directional Entity Linking and Time-aware Evaluation. Text Retrieval Conference (TREC), Gaithersburg, MD, USA, November 20-22, 2013. .pdf
Dietz, Laura and Dalton, Jeffrey: Query-specific Knowledge Sketches: A Joint Retrieval Model for Text, Entities, and Relations. CIIR Technical Report, 2013.
Dietz, Laura; Wang, Ziqi; Huston, Samuel; Croft, W. Bruce: Retrieving Opinions from Discussion Forums. Proceedings of ACM International Conference on Information and Knowledge Management (CIKM), 2013. .pdf
Dietz, Laura; Dalton, Jeffrey; Balog, Krisztian: Time-aware Evaluation of Cumulative Citation Recommendation Systems. Proceedings of SIGIR 2013 Workshop on Time-aware Information Access, TAIA, 2013 .pdf. code & supplement
Dalton, Jeffrey; Dietz, Laura: Constructing Query-Specific Knowledge Bases. Proceedings on the CIKM Workshop on Automated Knowledge Base Construction, 2013. .pdf.
Dalton, Jeffrey; Dietz, Laura: A Neighborhood Relevance Model for Entity Linking. Proceedings of the 10th International Conference in the RIAO series (OAIR), 2013. .pdf
Dietz, Laura: A Neighborhood-Relevance Model for Entity Linking. Mt Holyoke College, South Hadley, MA, USA, 20th of February, 2013. talk view in Web browser!
Dietz, Laura: A Neighborhood-Relevance Modelfor Entity Linking. Machine Learning and Friends Lunch Talk, University of Massachusetts, MA, USA, 14th of February, 2013. talk view in Web browser!
Gamari, Ben; Dietz, Laura: Bayes-stack. In: Twenty-third edition of Haskell Communities and Activities Report, November, 2012. .html – Code – Project
Dietz, Laura; Dalton, Jeffrey: Across-Document Neighborhood Expansion: UMass at TAC KBP 2012 Entity Linking. In: Proceedings of the Text Analysis Conference (TAC), 2012. .pdf – talk – poster
Dalton, Jeffrey; Dietz, Laura: Bi-directional Linkability From Wikipedia to Documents and Back Again: UMass at TREC 2012 Knowledge Base Acceleration Track. In: Proceedings of Text REtrieval Conference (TREC), 2012. .pdf
Dietz, Laura; Gamari, Benjamin; Guiver, John; Snelson, Edward; Herbrich, Ralf: De-Layering Social Networks with Shared Tastes of Friendships. In: Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media (ICWSM), 2012 .pdf – Code & Supplement
Konietzny, Sebastian; Dietz, Laura; McHardy, Alice: Inferring functional modules of protein families with probabilistic topic models. In: BMC Bioinformatics, vol. 12, no. 1, 141+, 2011 .html
Dietz, Laura: Exploiting Graph-Structured Data in Generative Probabilistic Models. PhD Thesis, January 2011. Max Planck Institute for Informatics and Saarland University, 2011 .pdf
Dietz, Laura: Inferring Shared Interests from Social Networks”. In: NIPS Workshop on Computational Social Science and the Wisdom of Crowd : Text and Beyond, 2010 .pdf
Dietz, Laura: Directed Factor Graph Notation for Generative Models. Technical Report, 2010 .pdf – TIKZ macros and algorithms module: .zip - Thanks to Jaakko Luttinen for creating an improved version at github.com/jluttine/tikz-bayesnet !
Dietz, Laura: Modeling Shared Tastes in Online Communities. In: NIPS Workshop on Applications for Topic Models: Text and Beyond, 2009 .pdf
Dietz, Laura ; Dallmeier, Valentin ; Zeller, Andreas ; Scheffer, Tobias: Localizing Bugs in Program Executions with Graphical Models. In: Advances in Neural Information Processing Systems, 2009 .pdf – supplement – project
Dietz, Laura; Bickel, Steffen;Scheffer Tobias : Unsupervised Prediction of Citation Influences. In: Proceedings of the 24th International Conference on Machine Learning. Corvallis, Oregon, USA, June 2007 .pdf – Watch the Talk – project
