Temporal information retrieval

Temporal information retrieval (T-IR) is an emerging area of research related to the field of information retrieval (IR) and a considerable number of sub-areas, positioning itself, as an important dimension in the context of the user information needs.

According to information theory science (Metzger, 2007), timeliness or currency is one of the key five aspects that determine a document's credibility besides relevance, accuracy, objectivity and coverage. One can provide many examples when the returned search results are of little value due to temporal problems such as obsolete data on weather, outdated information about a given company's earnings or information on already-happened or invalid predictions.

T-IR, in general, aims at satisfying these temporal needs and at combining traditional notions of document relevance with the so-called temporal relevance. This will enable the return of temporally relevant documents, thus providing a temporal overview of the results in the form of timeliness or similar structures. It also shows to be very useful for query understanding, query disambiguation, query classification, result diversification and so on.

This article contains a list of the most important research in temporal information retrieval (T-IR) and its related sub-areas. As several of the referred works are related with different research areas a single article can be found in more than one different table. For ease of reading the articles are categorized in a number of different sub-areas referring to its main scope, in detail.

Temporal dynamics (T-dynamics) Reference Year Conference/Journal Main Scope Comments Baeza, Y. (2002). Web Structure, Dynamics and Page Quality. In A. Laendar & A. Oliveira (Eds.), In Lecture Notes in Computer Science - SPIRE2002: 9th International Symposium on String Processing and Information Retrieval (Vol. 2476/2002, pp. 117 – 130). Lisbon, Portugal. September 11–13: Springer Berlin / Heidelberg. 2002 SPIRE T-Dynamics Cho, J., & Garcia-Molina, H. (2003). Estimating Frequency of Change. In TOIT: ACM Transactions on Internet Technology, 3(3), 256 - 290. 2003 TOIT T-Dynamics Fetterly, D., Manasse, M., Najork, M., & Wiener, J. (2003). Large-Scale Study of the Evolution of Web Pages. In WWW2003: Proceedings of the 12th International World Wide Web Conference (pp. 669 – 678). Budapest, Hungary. May 20–24: ACM Press. 2003 WWW T-Dynamics Ntoulas, A., Cho, J., & Olston, C. (2004). What's New on the Web?: the Evolution of the Web from a Search Engine Perspective. In WWW2004: Proceedings of the 13th International World Wide Web Conference (pp. 1 – 12). New York, NY, United States. May 17–22: ACM Press. 2004 WWW T-Dynamics Vlachos, M., Meek, C., Vagena, Z., & Gunopulos, D. (2004). Identifying Similarities, Periodicities and Bursts for Online Search Queries. In SIGMOD2004: Proceedings of the International Conference on Management of Data (pp. 131 – 142). Paris, France. June 13–18: ACM Press. 2004 SIGMOD T-Dynamics Beitzel, S. M., Jensen, E. C., Chowdhury, A., Frieder, O., & Grossman, D. (2007). Temporal analysis of a very large topically categorized Web query log. In JASIST: Journal of the American Society for Information Science and Technology, 58(2), 166 - 178. 2007 JASIST T-Dynamics Jones, R., & Diaz, F. (2007). Temporal Profiles of Queries. In TOIS: ACM Transactions on Information Systems, 25(3). Article No.: 14. 2007 TOIS TQ-Understanding Bordino, I., Boldi, P., Donato, D., Santini, M., & Vigna, S. (2008). Temporal Evolution of the UK Web. In ADN2008: Proceedings of the 1st International Workshop on Analysis of Dynamic Networks associated to ICDM2008: IEEE International Conference on Data Mining (pp. 909 – 918). Pisa, Italy. December 19: IEEE Computer Society Press. 2008 ICDM - ADN T-Dynamics Adar, E., Teevan, J., Dumais, S. T., & Elsas, J. L. (2009). The Web Changes Everything: Understanding the Dynamics of Web Content. In WSDM2009: Proceedings of the 2nd ACM International Conference on Web Search and Data Mining (pp. 282 – 291). Barcelona, Spain. February 9–12: ACM Press. 2009 WSDM T-Dynamics Metzler, D., Jones, R., Peng, F., & Zhang, R. (2009). Improving Search Relevance for Implicitly Temporal Queries. In SIGIR 2009: Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 700 – 701). Boston, MA, United States. July 19–23: ACM Press. 2009 SIGIR TQ-Understanding Elsas, J. L., & Dumais, S. T. (2010). Leveraging Temporal Dynamics of Document Content in Relevance Ranking. In WSDM10: Third ACM International Conference on Web Search and Data Mining (pp. 1 – 10). New York, United States. February 3–06: ACM Press. 2010 WSDM T-Dynamics Jatowt, A., Kawai, H., Kanazawa, K., Tanaka, K., & Kunieda, K. (2010). Analyzing Collective View of Future, Time-referenced Events on the Web. In WWW2010: Proceedings of the 19th International World Wide Web Conference (pp. 1123 – 1124). Raleigh, United States. April 26–30: ACM Press. 2010 WWW F-IRetrieval Aji, A., Agichtein, E. (2010). Deconstructing Interaction Dynamics in Knowledge Sharing Communities. In : Third International Conference on Social Computing, Behavioral-Cultural Modeling, & Prediction (pp. 273 – 281). Washington DC, United States. March 30–31: Springer-Verlag. 2010 SBP T-Dynamics Kulkarni, A., Teevan, J., Svore, K. M., & Dumais, S. T. (2011). Understanding Temporal Query Dynamics. In WSDM2011: In Proceedings of the 4th ACM International Conference on Web Search and Data Mining (pp. 167 – 176). Hong Kong, China. February 9–12: ACM Press. 2011 WSDM T-Dynamics Campos, R., Dias, G., & Jorge, A. M. (2011). What is the Temporal Value of Web Snippets? In TWAW 2011: Proceedings of the 1st International Temporal Web Analytics Workshop associated to WWW2011: 20th International World Wide Web Conference. Hyderabad, India. March 28.: CEUR Workshop Proceedings. 2011 WWW - TWAW T-Dynamics Campos, R., Jorge, A., & Dias, G. (2011). Using Web Snippets and Query-logs to Measure Implicit Temporal Intents in Queries. In QRU 2011: Proceedings of the Query Representation and Understanding Workshop associated to SIGIR2011: 34th Annual International ACM SIGIR 2011 Conference on Research and Development in Information Retrieval, (pp. 13 – 16). Beijing, China. July 28. 2011 SIGIR - QRU T-Dynamics Shokouhi, M. (2011). Detecting Seasonal Queries by Time-Series Analysis. In SIGIR2011: In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information (pp. 1171 – 1172). Beijing, China. July 24–28: ACM Press. 2011 SIGIR T-Dynamics Dias, G., Campos, R., & Jorge, A. (2011). Future Retrieval: What Does the Future Talk About? In ENIR 2011: Proceedings of the Enriching Information Retrieval Workshop associated to SIGIR2011: 34th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Beijing, China. July 28. 2011 SIGIR - ENIR F-IRetrieval Campos, R., Dias, G., & Jorge, A. M. (2011). An Exploratory Study on the impact of Temporal Features on the Classification and Clustering of Future-Related Web Documents. In L. Antunes, & H. S. Pinto (Eds.), Lecture Notes in Artificial Intelligence - Progress in Artificial Intelligence - EPIA2011: 15th Portuguese Conference on Artificial Intelligence associated to APPIA: Portuguese Association for Artificial Intelligence (Vol. 7026/2011, pp. 581 – 596). Lisboa, Portugal. October 10–13: Springer Berlin / Heidelberg. 2011 EPIA F-IRetrieval Jatowt, A., & Yeung, C. M. (2011). Extracting Collective Expectations about the Future from Large Text Collections. In Proceedings of the CIKM2011: 20th ACM Conference on Information and Knowledge Management (pp. 1259 – 1264). Glasgow, Scotland, UK. October 24–28: ACM Press. 2011 CIKM F-IRetrieval Yeung, C.-m. A., & Jatowt, A. (2011). Studying How the Past is Remembered: Towards Computational History through Large Scale Text Mining. In Proceedings of the CIKM2011: 20th ACM Conference on Information and Knowledge Management (pp. 1231 – 1240). Glasgow, Scotland, UK. October 24–28: ACM Press. 2011 CIKM C-Memory Costa, M., & Silva, M. J., & Couto, F. M. (2014). Learning Temporal-Dependent Ranking Models. In Proceedings of the SIGIR2014: 37th Annual ACM SIGIR Conference (pp. 757–766). Gold Coast, Australia. July 6–11: ACM Press. 2014 SIGIR T-RModels

Temporal markup languages (T-MLanguages) Reference Year Conference/Journal Main Scope Comments Setzer, A., & Gaizauskas, R. (2000). Annotating Events and Temporal Information in Newswire Texts. In LREC2000: Proceedings of the 2nd International Conference on Language Resources and Evaluation. Athens, Greece. May 31 - June 2: ELDA. 2000 LREC T-MLanguages Setzer, A. (2001). Temporal Information in Newswire Articles: An Annotation Scheme and Corpus Study. Sheffield, UK: University of Sheffield. 2001 Phd Thesis T-MLanguages Ferro, L., Mani, I., Sundheim, B., & Wilson, G. (2001). TIDES Temporal Annotation Guidelines. Version 1.0.2. Technical Report, MITRE Corporation, McLean, Virginia, United States. 2001 Technical Report T-MLanguages Pustejovsky, J., Castaño, J., Ingria, R., Sauri, R., Gaizauskas, R., Setzer, A., et al. (2003). TimeML: Robust Specification of Event and Temporal Expression in Text. In IWCS2003: Proceedings of the 5th International Workshop on Computational Semantics, (pp. 28 – 34). Tilburg, Netherlands. January 15–17. 2003 IWCS T-MLanguages Ferro, L., Gerber, L., Mani, I., Sundheim, B., & Wilson, G. (2005). TIDES 2005 Standard for the Annotation of Temporal Expressions. Technical Report, MITRE Corporation, McLean, Virginia, United States. 2005 Technical Report T-MLanguages

Temporal taggers (T-taggers) Reference Year Conference/Journal Main Scope Comments TempEx Module - Tarsqi Toolkit - Mani, I., & Wilson, G. (2000). Robust Temporal Processing of News. In ACL2000: Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (pp. 69 – 76). Hong Kong, China. October 1–8: Association for Computational Linguistics. 2000 ACL T-Taggers Annie - GATE distribution - Cunningham, H., Maynard, D., Bontcheva, K., & Tablan, V. (2002). GATE: A Framework And Graphical Development Environment For Robust NLP Tools And Applications. In ACL2002: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (pp. 168 – 175). Philadelphia, PA, United States. July 6–12: Association for Computational Linguistics. 2002 ACL T-Taggers GUTime - Tarsqi Toolkit 2002 T-Taggers HeidelTime - Strötgen, J., & Gertz, M. (2010). HeidelTime: High Quality Rule-based Extraction and Normalization of Temporal Expressions. In SemEval2010: Proceedings of the 5th International Workshop on Semantic Evaluation associated to ACL2010: 41st Annual Meeting of the Association for Computational Linguistics, (pp. 321 – 324). Uppsala, Sweden. July 11–16. 2010 ACL - SemEval T-Taggers TIMEN Llorens, H., Derczynski, L., Gaizauskas, R. & Saquete, E. (2012). TIMEN: An Open Temporal Expression Normalisation Resource. In LREC2012: Proceedings of the 8th International Conference on Language Resources and Evaluation. Istanbul, Turkey. May 23–25. 2012 LREC T-Taggers Chang, A., & Manning, C. (2012). SUTIME: A Library for Recognizing and Normalizing Time Expressions. In LREC2012: Proceedings of the 8th International Conference on Language Resources and Evaluation. Istanbul, Turkey. May 23–25. 2012 LREC T-Taggers HeidelTime - Strötgen, J., & Gertz, M. (2012). Multilingual and cross-domain temporal tagging. In LRE: Language Resources and Evaluation, 1 - 30. 2012 LRE T-Taggers ManTIME - Filannino, M., Brown, G. & Nenadic G. (2013). ManTIME: Temporal expression identification and normalization in the TempEval-3 challenge. In Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Seventh International Workshop on Semantic Evaluation (SemEval 2013), 53 - 57, Atlanta, Georgia, June 14–15, 2013. 2013 ACL - SemEval T-Taggers online demo