NII Testbeds and Community for Information access Research
  • NTCIR Official site
  • Conference
  • Organizers
  • Data
  • Important Dates

Overview (NTCIR-11 Temporalia)


The objective of this task is to foster research in temporal information access. Given the fact that time plays crucial role in estimating infromation relevance and validity we believe that sussessful search engines must consider temporal aspects of information in greater detail. We propose a challenge that establishes common grounds for designing and analyzing temporally-aware infromation access systems. We plan to focus on Information Retrieval at NTCIR-11 with potential extension to other applications at NTCIR-12 (hence the task name).


Temporal Information Retrieval has been gaining a lot of interest in IR and related research communities. It can be defined as a subset of document retrieval in which time plays crucial role in estimating document relevance. The objective of this task is to systematize various requirements in Temporal IR and offer a standardized challenge based on which competing systems can be compared and analyzed. Our recent analysis (Joho, et al., 2013) suggests that although many of temporal information needs seek for recent (fresh) information, a good proportion of them also search for information about past incidents as well as future incidents. Although there are several evaluation tasks that involve search and filtering over time (e.g., TDT, NTCIR GeoTime, TREC Temporal Summarization), there is no test collection to measure the performance of search applications across temporal information needs categories such as Past, Recent, Seasonal, and Future (cf. Khodaei and Alonso, 2012) in a systematic way.

Difference from Related Tasks

See this.