NII Testbeds and Community for Information access Research
  • NTCIR Official site
  • Conference
  • Organizers
  • Data
  • Important Dates

(NTCIR-11 Temporalia)

Welcome to the home page of NTCIR Temporal Information Access (Temporalia) Task. Temporalia is a new pilot task accepted to run at NTCIR-11. Please subscribe to our discussion group if you're interested in the task.

Please contact us for informal enquiries: tc4fia at googlegroups dot com.

Paper submission deadline: September 15th, 2014 (Hawaii Time)
Camera-Ready Paper submission deadline: November 1st, 2014 (Hawaii Time)

Temporalia is also described in the recent publication:

Hideo Joho, Adam Jatowt, and Roi Blanco: NTCIR Temporalia: A Test Collection for Temporal Information Access Research, Proceedings of the 4th Temporal Web Analytics Workshop (TempWeb 2014), ACM Press, Seoul, Korea, pp. 845-849

Follow us



26 Oct.
Reminder: Camera-ready copy of your NTCIR-11 participant paper is due on November 1st, 2014 (Hawaii Time).

30 Aug.
Complete data set (qrels, runs, evaluation results, etc.) has been released to active participants of @ntcirtemporalia! #ntcir11

21 Aug.
Instruction for participant paper submission was sent to active participants. The deadline is Sep 15, 2014!

8 Aug.
TIR results are now released to participants! Enjoy!

1 Aug.
TQIC evaluation results have been released to participants! TIR results will be released later next week.

16 Jun.
Two weeks to go until the deadline of NTCIR-11 Temporalia formal run submissions! https://sites.google.com/site/ntcirtemporalia/important-dates … #ntcirtemporalia #ntcir11

14 May.
[Important] You must freeze system development before even looking at formal run data! See https://sites.google.com/site/ntcirtemporalia/howto #ntcirtemporalia#ntcir11

8 May.
Formal Run dataset is now available! NTCIR office will send an instruction soon. Have fun! https://sites.google.com/site/ntcirtemporalia/ #ntcirtemporalia#ntcir11

29 Apr.
The release of formal run data will be postponed for a week to May 8, 2014. Stay tuned. https://sites.google.com/site/ntcirtemporalia/important-dates #ntcirtemporalia#ntcir11

18 Apr.
Our paper on Temporalia at TempWeb2014 workshop is available online now. http://dl.acm.org/citation.cfm?id=2579044 #ntcirtemporalia#ntcir11

16 Apr.
Initial results of dry runs have been sent to submitted participants! Look forward your feedback for formal runs. #ntcirtemporalia#ntcir11

9 Apr.
“Temporalia” description has appeared at Temporal Web Analytics Workshop (TempWeb2014) http://temporalweb.net/  at WWW2014. #ntcirtemporalia

19 Mar.
Submission page is open for dry runs! Please read the task description & run format first. https://sites.google.com/site/ntcirtemporalia/submission #ntcirtemporalia #ntcir11

17 Mar.
Getting ready for dry run submissions? Check out the run formats of TCIQ and TIR subtasks! https://sites.google.com/site/ntcirtemporalia/run-formats #ntcirtemporalia #ntcir11

20 Feb.
Unofficial feedback documents were released to support TIR subtask development. Check out [NTCIR-Temporalia:8]  #ntcirtemporalia  #ntcir11

9 Feb.

Want to remove tags from the body of the documents? Have a look at our How to page. https://sites.google.com/site/ntcirtemporalia/howto  #ntcirtemporalia #ntcir11

5 Feb.
A welcome message with detailed instruction has been sent to registered research groups! [NTCIR-Temporalia:5] #ntcirtemporalia #ntcir11

24 Jan.
Temporalia task schedule has been updated. Next up is the dry run submissions by Mar 31st. sites.google.com/site/ntcirtemp… #ntcirtemporalia #ntcir11

23 Jan.
We're pleased to announce that more than 20 teams have signed up for NTCIR-11 Temporalia! https://sites.google.com/site/ntcirtemporalia/  #ntcirtemporalia #ntcir11

23 Jan.
Topics & Queries for NTCIR-11 Temporalia Task is now available for dry runs! Go and get it! http://research.nii.ac.jp/ntcir/ntcir-11/data.html  #ntcirtemporalia #ntcir11

16 Jan.
For those who are not accessible to Google/Facebook, here is a mirror site. http://ntcir.nii.ac.jp/Temporalia/NTCIR-11-Temporalia/  #ntcirtemporalia #ntcir11

16 Jan
CFP: NTCIR-11 Temporal Information Access (Temporalia). Woking on IR, NLP, ML and related fields? Please join us! https://sites.google.com/site/ntcirtemporalia/cfp 

5 Jan.
Although we're very close to the completion of work, the release of dry run data set will be delayed for a week or so. Will keep you posted.

5 Jan.
Document collection is ready to obtain now! Please follow the instruction on the website. https://sites.google.com/site/ntcirtemporalia/document-collection  #ntcirtemporalia #ntcir11

21 Dec.
Temporalia Task Description has been updated with example topics. Please check it out and give us your feedback. https://sites.google.com/site/ntcirtemporalia/task-description 

20 Dec.
Registration Deadline has been extended to Jan 20, 2014. More information about the task will be updated really soon!

15 Oct.
How is NTCIR Temporalia different from other test collections? Read: https://sites.google.com/site/ntcirtemporalia/comparison  #ntcirtemporalia #ntcir11

25 Sep.
kickoff slides and videos now available!
http://research.nii.ac.jp/ntcir/ntcir-11/kickoff.html  check out the new tasks!

2 Sep.
Watch Adam introducing Temporalia at NTCIR-11 Kick-off Event. http://www.ustream.tv/recorded/38142231  #ntcirtemporalia #ntcir11

24 Jul.
The main NTCIR-11 website is up! The Kick-Off Event is 2nd Sept @ NII, Tokyo. http://research.nii.ac.jp/ntcir/ntcir-11/ #ntcir11 #ntcirtemporalia

1 Jul.

Temporal Information Access (Temporalia) has been accepted as NTCIR-11 Pilot Task! Updates from http://bit.ly/17x8aD3  #ntcirtemporalia