Evaluation and results for the various tasks of the Book Search Track

Book Retrieval,
Page in Context,
Structure Extraction, and
Active Reading.

Book Retrieval task

Coming Soon...

Page in Context task

Coming Soon...

Structure Extraction task

The aim of this task is to test and compare automatic techniques for deriving structural information from digitized books and building a hyperlinked table of contents.

Evaluation documents

Description of the Evaluation Measures of the Structure Extraction track

Evaluation Data

Groundtruth file ("ideal" tables of contents)
Evaluation Tool

Results

Each RunID is linked to further details on the evaluation of this run.

RunID	Participant	F-measure (complete entries)
MDCS	Microsoft Development Center Serbia	53,47%
MDCS_NAMES_AND_TITLES	Microsoft Development Center Serbia	52,59%
MDCS_TITLES_ONLY	Microsoft Development Center Serbia	23,24%
HF_ToC_prg_Jaccard	Xerox Research Centre Europe	10,27%
HF_ToC_prg_OCR	Xerox Research Centre Europe	10,18%
HF_TPF_ToC_prg_Jaccard	Xerox Research Centre Europe	10,10%
HF_ToC_lin_Jaccard	Xerox Research Centre Europe	5,05%

Active reading task

Coming Soon...