INFS 7410 Project Part 2 – Marking Sheet Criterion % 7 100% 4 50% FAIL 1 0% IMPLEMENTATION The ability to: Understand, implement, and execute advanced IR methods Perform text processing 45 Correct implementations of all three of the methods required by this project specifications. (80% for ANCE and TILDEv2; 100% for ANCE, TILDEv2, three-stage) [9 marks] Correctly implements the ANCE Dense Retriever of the methods required by the project specifications. [5 marks] No implementation; OR Many errors in the implementation. EVALUATION The ability to: Empirically evaluate and compare IR methods Analyse the results of empirical IR evaluation Analyse the statistical significance difference between IR methods’ effectiveness 45 Correct empirical evaluation has been performed Uses all required evaluation measures Reports all results for the provided query sets into appropriate tables Provides graphical analysis of results on a query-by- query basis using appropriate gain-loss plots Provides correct statistical significance analysis within the result table; and correctly describes the statistical analysis performed Provides a written understanding and discussion of the results with respect to the methods [9 marks] Correct empirical evaluation has been performed Uses all required evaluation measures Reports all results for the provided query sets into appropriate tables Provides graphical analysis of results on a query-by-query basis using appropriate gain-loss plots Does not perform statistical significance analysis, or errors are present in the analysis [5 marks] No or only partial empirical evaluation has been conducted, e.g. only on a subset of topics Only report a partial set of evaluation measures WRITE UP Binary score: 0/1 The ability to: Use fluent language with correct grammar, spelling and punctuation Use appropriate paragraph, sentence structure Use appropriate style and tone of writing Produce a professionally presented document, according to the provided template 10 Structure of the document is appropriate and meets expectations Clarity promoted by consistent use of standard grammar, spelling and punctuation Sentences are coherent Paragraph structure effectively developed Fluent, professional style and tone of writing. No proof reading errors Polished professional appearance [2 marks] Written expression and presentation are incoherent, with little or no structure, well below required standard Structure of the document is not appropriate and does not meet expectations Meaning unclear as grammar and/or spelling contain frequent errors. Disorganised or incoherent writing.
