IR Chapt 5
IR Chapt 5
Chapter 5:
Retrieval Evaluation
IR Evaluation
How ?
Types of Evaluation Strategies
•System-centered studies
– Given documents, queries, and relevance judgments
• Try several variations of the system
• Measure which system returns the “best” hit list
•User-centered studies
– Given several users, and at least two retrieval systems
• Have each user try the same task on both systems
• Measure which system works the “best” for users information need
Performance measures (Recall, Precision, etc.)
– An external judge
Chapter 6:
Query Languages and Operations
Introduction
• Information is the main value of Information Society.
Documents containing all the query words are ranked at the top.
Documents containing only one query word are ranked at
bottom.
Frequency counts may still be used to break ties among documents
that contain the same query words.
Cont…
4. Proximity queries:
Restrict the distance within a document between two search
terms.
Important for large documents in which the two search words
may appear in different contexts.
Fixed structure
Hypertext structure
Hierarchical structure
Fixed structure
Document is divided to a fixed set of fields, much like a filled
form.
Chapter 5 and 6