Summative evaluation

From RecSysWiki
Revision as of 09:03, 26 September 2011 by Zeno Gantner (talk | contribs) (* Wikipedia: Summative assessment)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

The goal of summative evaluation is to find out whether feature P causes quality X (regardless of the system that uses feature P). The usual summative approach is to test system A versus system B, where these systems only differ on feature P, and then measuring quality X to see if it differs between the two systems. Summative methods include A/B tests (field trials) and controlled experiments.

Researchers planning to do a user-centric recommender system evaluation need to be aware of the trade-offs between formative and summative evaluation.

External links