Formative evaluation

In formative research, the goal is to improve a certain system A in terms of a certain quality X. The usual formative approach is to test system A qualitatively, focusing on quality X, looking for improvements on certain features P, Q and R that will increase quality X.

Researchers planning to do a user-centric recommender system evaluation need to be aware of the trade-offs between formative and summative evaluation.