Quality evaluation criteria

From Testiwiki
Revision as of 05:17, 4 December 2008 by Jouni (talk | contribs) (first draft based on own thinking)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search



Scope

What is a set of quality evaluation measures such that it fulfils the following criteria:

Definition

Data

  • NUSAP criteria could be used here?

Amount of data

Amount of data can be measured with this question: How many sets of independent observations are used as data for defining the object?

Typically, each individual scientific article is one set of observations. However, if several articles are derived from the same observations, they should be counted as one set. There are also intermediate situations. For example, several follow-ups may be published from the same cohort. They are clearly not independent, but a later follow-up clearly includes observations that are not included in the previous one. In this case, the discussion should be whether the previous follow-up has any additional merit given the later one. It might for example be better for describing the impacts of exposures occurring at early stages of the follow-up.

Dependencies

Result

Amount of data is a quantitative measure with the following result domain:

  • Number of independent sources of information. This doesn't need to be an integer, if sources are only partly independent.
  • 0 means a "guesstimate" where the object result is based on general knowledge without any citable sources of information.
  • -1 means a place holder that contains little or no information about the topic; it is just used to make a technically complete object that can be used in testing the usage of the object in e.g. an assessment model.

See also

References