Performance

This page is a variable. The page identifier is Op_en2385
Moderator:Nobody (see all) Click here to sign up.
Give your opinion to the peer rating of the content of this page. {{ #opasnet_rater: }}
Upload data

<section begin=glossary />

Performance is the measure of how well an object fulfills its purpose. In this context, we talk about objects that are used in assessments for describing reality or methods to produce these descriptions.

<section end=glossary />

Research question about performance structure

What is a structure for performance such that it

• covers all aspects of the performance of an assessment,
• is a reflection of the purposes of an assessment,
• can be applied to all attributes of all objects,
• defines an external standard against which the performance can be evaluated,
• defines by whom the performance should be evaluated,
• complies with PSSP ontology.

Attribute	Property evaluated	Reference	Evaluator	Comments
Name	Not interesting to be evaluated
Scope	Relevance	Object's use purpose in its context	User (?)
Definition	Structure: Model uncertainty State: Work done	State-of-the-art Work load needed	Peer-reviewer Participants
Result	Truthlikeness	A golden standard	Expert	Can be divided into calibration and informativeness.

Note that the result of evaluation may change if a different reference is chosen.

Three dimensions: towards the use purpose, the making, and the truth

• Relevance is evaluated in the narrative description of the upper-level object. E.g. the scope of a variable is evaluated in the Definition/narrative description of an assessment.
• State of the description: participant evaluates the state against the resources available or needed. This becomes into the narrative description of the Definition. This can also be evaluated by an external reviewer based on the methodology used. The evaluation comes to Definition/narrative description as well.
• The result is evaluated against the truth. It comes to the narrative descriptioin and is performed by an outside expert against some external golden standard.

Performance is an object itself. These are the attributes:

• Name (not really needed because is always connected to another object.
• Scope: Tells which object and attribute is evaluated.
• Definition: Tells the external standard and the evaluator.
• Result: Tells the result of the evaluation.