Difference between revisions of "Evaluating assessment performance"
From Testiwiki
m (→Result) |
m |
||
| Line 10: | Line 10: | ||
'''Intended audience:''' Researchers (especially at doctoral student level) in any field of science (mainly natural, not social scientists). | '''Intended audience:''' Researchers (especially at doctoral student level) in any field of science (mainly natural, not social scientists). | ||
| − | '''Duration:''' 1 | + | '''Duration:''' 1 hour 15 minutes |
==Definition== | ==Definition== | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
In order to understand this lecture it is recommended to first acquaint oneself with the following lectures: | In order to understand this lecture it is recommended to first acquaint oneself with the following lectures: | ||
* [[Open assessment in research]] | * [[Open assessment in research]] | ||
* [[Assessments - science-based decision support]] | * [[Assessments - science-based decision support]] | ||
| − | * Variables - interpretations of | + | * [[Variables - interpretations of reality]] |
| − | * Science necessitates collaboration | + | * [[Science necessitates collaboration]] |
==Result== | ==Result== | ||
| − | * Introduction through analogy: | + | * Assessments must meet needs their of their use |
| + | * Assessments must strive for truth | ||
| + | * Both requirements must be met, which is not easy, but possible | ||
| + | * Assessment is a business of creating understanding about reality | ||
| + | |||
| + | * Introduction through analogy: assessment (product) vs. mobile phone → product, production, use | ||
| + | ** qoc - phone functionalities | ||
| + | ** applicability - user interface, appearance design, use context, packaging, logistics, marketing, sales | ||
| + | ** efficiency - mass production/customization: components, code, assembly | ||
* Performance related concepts in the context of assessments as science-based decision support: properties of good assessment | * Performance related concepts in the context of assessments as science-based decision support: properties of good assessment | ||
| − | * Contemporary conventions: quality assurance/control | + | * Contemporary conventions: |
| + | ** quality assurance/control: process approach | ||
| + | ** uncertainty assessment: product approach | ||
* Assessments serve 2 masters: truth (science) and practical need (societal decision making, policy) | * Assessments serve 2 masters: truth (science) and practical need (societal decision making, policy) | ||
* Evaluation: points of reference and criteria, | * Evaluation: points of reference and criteria, | ||
Revision as of 07:26, 15 February 2009
This page is a lecture.
The page identifier is Op_en2082 |
|---|
| Moderator:Nobody (see all) Click here to sign up. |
|
Give your opinion to the peer rating of the content of this page. |
| Upload data
|
Evaluating assessment performance is a lecture about the factors that constitute the performance, the goodness, of assessments and they can be evaluated within a single general framework. This page was converted into a lecture as there are other descriptive pages already existing about the same topic. The old content was archived and can be found here.
Scope
Purpose: To describe what assessments are about overall, what are the factors that constitute the overall performance of assessment, how they are interrelated, and how they can be evaluated.
Intended audience: Researchers (especially at doctoral student level) in any field of science (mainly natural, not social scientists).
Duration: 1 hour 15 minutes
Definition
In order to understand this lecture it is recommended to first acquaint oneself with the following lectures:
- Open assessment in research
- Assessments - science-based decision support
- Variables - interpretations of reality
- Science necessitates collaboration
Result
- Assessments must meet needs their of their use
- Assessments must strive for truth
- Both requirements must be met, which is not easy, but possible
- Assessment is a business of creating understanding about reality
- Introduction through analogy: assessment (product) vs. mobile phone → product, production, use
- qoc - phone functionalities
- applicability - user interface, appearance design, use context, packaging, logistics, marketing, sales
- efficiency - mass production/customization: components, code, assembly
- Performance related concepts in the context of assessments as science-based decision support: properties of good assessment
- Contemporary conventions:
- quality assurance/control: process approach
- uncertainty assessment: product approach
- Assessments serve 2 masters: truth (science) and practical need (societal decision making, policy)
- Evaluation: points of reference and criteria,
- Properties of good assessments as a means of managing design and execution or evaluating past work
- properties of good assessments is not an orthogonal set
- applicability depends on quality of content, efficiency depends on quality of content and applicability
