Difference between revisions of "Assessment"

From Testiwiki
Jump to: navigation, search
(todo added)
Line 1: Line 1:
 
[[Category:Universal object]]
 
[[Category:Universal object]]
 
[[Category:Glossary term]]  
 
[[Category:Glossary term]]  
{{encyclopedia}}
+
{{method}}
 
<section begin=glossary />
 
<section begin=glossary />
 
:'''Assessment''' is a process for describing a particular piece of reality in aim to fulfill a certain information need in a decision-making situation. The word assessment can also mean the end product of this process, i.e. an assessment report of some kind. Often it is clear from the context whether the term assessment refers to the making of the report or the report itself. Methodologically, these are two different objects, called the assessment process and the assessment product, respectively.
 
:'''Assessment''' is a process for describing a particular piece of reality in aim to fulfill a certain information need in a decision-making situation. The word assessment can also mean the end product of this process, i.e. an assessment report of some kind. Often it is clear from the context whether the term assessment refers to the making of the report or the report itself. Methodologically, these are two different objects, called the assessment process and the assessment product, respectively.
Line 8: Line 8:
  
 
{{todo|Hei Timo! Kun annoin tehtävän yhdistää mm. sivut [[Assessment]] ja [[Assessment structure]] niin tarkoitin, että myös sisältö siirretään sille sivulle joka jätetään olemaan. Nyt [[Assessment structure]]n tietoja ei käyttäjä löytäisi ellei tietäisi erikseen etsiä sivun historiasta. Voitko siis kaivella piiloutuneet tiedot, siis esim. [[Assessment structure]] tiedot sivulle [[Assessment]]? Ja huomaa, että keskustelusivuille pitää tehdä sama! --[[User:Jouni|Jouni]] 11:26, 6 July 2012 (EEST)|Timo Ikonen|project=Opasnet}}
 
{{todo|Hei Timo! Kun annoin tehtävän yhdistää mm. sivut [[Assessment]] ja [[Assessment structure]] niin tarkoitin, että myös sisältö siirretään sille sivulle joka jätetään olemaan. Nyt [[Assessment structure]]n tietoja ei käyttäjä löytäisi ellei tietäisi erikseen etsiä sivun historiasta. Voitko siis kaivella piiloutuneet tiedot, siis esim. [[Assessment structure]] tiedot sivulle [[Assessment]]? Ja huomaa, että keskustelusivuille pitää tehdä sama! --[[User:Jouni|Jouni]] 11:26, 6 July 2012 (EEST)|Timo Ikonen|project=Opasnet}}
 +
 +
 +
==Question==
 +
 +
;What is a structure for an assessment so that it:
 +
:* contains a description of a certain piece of reality {{reslink|Rename risk assessment}},
 +
:* the description is produced according to the use [[Purpose and properties of good assessments|purposes]] of the product,
 +
:* describes all the relevant phenomena that connect the decision under consideration and outcomes of special interest (called indicators),
 +
:* combines [[Value judgement|value judgements]] with the descriptions of physical phenomena
 +
:* can be applied in any domain,
 +
:* inherits the main structure from [[universal object]]s,
 +
:* complies with the [[PSSP]] ontology,
 +
:* complies with decision analysis,
 +
:* complies with Bayesian networks?
 +
 +
==Answer==
 +
 +
All assessments aim to have a common structure so as to enable effective, partially automatic tools for the analysis of information. An assessment has a set of attributes, which have their own subattributes.
 +
 +
===Name===
 +
 +
Identifier for the assessment.
 +
 +
===Scope===
 +
 +
Defines the purpose, boundaries and contents of the assessment. Scope consist of subattributes.
 +
; Question: What is the research question or -questions whose answers are sought by means of the assessment? What is the meaning of the assessment?
 +
; Boundaries: Where are the boundaries of observation drawn? In other words, which factors are noted and which are left outside the observation.
 +
; Intended use and users: Who is the assessment made for? Whose information needs does the assessment serve?
 +
; Participants: Those who may participate in the making of the assessment. The minimum group of people for a successful assessment is always described. If some groups must be excluded, this must be explicitly motivated.
 +
; Decisions: Which decisions and their options are included in the assessment? Furthermore, there might exist [[:op_en:scenario|scenarios]] that are not decisions, for instance if some possibilities are excluded from the observation in order to clarify the situation. For example, one could ask which climate change adaptation acts should be executed in a situation where the average temperature rises over two degrees centigrade. In this case, all the scenarios where the temperature does not rise over two degrees are excluded from the assessment. This is clearly not a decision, but is treated as such by means of information technology.
 +
 +
===Answer===
 +
 +
Gives the best possible answers to the questions asked in scope based on the information collected. Answer is divided into two parts:
 +
; Results: Answers to all of the research questions asked in all of the variables and the assessment. Also includes the results of the analyses mentioned in the rationale.
 +
; Conclusions: A reasoning based on the answers about what this information means regarding the meaning of the assessment.
 +
 +
===Rationale===
 +
 +
Includes all the information that is required for a meaningful answer. Rationale includes multiple subattributes.
 +
; [[Stakeholders]]: What stakeholders relate to the subject of the assessment? What are their interests and goals?
 +
; [[Variable]]s: What variables or descriptions of a particular phenomenon are needed in order to carry out the assessment? How do they relate to each other (through causation or other ways)? Among these it is necessary to distinguish three kinds of objects.
 +
:; Ordinary variables: Describe a phenomenon in the physical world and are often studied by scientific means.
 +
:; Value variables: Describe people's values or what they think of as good or bad. In practise, values are processed as though they could be processed by scientific means by making observations on people's behaviour and opinions.
 +
:; Methods: Describe their subject indirectly by answering the question " how can I find the answer to question X?" When using a method, the answer can only be found when it is connected to the correct frame of reference. For example, a method may include emission factors for a car, but the emissions that are the subject of the question can only be calculated when another part of the assessment produces the information how many kilometres are driven. To be exact, methods are not variables, but are tabulated and included in graphs like variables are.
 +
; Analyses: What statistical or other analyses can be made based on the information gathered? Typical analyses are decision analysis (which of the decision alternatives produces the best expected outcome) and value of data analysis (how large of a detriment to the decisionmaker do the uncertainties of different variables cause).
 +
; Indices: What indices are used in the assessment and what are cut out as unnecessary and when?
  
 
== See also ==
 
== See also ==
 
* [[Assessment structure]]
 

Revision as of 12:15, 10 July 2012


<section begin=glossary />

Assessment is a process for describing a particular piece of reality in aim to fulfill a certain information need in a decision-making situation. The word assessment can also mean the end product of this process, i.e. an assessment report of some kind. Often it is clear from the context whether the term assessment refers to the making of the report or the report itself. Methodologically, these are two different objects, called the assessment process and the assessment product, respectively.

<section end=glossary /> R↻

TODO: {{#todo:Hei Timo! Kun annoin tehtävän yhdistää mm. sivut Assessment ja Assessment structure niin tarkoitin, että myös sisältö siirretään sille sivulle joka jätetään olemaan. Nyt Assessment structuren tietoja ei käyttäjä löytäisi ellei tietäisi erikseen etsiä sivun historiasta. Voitko siis kaivella piiloutuneet tiedot, siis esim. Assessment structure tiedot sivulle Assessment? Ja huomaa, että keskustelusivuille pitää tehdä sama! --Jouni 11:26, 6 July 2012 (EEST)|Timo Ikonen|Opasnet}}


Question

What is a structure for an assessment so that it
  • contains a description of a certain piece of reality R↻ ,
  • the description is produced according to the use purposes of the product,
  • describes all the relevant phenomena that connect the decision under consideration and outcomes of special interest (called indicators),
  • combines value judgements with the descriptions of physical phenomena
  • can be applied in any domain,
  • inherits the main structure from universal objects,
  • complies with the PSSP ontology,
  • complies with decision analysis,
  • complies with Bayesian networks?

Answer

All assessments aim to have a common structure so as to enable effective, partially automatic tools for the analysis of information. An assessment has a set of attributes, which have their own subattributes.

Name

Identifier for the assessment.

Scope

Defines the purpose, boundaries and contents of the assessment. Scope consist of subattributes.

Question
What is the research question or -questions whose answers are sought by means of the assessment? What is the meaning of the assessment?
Boundaries
Where are the boundaries of observation drawn? In other words, which factors are noted and which are left outside the observation.
Intended use and users
Who is the assessment made for? Whose information needs does the assessment serve?
Participants
Those who may participate in the making of the assessment. The minimum group of people for a successful assessment is always described. If some groups must be excluded, this must be explicitly motivated.
Decisions
Which decisions and their options are included in the assessment? Furthermore, there might exist scenarios that are not decisions, for instance if some possibilities are excluded from the observation in order to clarify the situation. For example, one could ask which climate change adaptation acts should be executed in a situation where the average temperature rises over two degrees centigrade. In this case, all the scenarios where the temperature does not rise over two degrees are excluded from the assessment. This is clearly not a decision, but is treated as such by means of information technology.

Answer

Gives the best possible answers to the questions asked in scope based on the information collected. Answer is divided into two parts:

Results
Answers to all of the research questions asked in all of the variables and the assessment. Also includes the results of the analyses mentioned in the rationale.
Conclusions
A reasoning based on the answers about what this information means regarding the meaning of the assessment.

Rationale

Includes all the information that is required for a meaningful answer. Rationale includes multiple subattributes.

Stakeholders
What stakeholders relate to the subject of the assessment? What are their interests and goals?
Variables
What variables or descriptions of a particular phenomenon are needed in order to carry out the assessment? How do they relate to each other (through causation or other ways)? Among these it is necessary to distinguish three kinds of objects.
Ordinary variables
Describe a phenomenon in the physical world and are often studied by scientific means.
Value variables
Describe people's values or what they think of as good or bad. In practise, values are processed as though they could be processed by scientific means by making observations on people's behaviour and opinions.
Methods
Describe their subject indirectly by answering the question " how can I find the answer to question X?" When using a method, the answer can only be found when it is connected to the correct frame of reference. For example, a method may include emission factors for a car, but the emissions that are the subject of the question can only be calculated when another part of the assessment produces the information how many kilometres are driven. To be exact, methods are not variables, but are tabulated and included in graphs like variables are.
Analyses
What statistical or other analyses can be made based on the information gathered? Typical analyses are decision analysis (which of the decision alternatives produces the best expected outcome) and value of data analysis (how large of a detriment to the decisionmaker do the uncertainties of different variables cause).
Indices
What indices are used in the assessment and what are cut out as unnecessary and when?

See also