Difference between revisions of "Value of information"

From Testiwiki
Jump to: navigation, search
(VOI score added)
(generalised EVPII formula added)
Line 1: Line 1:
 
[[Category:Quality of an object]]
 
[[Category:Quality of an object]]
{{method}}
+
{{method|moderator=Jouni}}
 
[[Category:Glossary term]]<section begin=glossary />
 
[[Category:Glossary term]]<section begin=glossary />
 
:'''Value of information''' (VOI) in decision analysis is the amount a decision maker would be willing to pay for information prior to making a decision.<ref>[[:en:Value of information|Value of information in Wikipedia]]</ref><section end=glossary />
 
:'''Value of information''' (VOI) in decision analysis is the amount a decision maker would be willing to pay for information prior to making a decision.<ref>[[:en:Value of information|Value of information in Wikipedia]]</ref><section end=glossary />
Line 25: Line 25:
  
 
* See [[:en:Decision theory|Decision theory]], [[:en:Value of information|Value of information]], and [[:en:Expected value of perfect information|Expected value of perfect information]].
 
* See [[:en:Decision theory|Decision theory]], [[:en:Value of information|Value of information]], and [[:en:Expected value of perfect information|Expected value of perfect information]].
 +
* There are different kinds of indicators under value of information, depending on what level of information is compared with the current situation:
 +
*; EVPI: Expected value of perfect information (everything is known perfectly)
 +
*; EVPPI: Expected value of partial perfect information (one variable is known perfectly, otherwise current knowledge)
 +
*; EVII: Expected value of imperfect information (things are known better but not perfectly)
 +
*; EVPII: Expected value of partial imperfect information (one variable is known better but not perfectly)
  
 
==Result==
 
==Result==
Line 30: Line 35:
 
===Procedure===
 
===Procedure===
  
  VOI = E(Max(U(d<sub>i</sub>,&theta;))) - Max(E(U(d<sub>i</sub>,&theta;))),  
+
  EVPI = E(Max(U(d<sub>i</sub>,&theta;))) - Max(E(U(d<sub>i</sub>,&theta;))),  
  
 
where E=expectation over uncertain parameters &theta;, Max=maximum over decision options i, U=utility of decision d.
 
where E=expectation over uncertain parameters &theta;, Max=maximum over decision options i, U=utility of decision d.
 +
 +
The general formula for EVPII is:
 +
 +
EVPII = E<sub>&theta;2</sub>(U(Max(E<sub>&theta;2</sub>(U(d<sub>i</sub>,'''&theta;2'''))),&theta;2)) - E<sub>&theta;2</sub>(U(Max(E<sub>&theta;1</sub>(U(d<sub>i</sub>,'''&theta;1'''))),&theta;2)),
 +
 +
where &theta;1 is the prior information and &theta;2 is the posterior (improved) information. EVPPI can be calculated with the same formula in the case where P(&theta;2)=1 iff &theta;2=&theta;1. If &theta; includes all variables of the assessment, the formula gives total, not partial, value of information.
 +
 +
The interpretation of the formula is the following (starting from the innermost parenthesis). The utility of each decision option d<sub>i</sub> is estimated in the world of uncertain variables &theta;. Expectation over &theta; is taken (i.e. the probability distribution is integrated over &theta;), and the best option i of d is selected. The point is that in the first part of the formula, &theta; is described with the better posterior information, while the latter part is based on the poorer prior information. Once the decision has been made, the expected utility is estimated again based on the better posterior information in both the first and second part of the formula. Finally, the difference between the utility after the better and poorer information, respectively, gives the value of information.
  
 
===Management===
 
===Management===

Revision as of 17:27, 6 September 2009


<section begin=glossary />
Value of information (VOI) in decision analysis is the amount a decision maker would be willing to pay for information prior to making a decision.[1]<section end=glossary />

Scope

How can value of information be calculated?

Definition

Input

To calculate value of information, you need

  • a decision to be made,
  • an outcome indicator to be optimised,
  • an optimising function to be used as the criterion for the best decision,
  • an uncertain variable of interest (optional, needed only if partial VOI is calculated for the variable)

Output

Value of information, i.e. the amount of money that the decision-maker is willing, in theory, to pay to obtain a piece of information.

Rationale

  • See Decision theory, Value of information, and Expected value of perfect information.
  • There are different kinds of indicators under value of information, depending on what level of information is compared with the current situation:
    EVPI
    Expected value of perfect information (everything is known perfectly)
    EVPPI
    Expected value of partial perfect information (one variable is known perfectly, otherwise current knowledge)
    EVII
    Expected value of imperfect information (things are known better but not perfectly)
    EVPII
    Expected value of partial imperfect information (one variable is known better but not perfectly)

Result

Procedure

EVPI = E(Max(U(di,θ))) - Max(E(U(di,θ))), 

where E=expectation over uncertain parameters θ, Max=maximum over decision options i, U=utility of decision d.

The general formula for EVPII is:

EVPII = Eθ2(U(Max(Eθ2(U(di,θ2))),θ2)) - Eθ2(U(Max(Eθ1(U(di,θ1))),θ2)),

where θ1 is the prior information and θ2 is the posterior (improved) information. EVPPI can be calculated with the same formula in the case where P(θ2)=1 iff θ2=θ1. If θ includes all variables of the assessment, the formula gives total, not partial, value of information.

The interpretation of the formula is the following (starting from the innermost parenthesis). The utility of each decision option di is estimated in the world of uncertain variables θ. Expectation over θ is taken (i.e. the probability distribution is integrated over θ), and the best option i of d is selected. The point is that in the first part of the formula, θ is described with the better posterior information, while the latter part is based on the poorer prior information. Once the decision has been made, the expected utility is estimated again based on the better posterior information in both the first and second part of the formula. Finally, the difference between the utility after the better and poorer information, respectively, gives the value of information.

Management

How to use the method

Value of information score

The VOI score is the current expected value of perfect information (EVPI) for that variable in an assessment where it is used. If the variable is used is several assessments, it it the sum of EVPIs across all assessments.

See also

References