Difference between revisions of "Talk:Kuopio Risk Assessment Workshop 2008"

From Testiwiki
Jump to: navigation, search
m (Draft Lecture outline)
m (Draft Lecture outline: some comments and link updates)
Line 5: Line 5:
 
== Draft Lecture outline ==
 
== Draft Lecture outline ==
  
'''Lecture 1: Introduction to Open Risk Assessment (ORA) and the workshop [[user:Jouni|Jouni]]
+
'''Lecture 1: Introduction to [[Open assessment | Open Risk Assessment (ORA)]] and the workshop [[user:Jouni|Jouni]]
  
 
{{comment|#1: |Should the first lecture purely concentrate on preparing, inspiring and guiding the people to follow up and adopt what will be presented during following days and save the whole general assessment framework overview to the second lecture, or should the general assessment framework overview be more clearly divided between lectures 1 and 2?|--[[User:Mikko Pohjola|Mikko Pohjola]] 11:26, 7 February 2008 (EET)}}
 
{{comment|#1: |Should the first lecture purely concentrate on preparing, inspiring and guiding the people to follow up and adopt what will be presented during following days and save the whole general assessment framework overview to the second lecture, or should the general assessment framework overview be more clearly divided between lectures 1 and 2?|--[[User:Mikko Pohjola|Mikko Pohjola]] 11:26, 7 February 2008 (EET)}}
Line 44: Line 44:
 
** assessment, variable, context, (class), causal diagram
 
** assessment, variable, context, (class), causal diagram
 
** falsifiability → information against a hypothesis
 
** falsifiability → information against a hypothesis
* [[Participating in assessment | open participation]]
+
* [[Participating in assessments | open participation]]
 
** why open participation?
 
** why open participation?
 
*** acceptability, efficiency and relevance
 
*** acceptability, efficiency and relevance
Line 52: Line 52:
  
 
'''Lecture 3: [[Universal products | Information structure of ORA]]: object internal structure (Jouni)
 
'''Lecture 3: [[Universal products | Information structure of ORA]]: object internal structure (Jouni)
 +
 +
{{comment|#3: |This lecture will provide the participants at least the necessary understanding in order to design one's own variable in the group work. |--[[User:Mikko Pohjola|Mikko Pohjola]] 15:16, 7 February 2008 (EET)}}
 
* name, scope, definition, result
 
* name, scope, definition, result
 
** data, causality, unit, formula
 
** data, causality, unit, formula
* [[ Variable | data connections vs. causal connections]]
+
* [[Variable | data connections vs. causal connections]]
 
* content, description and discussion
 
* content, description and discussion
  
  
 
'''Lecture 4: [[Universal products | Information structure of ORA]]: relations between objects (Mikko)
 
'''Lecture 4: [[Universal products | Information structure of ORA]]: relations between objects (Mikko)
 +
 +
{{comment|#4: |This lecture will prepare the participants for combining the variables into a complete assessment in the group work.|--[[User:Mikko Pohjola|Mikko Pohjola]] 15:16, 7 February 2008 (EET)}}
 
* [[Variable | variable]], [[Assessment | assessment]], context, [[Class | (class)]]
 
* [[Variable | variable]], [[Assessment | assessment]], context, [[Class | (class)]]
 
* [[Drawing a causal diagram | presenting assessments as]] [[Causal diagram | causal diagrams]]
 
* [[Drawing a causal diagram | presenting assessments as]] [[Causal diagram | causal diagrams]]
  
  
'''Lecture 5: [[Participating in assessment | participating in assessments]]: [[:en:pragma-dialectics | argumentation]] (Mikko)
+
'''Lecture 5: [[Participating in assessments | participating in assessments]]: [[:en:pragma-dialectics | argumentation]] (Mikko)
 +
 
 +
{{comment|#5: |This lecture will explain how contributing to an assessment happens in particular by means of formal argumentation and give guidance on how to contribute to the assessment outside one's own variable in the group work.|--[[User:Mikko Pohjola|Mikko Pohjola]] 15:16, 7 February 2008 (EET)}}
 
* [[Dealing with disputes | dealing with disputes]]: discussion, commenting and argumentation
 
* [[Dealing with disputes | dealing with disputes]]: discussion, commenting and argumentation
 
* argumentation theory ([[:en:pragma-dialectics|pragma-dialectics]])
 
* argumentation theory ([[:en:pragma-dialectics|pragma-dialectics]])
Line 74: Line 80:
  
  
'''Lecture 6: [[Participating in assessment | participating in assessments]]: moderation and quality control (Jouni)
+
'''Lecture 6: [[Participating in assessments | participating in assessments]]: moderation and quality control (Jouni)
 +
 
 +
{{comment|#6: |This lecture will discuss one of the most criticized point in ORA; quality control, and will explain how contributions of an unorganized group of participants can be managed without loss of integrity and/or reliability.|--[[User:Mikko Pohjola|Mikko Pohjola]] 15:16, 7 February 2008 (EET)}}
 
* principles of open participation
 
* principles of open participation
 
* reader, contributor, moderator, board of moderators
 
* reader, contributor, moderator, board of moderators
Line 83: Line 91:
  
  
'''Lecture 7: [[Evaluating assessment performance | Evaluating assessment performance]] (Mikko)
+
'''Lecture 7: [[Evaluating assessment performance | evaluating assessment performance]] (Mikko)
* [[Properties of good assessments | properties of good assessments]]
+
 
 +
{{comment|#7: |This lecture will give guidance on how the group work output could be improved and how the overall outcome can be assessed.|--[[User:Mikko Pohjola|Mikko Pohjola]] 15:16, 7 February 2008 (EET)}}
 +
* [[Purpose and properties of good assessments | properties of good assessments]]
 
** quality of content: informativeness, calibration and relevance
 
** quality of content: informativeness, calibration and relevance
 
** applicability: availability, usability and acceptability
 
** applicability: availability, usability and acceptability
Line 93: Line 103:
  
 
'''Lecture 8: [[Assessing uncertainty | assessing uncertainties]] (Jouni)
 
'''Lecture 8: [[Assessing uncertainty | assessing uncertainties]] (Jouni)
 +
 +
{{comment|#8: |This lecture will address specifically how uncertainty can be assessed within the overall performance assessment.|--[[User:Mikko Pohjola|Mikko Pohjola]] 15:16, 7 February 2008 (EET)}}
 
* probabilistic (real) uncertainties: informativeness, calibration about result
 
* probabilistic (real) uncertainties: informativeness, calibration about result
 
* model "uncertainties": about definition
 
* model "uncertainties": about definition
 
* relevance: about scope
 
* relevance: about scope
 
* variability vs uncertainty
 
* variability vs uncertainty

Revision as of 13:16, 7 February 2008

Post your questions and comments here

If you have any questions and or comments regarding anything related to the workshop, please post them here and we will try to sort them out. -- Mikko Pohjola 10:10, 5 February 2008 (EET)

Draft Lecture outline

Lecture 1: Introduction to Open Risk Assessment (ORA) and the workshop Jouni

--#1: : Should the first lecture purely concentrate on preparing, inspiring and guiding the people to follow up and adopt what will be presented during following days and save the whole general assessment framework overview to the second lecture, or should the general assessment framework overview be more clearly divided between lectures 1 and 2? --Mikko Pohjola 11:26, 7 February 2008 (EET)

  • Forget everything you knew about risk assessment
  • During this week, we will describe a new approach to risk assessment. It has new developments from the theoretical foundation all the way to practical computer tools.
    • a new ontological foundation
    • strictly object-oriented approach
    • a new structure for objects
    • traditional methods for processing information, but organised in a more systematic way
    • tools that enable open collaboration
    • data sources that are directly available and applicable
  • ORA is about information processing. The information is about the real world.
  • A major aim of the system is to make the work systematic, reuse existing pieces of information, and save time and resources.
  • What is the most efficient way of doing ORA?
  • Practical way: short discussions only; all questions put into wiki and answered by the following day.
  • critical scientific disciplines you should be aware of
    • decision analysis
    • probability theory
    • graph theory
    • pragma-dialectical argumentation theory


Lecture 2: General assessment framework (Mikko)

--#2: : This lecture should provide an overview of things coming up during the workshop and (perhaps?) an overview of most important things that will not be covered during the workshop. --Mikko Pohjola 11:26, 7 February 2008 (EET)


Lecture 3: Information structure of ORA: object internal structure (Jouni)

--#3: : This lecture will provide the participants at least the necessary understanding in order to design one's own variable in the group work. --Mikko Pohjola 15:16, 7 February 2008 (EET)


Lecture 4: Information structure of ORA: relations between objects (Mikko)

--#4: : This lecture will prepare the participants for combining the variables into a complete assessment in the group work. --Mikko Pohjola 15:16, 7 February 2008 (EET)


Lecture 5: participating in assessments: argumentation (Mikko)

--#5: : This lecture will explain how contributing to an assessment happens in particular by means of formal argumentation and give guidance on how to contribute to the assessment outside one's own variable in the group work. --Mikko Pohjola 15:16, 7 February 2008 (EET)

  • dealing with disputes: discussion, commenting and argumentation
  • argumentation theory (pragma-dialectics)
    • argument is always about a statement
    • validity of an argument
    • attack
    • defend
    • signature
    • comment


Lecture 6: participating in assessments: moderation and quality control (Jouni)

--#6: : This lecture will discuss one of the most criticized point in ORA; quality control, and will explain how contributions of an unorganized group of participants can be managed without loss of integrity and/or reliability. --Mikko Pohjola 15:16, 7 February 2008 (EET)

  • principles of open participation
  • reader, contributor, moderator, board of moderators
  • different levels of protection
    • openly available page
    • page closed; discussion available
    • discussion managed by moderator, contributions via nuggets


Lecture 7: evaluating assessment performance (Mikko)

--#7: : This lecture will give guidance on how the group work output could be improved and how the overall outcome can be assessed. --Mikko Pohjola 15:16, 7 February 2008 (EET)

  • properties of good assessments
    • quality of content: informativeness, calibration and relevance
    • applicability: availability, usability and acceptability
    • efficiency: intra-assessment and inter-assessment efficiency
  • relations between properties and information structure
  • evaluation as an inherent part of the process


Lecture 8: assessing uncertainties (Jouni)

--#8: : This lecture will address specifically how uncertainty can be assessed within the overall performance assessment. --Mikko Pohjola 15:16, 7 February 2008 (EET)

  • probabilistic (real) uncertainties: informativeness, calibration about result
  • model "uncertainties": about definition
  • relevance: about scope
  • variability vs uncertainty