Difference between revisions of "Opasnet brochure"

From Testiwiki
Jump to: navigation, search
(→‎Result: copied from open assessment and edited; not finished)
m (→‎Result)
 
(5 intermediate revisions by one other user not shown)
Line 1: Line 1:
 +
[[Op_fi:Opasnet-esite]]
 
[[Category:Opasnet]]
 
[[Category:Opasnet]]
−
{{lecture}}
+
{{lecture|moderator=Jouni}}
 +
 
 
==Scope==
 
==Scope==
  
Line 48: Line 50:
 
==Result==
 
==Result==
  
−
See the Power Point file for printing out the brochure: [[Image:Opasnet brochure.ppt]]. The texts in the brochure are presented  below.
+
See the Power Point file for printing out the brochure: [[Image:Opasnet brochure.ppt]]. The texts in the brochure are presented  below. Posters made for text below: [[Image:Opasnet poster JAN2011.ppt]].
 +
 
 +
 
 +
===Open assessment: developing shared understanding for practical use===
 +
 
 +
Jouni T. Tuomisto<sup>1</sup>, Mikko V. Pohjola<sup>1</sup>
 +
 
 +
1) National Institute for Health and Welfare, Kuopio, Finland
  
 +
Corresponding author: Jouni Tuomisto (jouni.tuomisto(at)thl.fi)
  
−
Anyone can solve common problems
+
Keywords: Open assessment, impact assessment, policy support, decision-making, mass collaboration
  
 
Aim:  
 
Aim:  
Line 59: Line 69:
 
Abstract:
 
Abstract:
  
−
The world is packed with common problems awaiting for solutions - global warming, urban air pollution, contaminants in drinking water and food to name a few. Many people would be willing to make an effort in solving these problems but so far have been lacking practical means to contribute. Open assessment is a method that aims to offer rules and practices for collecting and synthesising information by self-organised groups into useful pieces (or objects) of information. In practice, the work is done using a web-workspace called Opasnet (en.opasnet.org) that is open and freely available to all.
+
The world is packed with common problems awaiting for solutions - global warming or urban air pollution to name a few. Many people would be willing to make an effort in solving these problems but so far have been lacking practical means to contribute. Open assessment is a method that aims to offer rules and practices for collecting and synthesising information by self-organised groups into useful pieces (or objects) of information to guide decisions.
  
−
The information needed for making a decision is organised as an assessment that predicts the impacts of different decision options on some outcomes of interest. Decisions, outcomes, and other issues are modelled as distinct and self-standing information objects called variables. In practice, assessments and variables are web pages in Opasnet. They contain all information (text, numerical values, and software code) needed to describe and actually run that part of an assessment model.
+
In open assessment, the information needed for making a decision is organised as an assessment that predicts the impacts of different decision options on some outcomes of interest. Decisions, outcomes, and other particular issues are modelled as distinct and self-standing information objects called variables. In practice, a variable is a pair of web pages (one for content about an issue, another for discussion about the content) in an open web-workspace Opasnet (http://en.opasnet.org). They contain all information (text, numerical values, and software code) needed to describe and actually run that part of an assessment model.
  
−
Each object (or page) contains information about a particular issue.  Each page also has the same, universal structure: a research question (what is the issue?), rationale (what do we know about the issue?), and result (what is our current best answer to the research question?). The descriptions of these issues are built on a web page, and anyone can participate in reading, evaluating, and contributing just as in Wikipedia. The content reflects the shared understanding by the participating group about the topic. Trialogue is a concept where shared information objects are specifically used as a major means to communicate knowledge between group members. As the group gets larger and the contributions more numerous, the content asymptotically approaches the best current scientific knowledge about the topic. Importantly, the same code of conduct applies to work on all pages irrespective of their maturity.
+
Pages have a universal structure: a research question (what is the issue?), rationale (what do we know about the issue?), and result (what is our current best answer to the research question?). Anyone can participate in reading, evaluating, and contributing to web page content just as in Wikipedia. The content reflects and communicates the shared understanding of the issue in the participating group. As the group gets larger and the contributions richer, the content asymptotically approaches the best current scientific knowledge about the issue.  
  
−
Inference rules (also called discussion rules) are used to decide what to believe about a topic, i.e. what should be written to its content page. The rules are summarised as follows:
+
There are rules (summarised below) to manage all discussions about a particular issue (documented on its discussion page) and then to decide what to believe about it (documented on its content page).
  
−
Anyone can promote a statement about anything (promote = claim that the statement is true). A statement can be factual (what is?) or moral (what should be?) by nature. A promoted statement is considered valid unless it is invalidated (i.e., convincingly shown not to be true). The validity of a statement is always conditional to a particular group (which is or is not convinced). Moral statement are only applied within an explicit field, e.g. within a country or within a profession.  
+
Anyone can promote a statement about anything. A statement can be factual (what is?) or moral (what should be?) by nature. A promoted statement is considered valid unless it is invalidated (i.e., convincingly attacked with a valid statement). The validity of a statement is always conditional to a particular group (which is or is not convinced).
  
−
Statements can be defended or attacked with arguments, which are themselves treated as statements of smaller discussions. Thus, a hierarchical structure of defending and attacking arguments is created. When the discussion is resolved, the content of all valid statements is incorporated into the information object. All resolutions are temporary, and anyone can reopen a discussion.
+
Statements can be defended or attacked with other statements thus forming a hierarchical structure. When a discussion is resolved, all valid top-level statements are incorporated into the content page. All resolutions are provisional, and anyone can re-open a discussion.
  
−
If there is uncertainty about whether a statement is true, the uncertainty is quantitatively measured with subjective probabilities. A priori beliefs are updated into a posteriori beliefs based on observations (in case of factual statements) or opinions (in case of moral statements) and open criticism that is based on shared rules. Opinions of each person are given equal weight.  
+
If there is uncertainty about whether a statement is true, the uncertainty is quantitatively measured with subjective probabilities. A priori beliefs are updated into a posteriori beliefs based on observations (in case of factual statements) or opinions (in case of moral statements) and open criticism that is based on rationality, relevance, and other shared rules.
  
−
There can be other rules than these inference rules for deciding what a group should believe. Rules are also statements and they are validated or invalidated just like any statements.
+
===Opasnet functionalities for impact assessment===
  
−
 
+
Teemu Rintala<sup>1</sup>, Jouni T. Tuomisto<sup>1</sup>, Einari Happonen<sup>1</sup>, Juha Villman<sup>1</sup>
−
Technical functionalities supporting open assessment
 
  
−
Opasnet is the web-workspace for making open assessments.  The user interface is a wiki and it is in many respects similar to Wikipedia, although it also has enhanced functionalities for making assessments.  One of the key ideas is that all work needed in an assessment can be performed using this single interface.  Everything required to undertake and participate in an assessmeent is therefore provided, whether it be information collection, numerical modelling, discussions, statistical analyses on original data, publishing original research results, peer review, organising and distributing tasks within a group, or dissemination of results to decision-makers.
+
1) National Institute for Health and Welfare, Kuopio, Finland
−
In practice, Opasnet is an overall name for many other functionalities than the wiki, but because the wiki is the interface for users, Opasnet is often used as a synonym for the Opasnet wiki.  Other major functionalities exist as well, aas outlined below. The main article about this topic is Opasnet structure.
 
−
Most variables have numerical values as their results. Often these are uncertain and they are expressed as probability distributions. A web page is an impractical place to store and handle this kind of information. For this purpose, a database called Opasnet Base is used. This provides a very flexible storage platform, and almost any results that can be expressed as two-dimensional tables can be stored in Opasnet Base.  Results of a variable can be retrieved from the respective Opasnet page.  Opasnet can be used to upload new results into the database.   Further, if one variable (B) is causally dependent on variable (A), the result of A can be automatically retrieved from Opasnet Base and used in a formula for calculating B.
 
−
Because Opasnet Base contains samples of distributions of variables, it is actually a very large Bayesian belief network, which can be used for assessment-level analyses and conditioning and optimising different decision options.  In addition to finding optimal decision options, Opasnet Base can be used to assess the value of further information for a particular decision. This statistical method is called Value of information.
 
−
Opasnet contains modelling functionalities for numerical models. It is an object-oriented functionality based on the R statistical software and the results in Opasnet Base. Each information object (typically a variable) contains a formula which has detailed instructions about how its result should be computed, often based on results of upstream variables in a model.
 
−
 
 
−
Meta level functionalities
 
  
−
In addition to work and discussions about the actual topics related to real-world decision-making, there is also a meta level in Opasnet.  Meta level means that there are discussions and work about the contents of Opasnet.  The most obvious expression of this are the rating bars in the top right corner of many Opasnet pages.  Peer rating means that users are requested to evaluate the scientific quality and usefulness of that page on a scale from 0 to 100. This information can then be used by the assessors to evaluate which parts of an assessment require more work, or by readers who want to know whether the presented estimates are reliable for their own purpose.
+
Corresponding author: Teemu Rintala (teemu.rintala(at)thl.fi)
−
The users are also allowed to make peer reviews of pages. These are similar to peer reviews in scientific journals, with written evaluations of the scientific quality of content. Another form of written evaluation are acknowledgements, which are a description about who has contributed what to the page, and what fraction of the merit should be given to which contributor.
 
−
Estimates of scientific quality, peer reviews and acknowledgements can be used systematically to calculate how much each contributor has done in Opasnet, though these practices are not yet well developed: contribution scores are so far the only systematic method even roughly to estimate contributions quantitatively.
 
−
Respect theory is a method for estimating the value of freely usable information objects to a group. This method is under development, and hopefully it will provide practical guidance for distributing merit among contributors in Opasnet.
 
−
 
 
−
Why does open assessment work?
 
  
−
Many people are (initially at least) sceptical about the effectiveness of open assessment.  In part, this is because ther approach is new and has not yet been widely applied and validated.  Most examples of its use are for demonstration purposes.  A number of reasons can nevertheless be advanced, supporting its use:  
+
Keywords: Opasnet, open assessment, collaborative web-workspace, modelling tools, discussion tools
−
In all assessments, there is a lack of resources, and this limits the quality of the outcome. With important (and controversial) topics, opening up an assessment to anyone will bring new resources to the assessment in the form of interested volunteers.
 
−
The rules of open assessment make it feasible to organise the increased amount of new data (which may at some points be of low quality) into high-quality syntheses within the limits of new resources.
 
−
Participants are relaxed with the idea of freely sharing important information - a prerequisite of an effective open assessment - because open assessments are motivated by the shared hope for societal improvements and not by monetary profit.  This is unlike in many other areas where information monopolies and copyrights are promoted as means to gain competitive advantage in a market, but as a side effect result in information barriers.
 
−
Problems due to too narrow initial scoping of the issue are reduced by having with more eyes look at the topic throughout the assessment process.
 
−
It becomes easy systematically to apply the basic principles of the scientific method, namely rationale, observations and, especially, open criticism.
 
−
Any information organised for any previous assessment is readily available for a new assessment on an analogous topic. The work time for data collection and the calendar time from data collection to utilisation are also reduced, thus increasing efficiency.
 
−
All information is organised in a standard format which makes it possible to develop powerful standardised methods for data mining and manipulation and consistency checks.
 
−
It is technically easy to prevent malevolent attacks against the content of an assessment (on a topic page in Opasnet wiki) without restricting the discussion about, or improvement of, the content (on a related discussion page); the resolutions from the discussions are simply updated to the actual content on the topic page by a trusted moderator.
 
−
These points support the contention that open assessment (or approaches adopting similar principles) will take over a major part of information production motivated by societal needs and improvement of societal decision-making.  The strength of this argument is already being shown by social interaction initiatives, such as Wikipedia and Facebook,  However, an economic rationale also exists: open assessment is cheaper to perform and easier to utilise, and can produce higher quality outputs than current alternative methods to produce societally important information.
 
  
 +
Aim:
 +
To develop an all-singing-all-dancing web-workspace for performing any tasks needed in an impact assessment.
  
−
Get involved with Opasnet!
+
Abstract:
 +
Opasnet is a web-workspace for making impact assessments, especially open assessments. A main objective is that all work needed in an assessment can be performed using this single interface, whether it be information collection, numerical modelling, discussions, statistical analyses on original data, publishing original research results, peer review, organising and distributing tasks within a group, or dissemination of results to decision-makers. This abstract briefly describes some of the existing functionalities.
  
−
Go see Opasnet at en.opasnet.org and find out how to participate by:
+
The user interface of Opasnet is an open wiki and it is in many respects similar to Wikipedia with content pages and discussion pages, with additional functionalities for structured discussions. Assessments consist of variables which are in practice self-standing Opasnet pages. Most variables have numerical values as results, often expressed as probability distributions. Opasnet has a database that can store very flexibly almost any results that can be expressed as two-dimensional tables. Results can be uploaded and downloaded using a respective Opasnet page as interface. Further, if one variable (B) is causally dependent on variable (A), the result of A can be automatically retrieved and used in a formula for calculating B using a simulation and modelling functionality based on statistical software R.
  
−
Reading Opasnet content
+
Because Opasnet contains interconnected distributions of variables, it is also a very large Bayesian belief network, which can be used for assessment-level analyses and conditioning and optimising different decision options. Opasnet can be used to find optimal decision options and also to assess the value of further information for a particular decision.
−
Commenting Opasnet content
 
−
Participating in polls
 
−
Editing and creating Opasnet content
 
−
Providing data to the Opasnet base
 
−
Peer-reviewing Opasnet content
 
−
Moderating parts of Opasnet
 
  
−
You can also check out and contribute to the on-going assessments on e.g.:
+
Opasnet contains functionalities for discussing and evaluating the content of Opasnet, in addition to the main purpose for discussing real-world phenomena. The most common form of these "meta-level" functionalities are rating bars on many Opasnet pages. Users can evaluate the scientific quality and usefulness of that page. This information can then be used by the assessors to direct further work or by readers to evaluate reliability of a page content.
  
−
Impacts of emission trading on city-level
+
The users are also allowed to make peer reviews of pages. These are similar to peer reviews in scientific journals. Contribution scores can be used to estimate user contributions quantitatively, but more advanced methods are in development. Task functionality keeps task lists and sends email notifications to users to whom tasks are assigned by others.
−
Impacts of heating in small municipalities
 
−
Climate change, air quality and housing
 
−
Costs and benefits of composite traffic
 
−
Benefits and risks of eating fish
 
  
 +
Any information organised for any previous assessment is readily available for a new assessment on an analogous issue. Thus, the work time for data collection is reduced and efficiency is increased.
  
−
[[Op_fi:Opasnet-esite]]
+
If malevolent attacks occur, a content page can be protected without restricting the discussion about, or improvement of, the content on the related discussion page; the resolutions from the discussions are simply updated to the actual content on the issue page by a trusted moderator.

Latest revision as of 13:25, 17 January 2011



Scope

Opasnet brochure is an easy-to-read promotion leaflet about Opasnet. It should tell the basic idea and major functionalities of Opasnet. The target audience is anyone who hears about Opasnet for the first time and is interested in learning what it actually is and where it can be found.

Definition

It's title should be the main slogan: "Anyone can solve common problems". The title should be described in one paragraph.

It should contain the descriptions of the five main properties:

  • Completely open participation.
  • Systematic information structure (research questions and attempted answers).
  • Everything is subject to scientific criticism.
  • Formal argumentation is used to resolve disputes.
  • Quantitative estimates are uploaded to a database where anyone can use them.

It should invite the reader to read more from Opasnet and contribute in other ways.

It should tell about some real assessments where the reader can contribute.

It should have a few illustrative figures.

The format of the brochure should be double-sided, colour-printed A4. It should be folded once (to size A5) or twice (height of A5, width 1/3 of the height of A4). It should also be available as a PDF file.

Intarese instructions

Title

Author1, Author2, Author3, Author4

1) Institution name and address 2) Institution name and address 3) Institution name and address 4). Institution name and address

Corresponding author: Name, e-mail address

Keywords: Please identify 3-5 keywords.

Aim: Please kindly keep the total length of Aim and Abstract to approximately 350 words. Font size 12, Times New Roman. Abstract: Acknowledgements:


Please submit your abstract to Dr. Kornelia Jumel (k.jumel()imperial.ac.uk) by 7 January 2011

Result

See the Power Point file for printing out the brochure: File:Opasnet brochure.ppt. The texts in the brochure are presented below. Posters made for text below: File:Opasnet poster JAN2011.ppt.


Open assessment: developing shared understanding for practical use

Jouni T. Tuomisto1, Mikko V. Pohjola1

1) National Institute for Health and Welfare, Kuopio, Finland

Corresponding author: Jouni Tuomisto (jouni.tuomisto(at)thl.fi)

Keywords: Open assessment, impact assessment, policy support, decision-making, mass collaboration

Aim:

To develop a method for organising scientific information and value judgements for improving societal decision-making in a situation where open participation is allowed.

Abstract:

The world is packed with common problems awaiting for solutions - global warming or urban air pollution to name a few. Many people would be willing to make an effort in solving these problems but so far have been lacking practical means to contribute. Open assessment is a method that aims to offer rules and practices for collecting and synthesising information by self-organised groups into useful pieces (or objects) of information to guide decisions.

In open assessment, the information needed for making a decision is organised as an assessment that predicts the impacts of different decision options on some outcomes of interest. Decisions, outcomes, and other particular issues are modelled as distinct and self-standing information objects called variables. In practice, a variable is a pair of web pages (one for content about an issue, another for discussion about the content) in an open web-workspace Opasnet (http://en.opasnet.org). They contain all information (text, numerical values, and software code) needed to describe and actually run that part of an assessment model.

Pages have a universal structure: a research question (what is the issue?), rationale (what do we know about the issue?), and result (what is our current best answer to the research question?). Anyone can participate in reading, evaluating, and contributing to web page content just as in Wikipedia. The content reflects and communicates the shared understanding of the issue in the participating group. As the group gets larger and the contributions richer, the content asymptotically approaches the best current scientific knowledge about the issue.

There are rules (summarised below) to manage all discussions about a particular issue (documented on its discussion page) and then to decide what to believe about it (documented on its content page).

Anyone can promote a statement about anything. A statement can be factual (what is?) or moral (what should be?) by nature. A promoted statement is considered valid unless it is invalidated (i.e., convincingly attacked with a valid statement). The validity of a statement is always conditional to a particular group (which is or is not convinced).

Statements can be defended or attacked with other statements thus forming a hierarchical structure. When a discussion is resolved, all valid top-level statements are incorporated into the content page. All resolutions are provisional, and anyone can re-open a discussion.

If there is uncertainty about whether a statement is true, the uncertainty is quantitatively measured with subjective probabilities. A priori beliefs are updated into a posteriori beliefs based on observations (in case of factual statements) or opinions (in case of moral statements) and open criticism that is based on rationality, relevance, and other shared rules.

Opasnet functionalities for impact assessment

Teemu Rintala1, Jouni T. Tuomisto1, Einari Happonen1, Juha Villman1

1) National Institute for Health and Welfare, Kuopio, Finland

Corresponding author: Teemu Rintala (teemu.rintala(at)thl.fi)

Keywords: Opasnet, open assessment, collaborative web-workspace, modelling tools, discussion tools

Aim: To develop an all-singing-all-dancing web-workspace for performing any tasks needed in an impact assessment.

Abstract: Opasnet is a web-workspace for making impact assessments, especially open assessments. A main objective is that all work needed in an assessment can be performed using this single interface, whether it be information collection, numerical modelling, discussions, statistical analyses on original data, publishing original research results, peer review, organising and distributing tasks within a group, or dissemination of results to decision-makers. This abstract briefly describes some of the existing functionalities.

The user interface of Opasnet is an open wiki and it is in many respects similar to Wikipedia with content pages and discussion pages, with additional functionalities for structured discussions. Assessments consist of variables which are in practice self-standing Opasnet pages. Most variables have numerical values as results, often expressed as probability distributions. Opasnet has a database that can store very flexibly almost any results that can be expressed as two-dimensional tables. Results can be uploaded and downloaded using a respective Opasnet page as interface. Further, if one variable (B) is causally dependent on variable (A), the result of A can be automatically retrieved and used in a formula for calculating B using a simulation and modelling functionality based on statistical software R.

Because Opasnet contains interconnected distributions of variables, it is also a very large Bayesian belief network, which can be used for assessment-level analyses and conditioning and optimising different decision options. Opasnet can be used to find optimal decision options and also to assess the value of further information for a particular decision.

Opasnet contains functionalities for discussing and evaluating the content of Opasnet, in addition to the main purpose for discussing real-world phenomena. The most common form of these "meta-level" functionalities are rating bars on many Opasnet pages. Users can evaluate the scientific quality and usefulness of that page. This information can then be used by the assessors to direct further work or by readers to evaluate reliability of a page content.

The users are also allowed to make peer reviews of pages. These are similar to peer reviews in scientific journals. Contribution scores can be used to estimate user contributions quantitatively, but more advanced methods are in development. Task functionality keeps task lists and sends email notifications to users to whom tasks are assigned by others.

Any information organised for any previous assessment is readily available for a new assessment on an analogous issue. Thus, the work time for data collection is reduced and efficiency is increased.

If malevolent attacks occur, a content page can be protected without restricting the discussion about, or improvement of, the content on the related discussion page; the resolutions from the discussions are simply updated to the actual content on the issue page by a trusted moderator.

Retrieved from "http://www.opasnet.org/testiwiki/index.php?title=Opasnet_brochure&oldid=17847"