Difference between revisions of "Open Assessors' Network"

From Testiwiki
Jump to: navigation, search
(text moved from Nugget)
(text written in new perspective)
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{encyclopedia|Open assessment}}
+
[[Category:Open assessment]]
 
[[Category:Glossary term]]
 
[[Category:Glossary term]]
 +
{{encyclopedia|moderator=Jouni}}
 +
This page is about a mass collaboration project '''Open Assessors' Network'''. For a description about the project's website and workspace, see [[Opasnet]].
 +
 
<section begin=glossary />
 
<section begin=glossary />
:The '''Open Assessors' Network''' ('''Opasnet''') is a [[:en:mass collaboration|mass collaboration]] project for [[open assessor]]s, that is people who are willing to promote the [[open assessment]] practices in the aim to improve societal decision-making. The major part of the collaboration happens on the website of this network: http://en.opasnet.org.
+
:The '''Open Assessors' Network''' is a [[:en:mass_collaboration|mass collaboration]] project for [[Open assessor|open assessors]], that is people who are willing to promote the [[Open assessment|open assessment]] practices in the aim to improve societal decision-making. The major part of the collaboration happens on [[Opasnet]], the website and workspace of this network: http://en.opasnet.org. In addition, there is a plan that [[Open Assessors' Network]] should be developed into a registered society for people interested in [[open assessment]]; the current plan is called [[:fi:Avointen arvioijien yhdistys Avary|Avary]] (description in Finnish). The society could maintain the [[Opasnet]] website and publish the [[Journal of Open Assessment]].
 
<section end=glossary />
 
<section end=glossary />
  
The '''Opasnet''' is based on the idea that assessments should no longer be done in closed expert groups that produce some static reports that may or may not answer the questions a decision-maker actually has, and that are only as credible as the expert group is. Instead, two improvements are needed. First, an assessment should be built on an explicit information need that is defined by an open deliberation between experts, decision-makers, and stakeholders. Second, everything in the assessment - including premises, data sources, modelling, and conclusions - is open to scientific criticism. To be able to perform such assessments in practice, several things must be available. The '''Opasnet''' aims to provide these things that are briefly described below (with links to more extensive pages).
+
==Question==
 
 
:We need a '''common platform''' or workspace where all these interested people may meet and work together. In practice, the core of the system must be based on an Internet workspace, although all traditional methods of group work (such as stakeholder meetings) should still be used and are available. But the products from traditional methods should be incorporated into the core system so that everyone who were not in a meeting still can read about the conclusions. This wiki-based website works as the core platform for this [[:en:mass collaboration|mass collaboration]] effort.
 
 
 
:We need a '''systematic information structure''' for all the parts of an assessment. A crucial problem currently is that the information useful for the assessment is sparsely located. The major task of performing the assessment is to collect the relevant pieces of information and synthesise them. Also, many stakeholder involvement projects have ended up to a failure, either because a large amount of feedback was so unstructured that there were not enough resources to make anything useful out of it, or because people guessed that this would happen and did not give any feedback in the first place. Therefore, the assessment must have a clear but flexible structure where the right location of ANY relevant piece of information can fairly easily be found. This way, it will become possible to save resources in organising information. Each contributor should himself or herself find the right location for his or her comment. Although it is extra work for the contributor, he or she can more easily see the importance of the contribution. One of our slogans is: "There is no such thing as a general comment."
 
 
 
:The systematic information structure is performed using '''standardised information objects'''. The most important ones are called [[variable]]s (descriptions of real-world phenomena), [[assessment]]s (descriptions of the questions and conclusions of a particular policy need), and [[method]]s (descriptions of how to actually perform a work that is needed for an assessment). Importantly, an assessment consists of variables and the '''[[causality|causal connections]]''' between them.
 
 
 
:We need a systematic way for [[discussion]] and '''[[dealing with disputes]]'''. For this, we use the approaches of [[:en:pragma-dialectics|pragma-dialectics]], a scientific theory of argumentation that looks at argumentation as a speech act. In this view, argumentation contains both the argumenting (act) and the argument (content). The argumentation is operationalised as Talk pages (see the 'discussion' tab on the top of each page) with some practical tools to help on-line discussions. Of course, other methods for discussion are allowed, but the main contents should be transformed into the core system after the discussion, so that others can see the results.
 
 
 
:We need systematic methods for doing assessments. This can be a [[guidebook]] about how assessments are done in general, and [[method]]s about particular pieces of work. We are collecting work descriptions to this website (for examples, see a [[:category:Method|category for methods]]. We are also collecting software [[tool]]s for pieces of work that are either difficult to do without existing tools, or that repeat from one assessment to another in a very similar way, thus enabling standardisation of the work. For examples, see a [[:Category:Tool|tool category]] and [[:category:Analytica tool|a category for Analytica tools]].
 
 
 
:We need an information source that contains results from previous assessments. This information can then be utilised in other assessments either as such, or after adjustments for new situations. In any case, the more information assessors provide for others, the easier it will become to perform new assessments. The information can be either [[:category:assessment models|assessment models]], or [[result database|model results]]. Both types of information is provided on this website.
 
  
Preliminary versions of all of these methods, websites, tools, and information sources already exist on this website, and they are available to anyone. The '''Open Assessors' Network''' invites you to participate in making assessments and improving the system for the benefit of future decision-making and the future world.
+
How should Open Assessors' Network function to fulfil it purpose to
 +
* help interested people in making open assessments,
 +
* help people in learning skills needed in open assessments,
 +
* help skilled people in teaching their skills to others,
 +
* promote the enthusiasm and recruit new members, and
 +
* build the capacity to mobilise enough people to work on a new case even within hours?
  
==Comparison of Wikipedia and Opasnet==
+
==Answer==
  
{| {{prettytable}}
+
* Network is organised virtually using a [http://www.facebook.com/pages/Open-Assessors-Network/109330159394?sk=wall Facebook group].
! Property
+
** Members can post questions, tasks, and challenges on the wall.
! [[Wikipedia]]
+
* Members can develop new skills for making open assessments. For a description, see [[Opasnet user skills]].
! [[Open Assessors' Network|Opasnet]]
+
** Members can keep a record about their skills on a page User:Member/Skill. For description, see [[:op_fi:Aikakone|Aikakone]] (in Finnish).
|----
+
** Each skill must be verified and accepted by another member who already has that skill.
! colspan="3"| [[:en:Wikipedia:Five pillars|Five pillars of Wikipedia]]
+
** Some challenges and tasks (such as [[List of tasks for R experts]]) are only available to members with specific skills.
|----
+
* Tasks are pieces of work for which someone has promised to give compensation, such as money. At the moment, [[THL]] is the largest supplier of tasks that are paid for. There ares list of tasks from which anyone with enough skills can take a task and do it (after some administrative business). See [[List of open tasks]], [[:op_fi:Avoimia tehtäviä|Avoimia tehtäviä]] (in Finnish), and [[List of tasks for R experts]].
| Purpose
+
* Challenges are like tasks but nobody has promised to pay for doing them. The motivation of doing challenges vary: they may be fun or challenging, or lead to social good. Also, social [[respect]] in the form of [[onor]]s may be given to people who succeed in challenges, although this is difficult to promise by anyone beforehand. In addition, there is a challenge of developing the actual system of distributing respect in the form of onors.
| [[:en:Wikipedia:What Wikipedia is not|Wikipedia is an encyclopedia]] incorporating elements of general encyclopedias, specialized encyclopedias, and almanacs. The purpose is to produce information that is of general interest.
 
| The purpose is to produce information that is directly relevant for societal decision-making, often targeted for a specific decision process.
 
|----
 
|
 
| All articles must follow our [[:en:Wikipedia:No original research|no original research policy]], and strive for verifiable accuracy: unreferenced material may be removed, so please provide references.  
 
| Same, except that original research is allowed.  
 
|----
 
| Neutral point of view (NPOV)
 
| Wikipedia has a [[:en:Wikipedia:Neutral point of view|neutral point of view]], which means we strive for articles that advocate no single point of view. Sometimes this requires representing multiple points of view, presenting each point of view accurately, providing context for any given point of view, and presenting no one point of view as the truth or the best view.
 
| Same. However, the scopes of most Opasnet articles are much more precise than in Wikipedia. Therefore, more detailed argumentation is possible and often required. The text on the main page must faithfully follow the resolutions of the argumentation presented. However, neutrality is not required in the argumentation itself. One purpose of Opasnet is to [[Dealing with disputes|resolve disputes]], not just report about resolutions.
 
|----
 
| Copyright
 
| Wikipedia is [[:en:Wikipedia:Copyrights|free content]] that anyone may edit. All text is available under the [[:en:GNU Free Documentation License|GNU Free Documentation License]] (GFDL)
 
| Same.
 
|----
 
| Code of conduct
 
| Wikipedia has a [[:en:Wikipedia:Etiquette|code of conduct]]: Respect your fellow Wikipedians even when you may not agree with them. Be civil. Avoid conflicts of interest, personal attacks or sweeping generalizations. Assume good faith.
 
| Same.
 
|----
 
| No firm rules beyond the five pillars.
 
| Wikipedia does not have firm rules besides the five general principles presented here. Be bold in editing, moving, and modifying articles. Although it should be aimed for, perfection is not required. Do not worry about making mistakes.
 
| Same, except that rules derived from the [[open assessment]] method apply as well. However, the Wikipedia approach is a good start. Be bold and provide your knowledge for common good even if you are not sure about all conventions. When disputes arise, the [[open assessment]] method is the ultimate rule. Remember that it is much easier to proceed with good information in a wrong format than with the right format but no information.
 
|----
 
! colspan="3"| Other aspects
 
|----
 
| Main contents
 
| Encyclopedia articles.
 
| Assessments, divided into variables. Also, method articles for performing assessments, and encyclopedia articles of specific topics.
 
|----
 
| Page subtitles
 
| Based on need and conventions related to the topic: e.g. General, History, References, External links.
 
| Based on [[open assessment]] method: [[Scope]], [[Definition]], [[Result]]. Also voluntary subtitles based on need: e.g. See also, References.
 
|----
 
| Resolving disputes
 
| Discussions on the Talk pages. [[:en:Wikipedia:Dispute resolution|Guidance for dispute resolution]].
 
| Same, In addition, formal [[argumentation]] is used to organize and resolve discussions on the Talk pages.
 
|----
 
| Page protection
 
| Most pages can be edited continuously. Some system pages are protected.
 
| Same. However, there are also [[Nugget]] pages that have distinct authors and cannot be edited by others.
 
|----
 
|}
 
  
==Contributing to Opasnet==
 
  
 +
==Rationale==
  
'''Contributing to Opasnet''' describes how you can bring your knowledge to the [[Opasnet]] system. If you have contributed to [[Wikipedia]], you already know a lot about Opasnet. However, Opasnet is NOT the same as Wikipedia, and it has its own objectives and some own rules and page types. For details, see the table above. General help for contributing to Wiki systems can be found from [[:en:Wikipedia:Contributing to Wikipedia|Contributing to Wikipedia]] (concepts) and [[:en:Help:Editing|Editing help in Wikipedia]] (technical).
+
The activities in Open Assessors' Network should be like a game: fun to do, socially attractive, and challenging so that step-by-step challenges that lead to more and more demanding tasks with higher and higher rewards.
  
Different contents should be written to different kinds of pages. Go through this flow chart to see where your contribution should be located.
+
==Tasks that open assessors should be able to do==
  
* Does an article with the same topic as your contribution already exist in [[:en:Main page|Wikipedia]] or [[Opasnet]]?
+
:''Main article: [[Opasnet user skills]].
** Yes: Add new information from your contribution to the existing article.
 
** No: Continue.
 
*Is the contribution an encyclopedia-type article of general interest (such as ''Methylmercury'')?
 
** Yes: Put it to [[:en:Main page|Wikipedia]] as a new article.
 
** No: Continue.
 
*Is the contribution an encyclopedia-type article of only specific interest or too large for a general encylopedia (such as ''Effects of methylmercury in children'')?
 
** Yes: Put it to [[Opasnet]] as an encyclopedia article. Use the <nowiki>{{Encyclopedia}}</nowiki> template.
 
** No: Continue.
 
*Is the contribution a structured answer to a research question (''Methylmercury concentration in Finnish children'', or ''Chemical analysis method for measuring methylmercury from blood'').
 
** Yes: Make a [[variable]] or a [[method]] page. Use <nowiki>{{variable}} and {{method}}</nowiki> templates, respectively.
 
**No: Continue.
 
* Is the contribution a description of a research study or a particular piece of data (''Methylmercury concentrations in mothers in Finland (Lucas study)'')?
 
** Yes: Make a nugget to [[Opasnet]]. Use the <nowiki>{{nugget}}</nowiki> template.
 
** No: Continue.
 
*Is the contribution directly linked to an existing page, such as a discussion?
 
** Yes: Copy it to the Talk page of the relevant page. Then, if necessary and possible, restructure it into the form of a formal [[discussion]]. Use the <nowiki>{{nugget}}</nowiki> template.
 
** No: Continue.
 
*Does the contribution really contain some important information that should be available to other people?
 
**Yes: Make a nugget to [[Opasnet]].
 
**No: Move on and forget your contribution.
 
  
 +
==See also==
  
If you want to have the authorship for your contribution, you can do one of the following (in the order of preference):
+
* [[Opasnet user skills]]
# Use your real name as your username, or put your real name onto your user page. This way, readers can find your contributions from the history of a page and see who was the contributor. No specific actions are needed when making the contributions.
+
* [[Opasnet]]
# Copy a [[:en:permanent link|permanent link]] (see the sidebar) of the page where you made your contribution and paste it to the current version of that page under the title  '''See also''' with a short explanation such as: "The original discussion about methylmercury by N.N. can be found from here."
+
* [[Open assessment]]
# Make a new page for your contribution. Describe the metadata according to the <nowiki>{{Nugget}}</nowiki> template.
+
* [[Journal of Open Assessment]]
 +
* [[Open assessor]]
 +
* [[:op_fi:Wikipuolue|Wikipuolue]] (in Finnish)

Latest revision as of 04:27, 12 January 2012


This page is about a mass collaboration project Open Assessors' Network. For a description about the project's website and workspace, see Opasnet.

<section begin=glossary />

The Open Assessors' Network is a mass collaboration project for open assessors, that is people who are willing to promote the open assessment practices in the aim to improve societal decision-making. The major part of the collaboration happens on Opasnet, the website and workspace of this network: http://en.opasnet.org. In addition, there is a plan that Open Assessors' Network should be developed into a registered society for people interested in open assessment; the current plan is called Avary (description in Finnish). The society could maintain the Opasnet website and publish the Journal of Open Assessment.

<section end=glossary />

Question

How should Open Assessors' Network function to fulfil it purpose to

  • help interested people in making open assessments,
  • help people in learning skills needed in open assessments,
  • help skilled people in teaching their skills to others,
  • promote the enthusiasm and recruit new members, and
  • build the capacity to mobilise enough people to work on a new case even within hours?

Answer

  • Network is organised virtually using a Facebook group.
    • Members can post questions, tasks, and challenges on the wall.
  • Members can develop new skills for making open assessments. For a description, see Opasnet user skills.
    • Members can keep a record about their skills on a page User:Member/Skill. For description, see Aikakone (in Finnish).
    • Each skill must be verified and accepted by another member who already has that skill.
    • Some challenges and tasks (such as List of tasks for R experts) are only available to members with specific skills.
  • Tasks are pieces of work for which someone has promised to give compensation, such as money. At the moment, THL is the largest supplier of tasks that are paid for. There ares list of tasks from which anyone with enough skills can take a task and do it (after some administrative business). See List of open tasks, Avoimia tehtäviä (in Finnish), and List of tasks for R experts.
  • Challenges are like tasks but nobody has promised to pay for doing them. The motivation of doing challenges vary: they may be fun or challenging, or lead to social good. Also, social respect in the form of onors may be given to people who succeed in challenges, although this is difficult to promise by anyone beforehand. In addition, there is a challenge of developing the actual system of distributing respect in the form of onors.


Rationale

The activities in Open Assessors' Network should be like a game: fun to do, socially attractive, and challenging so that step-by-step challenges that lead to more and more demanding tasks with higher and higher rewards.

Tasks that open assessors should be able to do

Main article: Opasnet user skills.

See also