Peer rating

From Testiwiki
Revision as of 12:29, 22 March 2010 by Jouni (talk | contribs) (the first scale and conversion based on own thinking.)
Jump to: navigation, search


Peer rating is a method to give merit ratings or onors to a page in Opasnet. Peer rating has a scale from 0 to 100, but it can be converted to onors with an inverse logarithmic transformation (1 on the peer rating scale equals 0.13 onors, 10 equals 1 onor, and 100 equals 1,000,000,000 onors).

Scope

What is such a method to give respect or merit to contributions (Opasnet pages) such that the method

  • reflects the true social respect on an absolute scale,
  • can be learned and used easily.

Definition

The rating bar functionality only accepts integers between 0 and 100. Therefore, it is practical to make the first attempt of peer rating reflect this interval. However, because ratings must be able to be used without limits, it might be possible to make an inverse log transformation using the following equation:

onor = 10^(rating/10) * 0.1

This results in the range from 0.01 to 100,000,000 onors which should be wide enough for practical needs. However, it does NOT make it possible to give negative respect.

How to read discussions

Statements: Negative respect should also be possible with peer rating.

Resolution: Not accepted. Negative respect must be given through peer review.

(Resolved, i.e., the resolution has been updated to the main page.)

Argumentation:

1 : Should we change this in such a way that rating below 20 would use this equation:

onor = -10^((10-rating)/10) * 0.1?

This would only make it possible to give -10 onors which may not be enough if negative onors are given in the first place. Instead, we could do so that if you want to give negative rating, you actually should make a peer review instead. The peer review result may be negative as well as positive. --Jouni 12:29, 22 March 2010 (UTC)


Result

Peer rating Onors Interpretation, examples
0 0.00 Not rated
1 0.13 An attempt to raise an issue.
2 0.16
3 0.20
4 0.25
5 0.32
6 0.40
7 0.50
8 0.63
9 0.80
10 1.00 A placeholder or a page title that makes sense. (Placeholder)
11 1.30
12 1.60
13 2.00
14 2.50
15 3.20
16 4.00
17 5.00
18 6.30
19 8.00
20 10.00 A brief page with useful links or a summary. (Draft)
21 13.00
22 16.00
23 20.00
24 25.00
25 32.00
26 40.00
27 50.00
28 63.00
29 80.00
30 100.00 A good description of at least one part of the topic. Links to relevant additional sources. Draft estimates, if a quantitative variable.
31 130.00
32 160.00 A news in a newspaper or website.
33 200.00
34 250.00
35 320.00
36 400.00
37 500.00
38 630.00
39 800.00
40 1000.00 A good text that helps to get an overview. Far from exhaustive. Fairly good quantitative estimates, if a variable.
41 1300.00
42 1600.00 A large newspaper article.
43 2000.00
44 2500.00
45 3200.00
46 4000.00
47 5000.00
48 6300.00
49 8000.00
50 10000.00 A good, peer-reviewed scientific article. A good assessment with a coherent set of variables.
51 13000.00
52 16000.00
53 20000.00
54 25000.00
55 32000.00
56 40000.00 A good meta-analysis
57 50000.00
58 63000.00
59 80000.00 A good novel.
60 100000.00 An outstanding scientific article. Exhaustive description ot the topic.
61 130000.00
62 160000.00 A good scientific textbook.
63 200000.00
64 250000.00
65 320000.00
66 400000.00
67 500000.00
68 630000.00
69 800000.00
70 1000000.00 A major scientific breakthrough that changes scientific thinking.
71 1300000.00
72 1600000.00 A Shakespeare play
73 2000000.00
74 2500000.00
75 3200000.00
76 4000000.00
77 5000000.00
78 6300000.00
79 8000000.00
80 10000000.00
81 13000000.00
82 16000000.00
83 20000000.00
84 25000000.00
85 32000000.00
86 40000000.00
87 50000000.00
88 63000000.00
89 80000000.00 F = G m1 m2 / r2
90 100000000.00 E = m c2
91 130000000.00
92 160000000.00
93 200000000.00
94 250000000.00
95 320000000.00
96 400000000.00
97 500000000.00
98 630000000.00
99 800000000.00
100 1000000000.00