Difference between revisions of "Peer rating"
(the first scale and conversion based on own thinking.) |
(idea of non-linear exchange rate for onor-money) |
||
| Line 33: | Line 33: | ||
==Result== | ==Result== | ||
| + | The total [[onor]]s earned by an individual i are calculated in the following way: | ||
| + | |||
| + | O<sub>i</sub> = Σ<sub>p</sub> O<sub>p</sub> n<sub>p</sub> f<sub>i,p</sub>, | ||
| + | |||
| + | where O<sub>i</sub> is the amount of onors earned by individual i, O<sub>p</sub> is the amount of onors per one reading given to a particular page p, n<sub>p</sub> is the number of times the page p was read, and f<sub>i,p</sub> if the fraction of merit that the contributor i earns for his/her work on page p. | ||
| + | |||
| + | Onors can be exchanged to money, but in a non-linear manner. There is a threshold for exchange, and onors below the threshold are not exchanged. The actual level of threshold is determined by the members of the society. The amount of exchangeable onors is calculated in the following way: | ||
| + | |||
| + | O(E)<sub>i</sub> = Σ<sub>p</sub> O<sub>p</sub> n<sub>p</sub> f<sub>i,p</sub> (if O<sub>p</sub> f<sub>i,p</sub> >= T then 1 else 0), | ||
| + | |||
| + | where T is the threshold. A major reason for this non-linearity is that anyone can do a large number of low-onor edits without specific skills. With a linear exchange rate, most of the money would be exchanged to such low-value contributions. It is more motivating and cost-effective to give higher prizes for hard and skilled work and none for others. This motivates people (who want to do this for living) to work especially on high-value things. | ||
{| width="500px" {{prettytable}} | {| width="500px" {{prettytable}} | ||
Revision as of 04:35, 2 April 2010
This page is a method.
The page identifier is Op_en4123 |
|---|
| Moderator:Jouni (see all) |
|
Give your opinion to the peer rating of the content of this page. |
| Upload data
|
Peer rating is a method to give merit ratings or onors to a page in Opasnet. Peer rating has a scale from 0 to 100, but it can be converted to onors with an inverse logarithmic transformation (1 on the peer rating scale equals 0.13 onors, 10 equals 1 onor, and 100 equals 1,000,000,000 onors).
Scope
What is such a method to give respect or merit to contributions (Opasnet pages) such that the method
- reflects the true social respect on an absolute scale,
- can be learned and used easily.
Definition
The rating bar functionality only accepts integers between 0 and 100. Therefore, it is practical to make the first attempt of peer rating reflect this interval. However, because ratings must be able to be used without limits, it might be possible to make an inverse log transformation using the following equation:
onor = 10^(rating/10) * 0.1
This results in the range from 0.01 to 100,000,000 onors which should be wide enough for practical needs. However, it does NOT make it possible to give negative respect.
| Statements: Negative respect should also be possible with peer rating.
Resolution: Not accepted. Negative respect must be given through peer review. (Resolved, i.e., the resolution has been updated to the main page.) |
| Argumentation:
⇤1 : Should we change this in such a way that rating below 20 would use this equation: onor = -10^((10-rating)/10) * 0.1? This would only make it possible to give -10 onors which may not be enough if negative onors are given in the first place. Instead, we could do so that if you want to give negative rating, you actually should make a peer review instead. The peer review result may be negative as well as positive. --Jouni 12:29, 22 March 2010 (UTC) |
Result
The total onors earned by an individual i are calculated in the following way:
Oi = Σp Op np fi,p,
where Oi is the amount of onors earned by individual i, Op is the amount of onors per one reading given to a particular page p, np is the number of times the page p was read, and fi,p if the fraction of merit that the contributor i earns for his/her work on page p.
Onors can be exchanged to money, but in a non-linear manner. There is a threshold for exchange, and onors below the threshold are not exchanged. The actual level of threshold is determined by the members of the society. The amount of exchangeable onors is calculated in the following way:
O(E)i = Σp Op np fi,p (if Op fi,p >= T then 1 else 0),
where T is the threshold. A major reason for this non-linearity is that anyone can do a large number of low-onor edits without specific skills. With a linear exchange rate, most of the money would be exchanged to such low-value contributions. It is more motivating and cost-effective to give higher prizes for hard and skilled work and none for others. This motivates people (who want to do this for living) to work especially on high-value things.
| Peer rating | Onors | Interpretation, examples |
|---|---|---|
| 0 | 0.00 | Not rated |
| 1 | 0.13 | An attempt to raise an issue. |
| 2 | 0.16 | |
| 3 | 0.20 | |
| 4 | 0.25 | |
| 5 | 0.32 | |
| 6 | 0.40 | |
| 7 | 0.50 | |
| 8 | 0.63 | |
| 9 | 0.80 | |
| 10 | 1.00 | A placeholder or a page title that makes sense. (Placeholder) |
| 11 | 1.30 | |
| 12 | 1.60 | |
| 13 | 2.00 | |
| 14 | 2.50 | |
| 15 | 3.20 | |
| 16 | 4.00 | |
| 17 | 5.00 | |
| 18 | 6.30 | |
| 19 | 8.00 | |
| 20 | 10.00 | A brief page with useful links or a summary. (Draft) |
| 21 | 13.00 | |
| 22 | 16.00 | |
| 23 | 20.00 | |
| 24 | 25.00 | |
| 25 | 32.00 | |
| 26 | 40.00 | |
| 27 | 50.00 | |
| 28 | 63.00 | |
| 29 | 80.00 | |
| 30 | 100.00 | A good description of at least one part of the topic. Links to relevant additional sources. Draft estimates, if a quantitative variable. |
| 31 | 130.00 | |
| 32 | 160.00 | A news in a newspaper or website. |
| 33 | 200.00 | |
| 34 | 250.00 | |
| 35 | 320.00 | |
| 36 | 400.00 | |
| 37 | 500.00 | |
| 38 | 630.00 | |
| 39 | 800.00 | |
| 40 | 1000.00 | A good text that helps to get an overview. Far from exhaustive. Fairly good quantitative estimates, if a variable. |
| 41 | 1300.00 | |
| 42 | 1600.00 | A large newspaper article. |
| 43 | 2000.00 | |
| 44 | 2500.00 | |
| 45 | 3200.00 | |
| 46 | 4000.00 | |
| 47 | 5000.00 | |
| 48 | 6300.00 | |
| 49 | 8000.00 | |
| 50 | 10000.00 | A good, peer-reviewed scientific article. A good assessment with a coherent set of variables. |
| 51 | 13000.00 | |
| 52 | 16000.00 | |
| 53 | 20000.00 | |
| 54 | 25000.00 | |
| 55 | 32000.00 | |
| 56 | 40000.00 | A good meta-analysis |
| 57 | 50000.00 | |
| 58 | 63000.00 | |
| 59 | 80000.00 | A good novel. |
| 60 | 100000.00 | An outstanding scientific article. Exhaustive description ot the topic. |
| 61 | 130000.00 | |
| 62 | 160000.00 | A good scientific textbook. |
| 63 | 200000.00 | |
| 64 | 250000.00 | |
| 65 | 320000.00 | |
| 66 | 400000.00 | |
| 67 | 500000.00 | |
| 68 | 630000.00 | |
| 69 | 800000.00 | |
| 70 | 1000000.00 | A major scientific breakthrough that changes scientific thinking. |
| 71 | 1300000.00 | |
| 72 | 1600000.00 | A Shakespeare play |
| 73 | 2000000.00 | |
| 74 | 2500000.00 | |
| 75 | 3200000.00 | |
| 76 | 4000000.00 | |
| 77 | 5000000.00 | |
| 78 | 6300000.00 | |
| 79 | 8000000.00 | |
| 80 | 10000000.00 | |
| 81 | 13000000.00 | |
| 82 | 16000000.00 | |
| 83 | 20000000.00 | |
| 84 | 25000000.00 | |
| 85 | 32000000.00 | |
| 86 | 40000000.00 | |
| 87 | 50000000.00 | |
| 88 | 63000000.00 | |
| 89 | 80000000.00 | F = G m1 m2 / r2 |
| 90 | 100000000.00 | E = m c2 |
| 91 | 130000000.00 | |
| 92 | 160000000.00 | |
| 93 | 200000000.00 | |
| 94 | 250000000.00 | |
| 95 | 320000000.00 | |
| 96 | 400000000.00 | |
| 97 | 500000000.00 | |
| 98 | 630000000.00 | |
| 99 | 800000000.00 | |
| 100 | 1000000000.00 |
