Open assessment workshop 2009
This page is a encyclopedia article.
The page identifier is Op_en2582 |
---|
Moderator:Nobody (see all) Click here to sign up. |
Give your opinion to the peer rating of the content of this page. |
Upload data
|
Open assessment workshop 2009 is the third workshop about new methods in assessments (previously more narrowly on risk assessment), organised by the National Public Health Institute (KTL), Kuopio, Finland. Its main purpose is to provide the workshop participants a broad perspective to assessments, promote the idea and practice of open assessment, as well as further develop methods to perform open assessments. The workshop has started following the needs of several EU-funded research projects, notably Intarese, Beneris, and Heimtsa. The workshop is mainly targeted to postgraduate students working in the fields of environmental health or risk assessment, but it is also open to anyone interested. If you want to join the workshop, please create a user account (by following the log in/create account link in the right-top corner of the page) with your contact information and add your username to the list on the bottom of this page. There is no deadline for registration nor a registration fee for the workshop, but early registration is highly recommended in order to help both the organizers and the participants to arrange the facilities, accommodation, programs etc.
Contents
General information
Time: | 16.2. - 20.2.2009 |
Place: | KTL, Kuopio, Finland (Kuopio info) |
Organizer: | National Public Health Institute (KTL), Department of Environmental Health |
<googlemap width="375" zoom="11" type="map" lon="27.638855" lat="62.903976"> m62.893334, 27.679328, Kuopio, Finland 62.890603, 27.627397, THL Neulaniementie 4, 70701 Kuopio, Finland 62.866252, 27.648468, Jätkänkämppä smoke sauna </googlemap>
5-day weather forecast for Kuopio by the Finnish Meteorological Institute.
5-day weather forecast for Kuopio (in Finnish) by Foreca.
Description
The aim of the workshop is to provide the participants a good understanding of how to make the practical information needs of societal action and creation of scientific knowledge meet by making use of the latest methodological developments and modern information and communication technology. This aim is pursued in the workshop lectures and exercises by discussing and considering e.g following questions:
- How to take the practical needs of policy into account in assessments?
- How can scientific validity of assessments be ensured?
- How to increase the applicability and enhance the use of assessment outputs?
- How should impacts be appraised?
- How to make inferencing, information synthesis and communication more effective?
- Overall, what makes a good assessment a good one?
Answers to the questions listed above are sought for by addressing them from the point of view of open assessment. After the workshop, the participants should have:
- understanding and command of concepts, methods application areas of open assessment
- Adequate command of tools applied in open assessment in order to efficiently make use of them in design and execution of assessments and use of assessment outputs
- improved expertise in the environmental health relevant topics considered in the lectures and group work exercises
In addition to everything above, we wish that after the workshop at least some of the objects worked on in the exercises reach such a high quality in their information content that they can be considered to be the most up-to-date and comprehensive source of information regarding the topic in issue.
The core of the workshop program are the practical group work exercises related to a real-life assessment case called Assessment on impacts of emission trading on city-level (ET-CL), aiming to influence the COP-15 meeting to be held in Copenhagen December 2009. The exercises are complemented with lectures and guidance aiming to provide understanding of the necessary concepts and methods as well as sufficient command of the technical tools for carrying out the exercise tasks. The guidance will be provided by workshop organizers, as well as other participants suitably experienced in the question in issue, according to demand as the workshop progresses. Lectures and group work are explained in more detail below.
Daily program
Monday | Tuesday | Wednesday | Thursday | Friday |
---|---|---|---|---|
Introduction to workshop | Lecture 3: Variables and their information structure | Lecture 5: Scientific validity and practical need | Lecture 7: Assessments as causal networks, assessment-level analyses and conclusions | Lecture 8: Performance of assessment |
Lecture 1: Open assessment and science | Lecture 4: Information collection and synthesis | Lecture 6: Collaboration, argumentation | Outdoor activities: Skating on lake Kallavesi | Group work: Assessment performance evaluation |
Lunch | Lunch | Lunch | Outdoor activities: Skating lake Kallavesi | Lunch |
Lecture 2: Decisions, actors and indicators | Group work: Variable development | Group work: Variable development in collaboration | Lunch | Group work presentations |
Introduction to case study | Group work: Variable development | Group work: Variable development in collaboration | Group work: Assessment development | Workshop summary and feedback |
Practical arrangements | Group work presentations | Group work presentations | Group work: Assessment development | |
Evening program: dinner and smoke sauna | Evening program: skiing, snowboarding, sledding on [Puijo] | Group work presentations |
Morning sessions begin at 9:00. Lunch is available at Microteknia canteen (at participant's own cost) 11:45 - 12:45., after which the afternoon sessions continue until approximately 16:45. Exceptions to this are Thursday when we have a later lunch time as well as delayed afternoon session due to a skating trip to lake Kallavesi in the forenoon, and Friday when the afternoon session will end already by 14:00 due to travel schedules of some workshop participants.
Lectures
The lectures are conducted in a form that attempt to emphasize practicality of discussed topics as well as dialogue among the lecturers and participants. The whole set of lectures comprise a discussion that continues and develops throughout the workshop week and guides the participants from considerations regarding the purpose of assessments to detailed contents of individual variables and on to a synthesis and an evaluation of overall outcomes of assessments. The specific lecture topics can be seen in the daily program above.
NOTE: The first lecture on Monday morning, Open assessment and science, is targeted also to people that do not have the possibility or interest to participate in the whole workshop. It emphasizes the relationship between science and open assessment and impact of OA to making science, whereas the focus in the rest of the lectures and exercises is rather on providing information support to practical decision making. It is thus possible to attend only the first lecture as an independent part of the workshop program. It is also possible to continue to follow the rest of the workshop program after the first lecture without any prior registration.
Methods related to Monday morning lecture:
Group work exercises
There are four exercise sessions, one every day from Tuesday to Friday, each consisting of first working in small groups on specific tasks and then presenting the outcomes of that work to other groups. On Tuesday and Wednesday the exercises focus on developing the contents of a chosen set of variables belonging to the Assessment on impacts of emission trading on city-level (ET-CL). On Thursday the exercises focus on certain assessment level aspects of the ET-CL case drawing together the work on individual variables on previous days. The last exercise on Friday is about evaluating the goodness of the assessment and its parts in their current form. The groups will (probably) be reconfigured for each exercise.
The specific tasks for each group focus on one particular object, or a part of that object (a variable, an assessment attribute or group of variables located in Opasnet). The idea is to develop the information content by applying certain specified methods of open assessment. Tentative lists of objects and methods is presented below. The tasks are designed to be focused enough so that the group will be able to get a good grasp of the issue at hand, familiarize themselves adequately with the method(s) to be used, and produce some concrete output on the corresponding Opasnet pages. Methodological and tool support (also substantial expertise, if available) will be provided according to demand by workshop organizers as well as other workshop participants already familiar with the tools and methods in question.
The expected outcome of these exercise tasks consists of multiple aspects:
- improved information content variable or assessment pages in Opasnet
- improved information content of method descriptions in Opasnet
- increased understanding among the group members of both the substance that the objects describe and the methods applied
- understanding conveyed to other groups through group work presentations
Methods related to Monday afternoon lecture and introduction to group work
- Performing an assessment
- Defining the purpose of an assessment
- Defining the users of an assessment
- Issue framing
- Scoping an assessment
Tuesday exercise: variable development
Variable | Task |
---|---|
PM2.5 exposure-response function | Develop a new variable from the existing variables Concentration-response to PM2.5 and ERF of PM2.5 on mortality in general population |
Emission factors for burning processes | Develop a new variable using e.g. emission factor data from U.S.EPA |
Population of Helsinki metropolitan area | Develop a new specific variable from a more general variable Population of Europe |
DALY weights | Inclusion of uncertainty: improve variable content from point estimates to distributions |
Cardiopulmonary mortality in Helsinki metropolitan area | Development of a new specific variable from a general variable Background incidence rates in Europe |
Methods related to Tuesday exercise:
- Designing variables
- Plausibility test
- Applying general information
- Result domain
- Executing variables
- Calculating health impacts
- Life table
Wednesday exercise: variable development in collaboration
- Scrutinize one variable by some other group (see list of variables above). According to your expertise create statements and arguments about the content
- React to argumentation given to your group's own variable. Counter argue and/or improve the variable
Methods related to Wednesday exercise:
- Open participation
- Evaluating scientific claims
- Dealing with disputes
- Discussion
- Help:Argumentation
- Index conversion function
- Merging models with different grids
- Synthesising information about continuous variables
- Using non-predetermined spatial disaggregation
Thursday exercise: assessment development
Assessment-level aspect | Task |
---|---|
Meeting needs of primary intended use (COP-15) |
|
Assessment-level analysis |
|
Assessment optimization |
|
Parts and relations of assessment |
|
Scenarios - alternative EU ETS phase III compositions |
Methods related to Thursday exercise:
- Drawing a causal diagram
- Improving the result of a variable
- Value of information
- Reporting an assessment
- Operationalising large structural changes to existing systems
- Variable transfer protocol
Friday exercise: evaluation of assessment performance
Assessments serve two masters: practical (policy) need & scientific validity (truth)
- Properties of good assessments
- Quality of content
- Applicability
- Efficiency
- Technical quality
- Peer review
- Contributor rating
Methods related to Friday exercise:
- Performance
- Acknowledgements
- Peer review
- Quality assurance and quality control
- Quality evaluation criteria
Facilities
A working space with a wireless internet connection will be provided for all participants at the premises of THL (formerly known as KTL). Each participant is recommended to bring along a laptop computer. If this is not possible for you, please inform the organizers about this and we will see what we can do about it.
Lectures and group work will take place at KTL, Neulanen building (see map). Meeting at the reception at 08.45 on Monday morning, where you will receive your visitor cards.
Your suggestions
Workshop program is still being adjusted and further suggestions are welcome. See other people's suggestions and give your own suggestions on the discussion page. You can also have a look at the workshop program 2008 and the lecture slides from workshop 2008 as well as other preparation material at the end of this page.
Remote participation
If there should be any people who would like to participate in the workshop, but cannot make it to Kuopio to attend the workshop in person, we try to organise a web-conference for the lecture sessions using Skype. The group work will be worked on using the Opasnet website, so also outsiders can relatively easily take part in that as well. This way you may also participate from wherever you are, as most major things - except the social program - will be made available via the Internet. Add your name on the list of remote via internet participants at the end of this page if you want to follow the workshop, but are unable to attend in person.
Social activities
Activities arranged as part of the workshop program:
- Tuesday evening: smoke sauna and dinner at Jätkänkämppä
- Wednesday evening: skiing, snowboarding, sledding etc. at Puijo (Antikkala)
- Thursday morning: skating on lake Kallavesi exploiting the Finland Ice Marathon skating tracks
It is still possible to adjust the social activities program. If you have wishes or suggestions, go ahead and let us know by writing them down on the discussion page
Please note that the social activities are voluntary and the costs of activities will be borne by the participants themselves. Participating in the social activities happens at each participant's own risk, the participants are not insured against any accidents by the workshop organizers. It is recommended that each participant makes sure before the workshop that they have a valid insurance that covers also the free-time activities during the workshop.
Examples of other activities, sites etc. available:
- Finland Ice marathon, a skating event on natural ice of lake Kallavesi 18-22 February, 2009
- Tahko, a ski resort approximately 1 hour drive northeast from Kuopio
- Puijo tower, the most famous attraction of Kuopio
- Rauhalahti Spa, a spa hotel in Kuopio
- Live music e.g. at Henkka or Kuopio Music Centre
Accommodation
We have a block reservation for the workshop participants at Hotel Savonia see map. The hotel is the same as where most of the 2008 workshop participants stayed.
Room prices for workshop participants:
- Single room 80 euros/night
- Double room 96 euros/night
If you need accomodation, please (in addition to mentioning it in the registration below) inform the organizers about the desired room type and duration of your stay. If you wish to save some money by sharing a double room with someone, but you do not have a room mate, we can try to do some matchmaking on behalf of you. However we can not guarantee finding a room mate for everyone. If you wish to stay in Kuopio over the weekend before or after the workshop, the above-mentioned workshop room rates apply also for weekend nights.
Getting around in Kuopio
Arrival/departure by air
The distance from Kuopio airport to the city is about 17 km. There are two options to get from the airport to the hotel - bus and taxi. Kuopio airport transport connections
Bus:
Airport buses (5 €/trip) operate (by Linja-Karjala Oy) from all domestic flights, except for the flight AY519, arriving 00.25! The bus leaves from the airport approximately 5-15 minutes after the flight has arrived (the bus will wait for the passengers to collect their luggage before leaving). Get off the bus at Market Square in the center of Kuopio. From the Market Square it is possible to walk to the hotel (distance 2,4 km, see map) or alternatively you can take a bus line 5 (2,70 €/trip) that goes by the hotel. Line 5 buses leave from the Market Square close to the Market Hall on the south end of the square (see map. The timetable (unfortunately only in Finnish) for line 5 can be seen here.
Airport buses operate to all domestic flights. Bus to the airport leaves from Market Square (front of Anttila department store, east end of the square, Puijonkatu 19) 55 minutes before flight departure.
Taxi:
After each flight arrival there will be taxis waiting outside the airport. You may choose the airport taxi service (18 €/person), which means that the driver will wait until the car is full (in practice 2-3 persons/taxi) before leaving and then takes each passenger to their destination. Alternatively you may choose the normal taxi service (about 30 €/trip). If there are 2 people or more sharing a normal taxi it will be cheaper to take the it instead of the airport taxi service. If there are no taxis waiting at the airport you can order one by calling +358 17 106 400.
When going to the airport, make your airport taxi bookings (18 €/person) at least 2 hours before your scheduled departure by calling +358 17 106 400. The taxi will come to pick you up from agreed location approximately 1 hour before the scheduled departure time. Again, if there are 2 or more people sharing the taxi, it is also possible to order a normal taxi from the same taxi center number +358 17 106 400.
Arrival/departure by train
Kuopio railway station is located close to the center. It is possible to walk to the hotel (distance 2,1 km, see map) or alternatively walk to Market Square and take bus line 5 going by the hotel. Line 5 buses leave from the Market Square close to the Market Hall on the south end of the square (see map. The timetable (unfortunately only in Finnish) for line 5 can be seen here. Getting from hotel to the railway station happens similarly, but vice versa. You can also take a taxi to the hotel in front of the railway station.
Attendees
Please list your name and organisation here: (Requires login)
No accommodation needed:
- Jouni Tuomisto, KTL, Risk research group
- Juha Villman
- Päivi Meriläinen, KTL
- Mikko Pohjola, THL
- Juuso Uski, Toxicology student, University of Kuopio
- Virpi Kollanus, THL
- Pauliina Ahtoniemi, THL
- Olli Leino, THL
Accommodation needed:
- Eva Kunseler (probably), PBL, Quality of the Local Environment
- Anne Knol, RIVM
- Audrey de Nazelle, CREAL
- Tek-Ang Lim, InVS
- Danielle Vienneau, IC
Participation via the Internet:
- Katy Walker
- Alex Kuhn
Useful links while preparing for the workshop
- Glossary is a collection of important concepts and terms and their explanations
- See Help:Contents for guidance on using Opasnet (this site, running on Mediawiki software platform).
- We recommend participants to familiarise themselves with the following concepts:
- A free 15-day trial version of Analytica or an Analytica player for viewing the models from Lumina Decision Systems website on this site.
- Guidebook is a collection of links to theory and method pages related to the workshop.
- Lectures from workshop 2008:
- Lecture 1: Introduction to Open Risk Assessment (ORA) and the workshop (also in Finnish!)
- Lecture 2: General assessment framework
- Lecture 3: Information structure of ORA: assessment products and their relations
- Lecture 4: Information structure of ORA: defining variables
- Lecture 5: participating in assessments: argumentation
- Lecture 6: participating in assessments: moderation and quality control
- Lecture 7: evaluating assessment performance
- Lecture 8: assessing uncertainties
Keep an eye on this page, this is the official website of the workshop. It will be updated as new information comes available.