UNAWE Evaluation contexts
Case study example activity
Evaluation workshop day 1 House of Astronomy Heidelberg
Your name Your organisation
SĂŚvar Helgi Bragason Stjornufraedivefurinn
1. Who were the participants?
Kindergarten teachers
1. Who were the participants? a. 30-55 Age 1. Who were the participants? b. 20 Number of participants Workshop for kindergarten teachers, with special emphasis on the Earthball. Earth/Moon/Sun interaction, day and night, seasons, eclipses, stories of the 2. What was the activity? Website constellations. No website with English text, unfortunately. address: Teach the teachers how to make a good use of the Earthball in the classroom. Giving them the self-confidence to teach astronomy to young children. Inspiring 2a. What were the activity goals? them to look up.
2b. Describe the activity 2c. What time of day did the activity take place? 2d. Activity duration 2e. Who delivered the activity? (tick as many as apply) 2f. Activity format 2g. How was it advertised? 3. Where did the activity take place? a. Location 3. b. Country
4. How did you evaluate it? a. What did you want to know?
Hands-on activies with the Earthball to show day and night, seasons etc using similar activies as in the Earthball booklet. Smaller balls to explain Moon phases. Stellarium used to tell stories behind the constellations. Morning 121- 180 mins Educators, Volunteers Teacher training session Website, Targeted email, Social Media Reykjavik Iceland Haven't evaluated it. Want to know if this had any success, if the teachers started using the new knowledge in the kindergarten.
Your name Your organisation 1. Who were the participants? 1. Who were the participants? a. Age 1. Who were the participants? b. Number of participants
Sarah Eve Roberts EU-UNAWE British School of the Hague students 9 27
Space Scoop Storytelling: http://www.unawe.org/activity/eu-unawe1316/ - Getting familiar with astronomy and science journalism and improving creative thinking, literacy and teamwork skills. - Learn about the latest scientific discoveries happening in astronomy. 2a. What were the activity goals? - Practise and develop language and art skills 2. What was the activity? Website address:
2b. Describe the activity 2c. What time of day did the activity take place? 2d. Activity duration 2e. Who delivered the activity? (tick as many as apply) 2f. Activity format 2g. How was it advertised? 3. Where did the activity take place? a. Location 3. b. Country
Use Space Scoop astronomy news stories for children as the basis for a creative writing and drawing activity. Afternoon 61- 120 mins Students, Communicators/ NPM School session Targeted email
4. How did you evaluate it? a. What did you want to know?
Classroom the Netherlands If the listed learning objectives/goals were achieved. If the children enjoyed the activity; were inspired by the topic and motivated to continue learning about science/ astronomy.
4b. Who were you evaluating it for?
EU-UNAWE project and all users of this workshop (the activity guide is public).
4c. Which methods did you use? Interviews with students post activity (not recorded.)
4d. What did you find out?
The children were very excited about the topic covered (black holes, supernova, exoplanets) and had a lot of questions still to be answered. Appeared that they would follow up the subjects in the future.
Many of the learning objectives would not be visible without a future session, or in the short-term. Verbally within a small group, and by improving the 4f. How did you communicate learning goals. what you found? Unfortunately, unsure for now as the activity took 4g. What are the implications of place just once and we have not been in contact with the school teachers or students since. the evaluation? 4e. What were the challenges?
Your name Your organisation 1. Who were the participants? a. Age b. Number of participants 2. What was the activity? Website address:
Tomita Wakayama Univ, Japan nursery children 3-5 years old 80 so far only in Japanese
Let children express what they feel and think as much as possible. Let children exchange what they express as 2a. What were the activity goals? much as possilbe. Talk about today's weather, Talk about starry world, sometimes fantasy, 2b. Describe the activity Endless question-and-answer sessions 2c. What time of day did the Morning activity take place? 2d. Activity duration 30- 60 mins 2e. Who delivered the activity? Educators 2f. Activity format School session 2g. How was it advertised? personal connection 3. Where did the activity take nursery place? a. Location 3. b. Country Japan How much the children express what they feel and think. 4. How did you evaluate it? a. How much the children exchange what What did you want to know? they express. 4b. Who were you evaluating it Nursery teachers observe the children, and for? they explain their memo to me. 4c. Which methods did you use? Hearing from nursery teachers. Some children say many words than everyday activities, that is surprising to teachers. Some children do like discussing with friends. Though the children's expressions are not scientific, children try to explain hard about their thinking to friends and 4d. What did you find out? teachers; that is surprising to teachers. Memo of teachers is not complete. 4e. What were the challenges? 4f. How did you communicate what you found? 4g. What are the implications of the evaluation?
Some teachers make good memo, but others not. I would like to know how to access the memo. Children already have enough base for scientific discussion.
Your name Your organisation
Jean-Christophe Mauduit IAU Office of Astronomy for Development
1. Who were the participants? lecturers & students adults between 25 and 40 1. a. Age 1. b. Number of participants 15 Introducing astronomy teaching for undergrads http://www.astro4dev.org/activities/astrovarsity/unizul 2. What was the activity? Website address: u-workshop/ The goal was to present them the AstroVARSITY teaching project in more details and see how it could 2a. What were the activity goals? be implemented at the University of Zululand.
2b. Describe the activity 2c. What time of day did the activity take place? 2d. Activity duration
the workshop at UNIZULU was aimed at presenting the practical part of the AstroVARSITY project to potential lecturers and tutors as well as discussing ways of implementing it into the curriculum. The idea was to present them the instruments (telescope + photometer), their basic working principle and how to use them. We also planned to give them an overview of potential projects that can be done with it, in terms of practicals and small research projects as well as potential in terms of education and public outreach. Moreover we include a brief presentation of the kind of tutorials that could be done with the students as well as the possibilities of Virtual Observatory projects. Full day 3 days
2e. Who delivered the activity? Students, myself (tick as many as apply) Teacher training session 2f. Activity format Website, Printed material, Targeted email, Social 2g. How was it advertised? Media 3. Where did the activity take University of Zululand place? a. Location South Africa 3. b. Country Feedback on google form: 4. How did you evaluate it? a. http://www.astro4dev.org/activities/astrovarsity/unizul What did you want to know? u-workshop/unizulu_workshop_feedbacks/ 4b. Who were you evaluating it For the office for? 4c. Which methods did you Only online feedback use? Successful outcome and general satisfaction 4d. What did you find out? Unfortunately only a few responses (hence limited sample) although importance of feedback was 4e. What were the challenges? emphasized 4f. How did you communicate Only internally for now (within the office) what you found? 4g. What are the implications Moving forward on the workshops in other universities of the evaluation?
Your name Your organisation 1. Who were the participants? 1. a. Age 1. b. Number 2. What was the activity?
Edward Gomez Las Cumbres Observatory Anyone 10-21 year olds 1500
http://lcogt.net/agentexoplanet Make measurements and scientific discovery 2a. What were the about exoplanet, without detailed technical activity goals? knowledge of software. Participants use a custom website to measure and analyse exoplanet data. Everyone's results are combined to produce a final 2b. Describe the activity exoplanet model with physical parameters 2c. What time of day did the activity take place? Anytime Participants can do as much as they like but 2d. Activity duration usually between 30-90 mins 2e. Who delivered the activity? (tick as many as Either independently or with a research astronomer to assist apply) School session, Community/ public session, 2f. Activity format Citizen science data collection 2g. How was it Website, Social Media advertised? 3. Where did the activity take place? a. Location online 3. b. Country N/A Did our approach succeed in allowing 4. How did you evaluate participants to concentrate on the science it? a. What did you want and science process instead of learning how to know? to install and use software. 4b. Who were you Myself (the developer) evaluating it for? 4c. Which methods did Likert scale and "2 stars and a wish" you use? 4d. What did you find Many students enjoyed the activity but made suggestions about improving it. out? 4e. What were the challenges?
Getting well phrased questions which don't introduce bias.
Your name Your organisation 1. Who were the participants? 1. a. Age 1. b. Number of participants 2. What was the activity? Website address:
Hassane Darhmaoui Al Akhawayn University in ifrane Teaches, students, amateur astronomers 18 to 65 36
Web2 technologie, Ifrane, Morocco 2013 Train diiefent actors in 2a. What were the agricultureon the use of Web 2 activity goals? technologies Workshop on What is Web2? Social networks? Audio/Video techniques 2b. Describe the activity Real applications in Agriculture 2c. What time of day Full day 2d. Activity duration 2.5 days 2e. Who delivered the Educators, Volunteers activity? 2f. Activity format Resource 2g. How was it Website, Targeted email, Social advertised? Media 3. Where did the activity take place? a. Location Al Akhawayn University, Ifrane 3. b. Country Morocco 4. How did you evaluate Level of satisfaction of the trainee it? a. What did you want Things they got fromthe workshop to know? Things they liked or dislaked 4b. Who were you Karianet Association evaluating it for? 4c. Which methods did Questionnaire you use? 4d. What did you find Good and encourqaging out? appreciations 4e. What were the The number of respondants of the challenges? onlinequestionnaire 4f. communication Email 4g. What are the Repeat the workshop for another implications? group
Your name Your organisation 1. participants? 1. a. Age 1. b. Number of participants 2. What was the activity? Website address:
2a. What were the activity goals?
2b. Describe the activity 2c. What time of day did the activity take place? 2d. Activity duration 2e. Who delivered the activity? 2f. Activity format 2g. How was it advertised? 3. a. Location 3. b. Country
Enrique Torres IVIC Teachers at basic school in Venezuela between 20 and 30 years old 25 UNAWE-VENEZUELA Actual program of building of Schools Planetariums, at the City of Merida Teach to the teachers the way to build a geodesic school planetarium and use it with the pinhole star projector and also with an video projector for astronomy and general science education at schools Introduction: Workshop description, methods and objectives School Planetariums and UNAWE: Importance and construction Triangle Cut for planetarium Dome building Projector construction Testing and calibration of projector: Introduction to the Celestial Sphere and Constellations Multimedia instructional strategies for teaching science in the planetarium Summary, conclusions and directions for further work Full day 3 days Educators Teacher training session Website, Targeted email, education ministry at venezuela MĂŠrida, Venezuela Venezuela
Venezuela (contd.)
the teachers learn the way to build 4. How did you evaluate the planetariums, but not all are it? a. What did you want really shure to build it by to know? themselves 4b. Who were you evaluating it for? 4c. Which methods did you use?
4d. What did you find out?
4e. What were the challenges? 4f. How did you communicate what you found? 4g. What are the implications of the evaluation?
for better the program forms at the end of the workshop and phone calls 1, 2, 3 months after the workshop that maybe 30% of the teachers build new planetariums, a 40% wants but have obstacles at their schools
better the methods of teach to use the multimedia resourses by informs and web articles better the results and obtain more of the objectives
Your name Your organisation
Olayinka Fagbemiro Nigerian's Space Agency school kids- pre-school to high 1. Who were the participants? school 1. Who were the participants? a. Age 3 to 17years 1. Who were the participants? b. around 200 in groups of 10s Number of participants 2. What was the activity? Website Water rocketry address: To teach kids about water rocket launch and have them replicate the 2a. What were the activity goals? activities Some water rocketry kits were used and the kids were taught the basics of water rocketry and how to launch 2b. Describe the activity it and have them do it themselves 2c. What time of day did the activity Afternoon take place? 2d. Activity duration 30- 60 mins 2e. Who delivered the activity? (tick Educators, Students as many as apply) Festival activity, School session, 2f. Activity format Teacher training session Printed material, Targeted email, 2g. How was it advertised? Invitations sent to schools 3. Where did the activity take place? School premises a. Location 3. b. Country Nigeria 4. How did you evaluate it? a. What We marked the distance each did you want to know? launched rocket travelled 4b. Who were you evaluating it for? The agency to see how kids were able to replicate 4c. Which methods did you use? what they were taught a number of the kids were able to reproduce what they saw and had 4d. What did you find out? very good launches we had limited kits(resources) and had to take too many kids in a 4e. What were the challenges? group 4f. How did you communicate what we wrote a report at the end of the you found? activities To show the impact of the team's 4g. What are the implications of the activities on the kids, to measure evaluation? their reception and understanding
Your name Mark Bailey Your organisation Armagh Observatory 1. Who were the participants? Primary School Teachers 1. Who were the participants? 18-65 a. Age 1. Who were the participants? 10-20 per course b. Number of participants 2. What was the activity? Primary Sector Teacher Training Website address: Course To provide a basic level of knowledge and understanding of modern astronomy to Primary School Teachers and provide them with fact, knowledge, links to other resources etc. to that the information provided, and astronomy more generally, may be incorporated into the curriculum. Thus: to provide (a) and introduction to the principal features of the solar system and Earth's place in the wider Universe; (b) to gain some understanding of scale and of relatives sizes and distances in the solar system and beyond; and (c) to 2a. What were the activity show how this can all be incoporated goals? as examples in the relevant A series of interactive talks, discussion Curriculum. sessions and engaging activities provided to small groups of Primary Sector teachers as part of a whole-day activity in a teacher centre or other appropriate learning centre used by 2b. Describe the activity teachers for teacher training. 2c. What time of day did the Full day activity take place? 2d. Activity duration Whole Day 2e. Who delivered the Professional teacher trainer and activity? (tick as many as professional astronomer apply) 2f. Activity format Teacher training session 2g. How was it advertised? Printed material, Targeted email 3. Where did the activity take Teacher Centre place? a. Location UK and Ireland (e.g. England, Wales, Scotland, Northern Ireland and 3. b. Country Republic of Ireland)
Northern Ireland (contd.) 4. How did you evaluate it? a. What did you want to know? Feedback forms (two types) Ourselves (feedback on quality of course, delivery mechanisms, comments from participants) Impact on (a) participants and colleagues, and (b) on the pupils they either reach 4b. Who were you directly or reach indirectly through evaluating it for? colleagues (i.e. wider dissemination) Completion of feedback forms and requests for further information after time had been 4c. Which methods did given for the impact of the course(s) to be you use? registered within schools) Courses very positively received; often too little time for complete discussion of all issues raised during the course; there is an ongoing need for further courses of this kind; the "best" (i.e. most often appreciated) resources are those that are (a) simple in concept and (b) cheap and so readily 4d. What did you find procured of fabricated by the teacher, given out? classroom resource constraints. Enthusing and a group of professional teachers with a subject (astronomy) which many of them will have had very little experience of, and demonstrating its value in the wider context of teaching and learning in the school environment and especially the Primary School curriculum in the different regions of the UK and Ireland. Cost; i.e. time and money required to deliver each course, c. 5k pounds per course. The course is perceived by schools and by funding agencies as expensive, given the 4e. What were the relatively small numbers (c. 10--20) of challenges? 4f. How did you Through internal and annualper reports of professional teachers reached course. communicate what you the Armagh Observatory and the EU-UNAWE found? programme. 4g. What are the There is an ongoing need to provide more implications of the primary-sector teacher training in evaluation? astronomy and related sciences.
Your name Your organisation 1. Who were the participants? 1. Who were the participants? a. Age 1. Who were the participants? b. Number of participants 2. What was the activity? Website address: 2a. What were the activity goals? 2b. Describe the activity 2c. What time of day did the activity take place? 2d. Activity duration 2e. Who delivered the activity? (tick as many as apply) 2f. Activity format 2g. How was it advertised? 3. Where did the activity take place? a. Location 3. b. Country 4. How did you evaluate it? a. What did you want to know? 4b. Who were you evaluating it for? 4c. Which methods did you use?
4d. What did you find out? 4e. What were the challenges? 4f. How did you communicate what you found? 4g. What are the implications of the evaluation?
Pedro Russo UNAWE Leiden General Public (Mainly school pupils) 4-85 yl 3800 Transit of Venus 2012 in Timor-Leste http://www.unawe.org/network /national/tl/ Give the opportunity to the public observe and understand the transit of Venus Public observation of transit of venus. through telescopes and solar glasses. Morning 5 hours Educators, Students, Volunteers Community/ public session Website, Printed material, Targeted email, Publication, Social Media, Mass media Dili Timor-Leste Quantitative: Number of people attending For our project, donors and supporters We count the number of people looking through a telescope. Unique astronomical phenomena attract large crowds Difficult to engage in a deeper level with participants. Manage large amount of people. Draft report, presentation at CAP2013 Large scale, measure number of people.
Your name Your organisation
Livia University of Sao Paulo
1. participants? children 1. a. Age 6-8 years 1. b. Number of around 120 participants Using the 3.4 "Universe in a Box" activity named "Sun’s Path 2. What was the and a Sundial" for 6 different groups of children. activity? Pictures are here: Website https://www.dropbox.com/sh/lhqhln143csf9l8/5moBTr0 address: L8l - the shadow changes accordingly the sun's position. 2a. What were - the sun’s path on the sky changes during a year the activity - the sun's path changing is related with the year goals? seasons. We paid attention on how the observer’s shadow changes depending on the sun’s position. Then we concluded that the biggest observer’s shadow happen at both sunrise and sunset moments, and the smallest observer’s shadow happens at noon. Before I drew the three sun’s paths on the half-sphere (summer, spring/autumn and winter) using washable markers, I invited children to think what we could draw on the white paper to fill the observer’s landscape. So I drew streets, houses, lakes, cars and trees according to children’s suggestions. This part was important to guarantee children were understanding the idea of local observer’s view and what the half-sphere was representing. I didn’t need to define the half-sphere for any group because they 2b. Describe the naturally understood all elements. We couldn’t reach activity neither “Other parts of the world” nor “Sundial” topic 2c. What time of due to lack of time. Each class is 40min long. half in morning, half in afternoon day? 2d. Activity 30- 60 mins duration 2e. Who delivered the Educators activity? 2f. format School session 2g. How was it it's a regular event in that school advertised? 3. a. Location 3. b. Country
public school in my home town, near Sao Paulo Brazil
Brazil (contd.)
4. How did you evaluate it? a. What did you want to know? Whether my goals were reached. 4c. Which methods did Looking at the children behavior during the you use? activity and their questions about it. The 30cm diameter half-sphere is too small to be used with 20-25 children. I had to manage children’s position many times, so I 4d. What did you find separated them in smaller groups. That out? consumed many minutes. I adapted the activity for the youngest group and spent most of time relating shadows with sun’s positions. They really liked the shadow movement according to the flashlight. The oldest group wanted to think how the sun’s path is in another country after the sunset for our observer. So we used a globe and two little dolls glued on the globe to simulate sunrises, noons and sunsets for different places. They were very excited.
4e. What were the challenges? 4f. How did you communicate what you by the UNAWE report form. found? 4g. What are the implications of the It can help me to see what didn't work well and make changes for the next activities. evaluation?
Your name Your organisation 1. Who were the participants? 1. Who were the participants? a. Age 1. Who were the participants? b. Number of participants
2. What was the activity? Website address:
2a. What were the activity goals?
2b. Describe the activity
Zhu Dayi Shanghai Astronomical Observatory artists,visitors 16-40 ＋ 5000 http://www.astron.ac.cn/bencandy-43435-1.htm http://blog.sina.com.cn/s/blog_537c9d9 30100k6ed.html （ for pictures) http://www.douban.com/event/1224466 7/ http://vision.xitek.com/info/201007/1447590.html (professional photographer web ） Through the exhibition to inspirit and influence the artists, let them to influence more people to know about astronomy,How beautiful the universe is,let more people .Give astronomy a label of "fashion" and "romantic". Artist class belongs to the class of ideology in nowadays China, represents fashion and frontier. The theme the of the exhibition quoted the buddhist scriptures“ 相由心生”（ the figure comes from your mind ） ,we changed one character : 心 (mind)to 星（ star) ， as" 相由星生” . In addition to cut the ribbon on opening ceremony,we invited scientist give the audience a lecture,for the interpretation of the images. most of the audiences is resident artists in this art space. (some of them is the invited artist of the Venice biennale) otherwise,we rearrangement the Use exhibition contents by people interest in the constellation.Star image content is according to the order with zodiac constellation, e.g.the crab nebula in Taurus. when mention of Taurus, the image of M1 will appear. The exhibition has been lasted for 45 days.
China (contd.)
2c. What time of day did the Full day activity take place? 2d. Activity duration 45days 2e. Who delivered the activity? Educators, Image technology suppliers (tick as many as apply) Festival activity, Community/ public 2f. Activity format session 2g. How was it advertised? Printed material, Social Media 3. Where did the activity take M50 art centre(biggest art centre in place? a. Location Shanghai) 3. b. Country PRC 4. How did you evaluate it? a. The popularity and can be continuity What did you want to know? in the future 4b. Who were you evaluating it The organizers & sponsors for? 4c. Which methods did you exhibition,lectures. use? Many people seemingly has nothing to do with science , but people love the stars, they have a strong curiosity on astronomy. In addition, the curator's 4d. What did you find out? point of view is very important. Otherwise,Excellent display project 4e. What were the challenges? book is very important. Local media.They reported a lot of this 4f. How did you communicate exhibition.Both art media and what you found? fashion media The combination of art and astronomy is a very avant-garde and 4g. What are the implications fashion. Need to do more such of the evaluation? activities in the future.
Your name
Charlotte
Your organisation
EU-UNAWE
1. Who were the participants?
young girls
1. Who were the participants? a. Age
'8-11
1. Who were the participants? b. Number 6-8 per group of participants 2. What was the activity? Website address:
2a. What were the activity goals?
2b. Describe the activity
Invent an Alien Introduce the properties of planets and moons and how they affect life - Give an introduction/presentation about the properties (e.g. atmosphere, temperature, distance to sun...) - give them an example of a life form based on a planet/moon - give factsheets of each planets/moons - Ask the children to choose one planet/moon and invent draw a life form that relates to the properties -
2c. What time of day did the activity take Afternoon place? 2d. Activity duration
61- 120 mins
2e. Who delivered the activity? (tick as 2 interns science writer & one intern designer many as apply) 2f. Activity format 2g. How was it advertised?
Festival activity Â
3. Where did the activity take place? a. Bruxelles International school Location 3. b. Country Belgium