Skip to content. | Skip to navigation

JISC Answers

Ask a new Question

You are here: Home Questions Evaluating project outputs
 
Q: Evaluating project outputs

Hi Everyone,

We are in the process of putting the final touches to our first learning resource - this is an interactive piece of work which takes users through the basic copyright considerations when handling multimedia items in a repository.

In line with most of our project outputs we'd like to evaluate this learning object once it has been released into the wider world. We have decided to embed a mini feedback survey within the object itself and we'll also invite people to complete the feedback survey in our promotion of the object to various mailing lists etc.

What I'd like to ask is for advice and suggestions for the content of our feedback survey. Has anyone got any good practice guidlines we can follow, any information on how to construct survey questions or examples of their own feedback surveys that we can take a look at? We are basically wanting to know what questions to ask and how to ask them.

Any advice would be much appreciated!
Many thanks

Jackie
Welsh Repository Network
http://www.wrn.aber.ac.uk/

jknowles
Asked by Jackie Knowles
from Aberystwyth University on 27-10-2009 at 16:11
[]
Member Answer

Hi Jackie - if you are looking to evaluate the product from the project perspective, wouldn't this be more about metrics that relate to its usage and distribution? Metrics relating to quality could simply be that x respondents 'rated the object as good or excellent'

If however you are trying to find out more about the value that users place on the content, then I'd favour a simple free text commenting and rating system. I've always thought that surveys have a habit of channeling responses rather than encourgaing free thought.

Just a thought...

Answer by James Toon — (0) ERIS Project Manager at University of Edinburgh on 28-10-2009 at 11:02
[]
Member Answer

Just a thought - may be an approach you could adopt could be based on an information literacy approach to validating resources  looking at this Berkeley site gave me the idea http://www.lib.berkeley.edu/instruct/guides/evaluation.html e.g. audience (is it aimed at particularly learners), is it up-to-date etc, guidance of reuse and whether this adequated reflected in the metadata. Another important issue is accessibility e.g. are there text alternatives for audio and video material.   

Answer by Vicki McGarvey — (0) Project Manager at Nottingham Trent on 29-10-2009 at 12:58
[]
Member Answer

Jackie

I've been waiting to see if you got any further replies before I added my thoughts. In our Project Team we included a team member who had a very good knowledge of 'research methods' and who had a deep understanding of user engagement tools etc. If you are still looking for advice maybe you could e-mail me at paul.mayes@gmail.com and we can see if we can help.

Answer by Paul Mayes — (0) Consultant at betterprojects.jiscinvolve.org on 12-11-2009 at 12:14