APPENDIX D

QUESTIONNAIRE

Appendix D is the questionnaire form used after participants performed online catalog searches on CHESHIRE. It contains questions on users' search experience on CHESHIRE and aims to collect data on CHESHIRE's retrieval performance. A questionnaire form was filled out for each search query.

(1-3) Incident ID # Login ID #:

(4) 1. o Effective 2. o Ineffective o Transaction log #

Please do not write above the line

QUESTIONNAIRE

Please answer, by checking appropriate box(es), the following questions about the search you performed on CHESHIRE.

1. You are a: (5)

¨ MLIS student ¨ Certificate student ¨ Doctoral student

2. How long ago did you perform this search? (6)

¨ 0 - 7 days ago ¨ 8 to 30 days ago ¨ 31 to 90 days ago

3. Did you find what you wanted in your first try? (7)

¨ Yes [Skip to Q# 5] ¨ No ¨ Not quite what I wanted

4. Why was this? (8)

¨ The sources did not look helpful

¨ I was looking for more specific sources

¨ I was looking for more general sources

¨ I had to wade through a lot of useless sources

¨ I had experienced problems in using CHESHIRE

5. Considering your first try using CHESHIRE for this question, approximately what (9)

percent of the sources you found were especially useful?

¨ 0%

¨ Less than 10%

¨ Less than 25%

¨ Less than 50%

¨ More than 50%

¨ More than 75%

¨ More than 90%

¨ 100%

6. Did you perform relevance feedback search? (10)

¨ Yes ¨ No [Skip to Q# 9] ¨ I don't remember [Skip to Q# 9]

Please turn over

7. Did relevance feedback improve the search results? (11)

¨ Yes, I found more useful sources

¨ Yes, results were better than the first try

¨ No, the sources I found were similar

¨ No, I found less helpful sources

¨ No, not at all

8. Considering your overall experience (including relevance feedback) with CHESHIRE, (12)

approximately what percent of the sources you found were especially useful?

¨ 0%

¨ Less than 10%

¨ Less than 25%

¨ Less than 50%

¨ More than 50%

¨ More than 75%

¨ More than 90%

¨ 100%

  • 9. What was it that you found most helpful in CHESHIRE? [You may mark more (13-18)
    •

    than one.]

  • ¨ Ability to enter search queries in natural language
    •

    • ¨ Ease of use

    ¨ Relevance feedback

    ¨ Fast retrieval

    ¨ Retrieval results

    ¨ Other (Please explain.)

  • 10. What was it that you found most confusing in CHESHIRE? [You may mark more (19-23)
    •

    than one.]

    ¨ Difficult to use

    ¨ Lack of Boolean searching capability

    ¨ Relevance feedback

    ¨ Time consuming

    ¨ Other (Please explain.)

    Thank you.