Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

Semantic Digital Libraries Evaluation

Results of Anna Karpinska (DSpace)

Pre-Evaluation Questionnaire

1. Your age

< 20 21 - 25 26 - 30 31 - 35 36 - 40 > 40

2. Your education

under- BSc MSc PhD Other

grad

3. Main domain of education / research

Informatics / Computer Science

Electronics / Telecommunications
Business / Marketing
Fine Arts / Architecture
Life Science / Social Science
Bio-Chemistry
Maths / Physics
Other

4. How often do you visit the university library? (slide the X marks on the lines below)

at least at least at least

more
once a once a once a
seldom
day week month

5. How often do you visit the university digital library? (slide the X marks on the lines below)

at least at least at least

more
once a once a once a
seldom
day week month

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 1 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

6. Do you know what social tagging is?

Yes
No

7. Do you use any online bookmarking system? (If yes - name up to 3 most often used.)

Yes
No

8. Are you subscribed to any online social networking site? (If yes - name up to 3 most often
used.)

Yes
No

9. Have you ever come across the term “Web 2.0”? Do you know what it means?

Yes
No

10. Have you ever come across the term “Semantic Web”? Do you know what it means?

Yes
No

Questionnaire After the Initial Task

1. What is your general first impression about the system? (slide the X marks on the lines
below)

hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, intuitive, straight

unintuitive forward

boring interesting

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 2 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

ugly, unattractive attractive

useless useful, handy

2. How did you find the task of registering to the digital library? (slide the X marks on the
lines below)

hard to understand easy to understand

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

3. How did you find the task of finding publications described with either of two given
keywords: ''web services'' and ''semantic web''? (slide the X marks on the lines below)

hard to understand easy to understand

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

4. How did you find the task of finding ''publications about notitio.us'' ? (slide the X marks
on the lines below)

hard to understand easy to understand

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

5. How did you find the task of bookmarking articles about notitio.us ? (slide the X marks on
the lines below)

hard to understand easy to understand

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 3 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

6. Please describe how (using which system) did you bookmark articles about notitio.us.
(Please, provide a link to the bookmarking services if you used an online bookmarking
solution, outside of the digital library.)

I didn't

7. Do you have any comments to this part of the evaluation?

No

First Task

Question: Which personality features are considered to be the factors increasing the
usage of the Internet (and for which purposes)?
(PL: Ktore cechy osobowosci uwaza sie czynniki zwiekszajace wykorzystywanie sieci
internetowej (do jakich celow)?)

Answer:

Openness and Neurocism

References:

http://dspace.digime.name/bitstream/123456789/547/4/href/big%20five-osobowosc36099.pdf

Comment:

none

Evaluation Questionnaire after the First Task

1. How did you find the task of finding information in the digital library? (slide the X marks
on the lines below)

hard to understand easy to understand

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 4 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

2. How do you find search feature in the digital library? (slide the X marks on the lines
below)

hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, intuitive, straight

unintuitive forward

boring interesting

ugly, unattractive attractive

useless useful, handy

3. Do you have any comments to this part of the evaluation?

Second Task

Question: What (credibility) dimension are used to evaluate the credibility of the
information on the Internet (used in the research)?
(PL: Jakie skale/kryteria uzywane sa do oceny wiarygodnosci informacji Internetowej
(wykorzystywane w badaniach)?)

Answer:

To evaluate credibility of the information on the Internet * believability * accuracy *

trustworthiness * bias * completeness. "The Yale group defined credibility in terms of
speaker's expertise (as web coprehesiveness of a Web information) and trustworthiness (as
web site's integrality)" but also dynamism, composure and sociability.

References:

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 5 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

http://dspace.digime.name/bitstream/123456789/543/4/href/credibility-factors36177.pdf
http://dspace.digime.name/handle/123456789/542
http://localhost:8080/jeromedl/resource/RKyRXPaE

Comment:

Evaluation Questionnaire after the Second Task

1. How did you find the task of finding information in the digital library? (slide the X marks
on the lines below)

hard to understand easy to understand

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

2. How do you find search feature in the digital library? (slide the X marks on the lines
below)

hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, intuitive, straight

unintuitive forward

boring interesting

ugly, unattractive attractive

useless useful, handy

3. Do you have any comments to this part of the evaluation?

No

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 6 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

Third Task

Question: Based on the results of the research, what is the credibility of the Internet and
information delivered by it, compared to the credibility of other media sources?
(PL: Jak oceniana jest, na podstawie wynikow badan, wiarygodnosc Internetu i informacji z
niego pochodzacych w porownaniu z wiarygodnoscia innych mediow?)

Answer:

"Students in this study reported that they perceived the Internet to be moderately to
somewhat credible (M=4.09, S.D.=0.82), although less credible than newspapers,
television, and magazines. Compared to the nonstudent sample the students found all
information channels to be more credible than did the nonstudents, as indicated by a
significant between-subjects (student status) effect in a repeated-measures ANOVA." <>

References:

http://dspace.digime.name/bitstream/123456789/542/4/href/flanagin-%20ksiazka%20-
%20wiarygodnosc236204.pdf
http://dspace.digime.name/bitstream/123456789/543/4/href/credibility-factors36177.pdf
http://dspace.digime.name/bitstream/123456789/565/4/href/student%20web%20use%2b%20credibility36157.pdf

Comment:

It was easy to find articles, but difficult to find sth in it. To less time to right good essay about
it.

Evaluation Questionnaire after the Third Task

1. How did you find the task of finding information in the digital library? (slide the X marks
on the lines below)

hard to understand easy to understand

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

2. How do you find search feature in the digital library? (slide the X marks on the lines
below)

hard to use easy to use

complex, mind boggling simple, clearly organized

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 7 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

hard to master, intuitive, straight

unintuitive forward

boring interesting

ugly, unattractive attractive

useless useful, handy

3. Do you have any comments to this part of the evaluation?

no

Post-Evaluation Questionnaire

1. What is your overall impression about the DL library you used? (slide the X marks on the
lines below)

hard to use easy to use

complex, mind boggling simple, clearly organized

hard to master, intuitive, straight

unintuitive forward

boring interesting

ugly, unattractive attractive

useless useful, handy

2. “I think, I would perform better if only ...” (complete the sentence)

there was better funcionality of finding more information inside

articles. It's easy to find sth connected to subject, but in most cases
it don't help in find an answer I needed.

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 8 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 25/01/2008 16:36

3. Would you like to continue using this digital library (DSpace)? (Say why)

Yes

No

I have a feeling that it will be easier to find an answer to that

questions in google. I mean that their search engine is more
"semantic" than Dspace. In this case I would prefer to get paper
article than read it on the screen to find my answer.

4. Do you have any comments to this part of the evaluation?

no

[Main Page]

http://localhost:8080/questionnaire/quest/complete?_u=niusianusia Page 9 of 9
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 02/03/2008 14:37

Semantic Digital Libraries Evaluation

Results of Anna Karpinska (DSpace)

Memory Task

Question: What (credibility) dimension are used to evaluate the credibility of the
information on the Internet (used in the research)?
(PL: Jakie skale/kryteria uzywane sa do oceny wiarygodnosci informacji Internetowej
(wykorzystywane w badaniach)?)
Answer:

I think there was 5 of them, but I'm not sure. I can't tell which

References:

Comment:

After this time it is very difficult to answer any question

Evaluation Questionnaire after the Memory Task

1. How did you find the task of recalling previously learned information? (slide the X marks
on the lines below)

hard to understand easy to understand

hard to execute easy to execute

hard to master, intuitive, straight

unintuitive forward

2. “I think, I would perform better if only ...” (complete the sentence)

There was more sematics in it. This time my search look like
google search and it was not enough time to give a good answer.

http://q.digime.name/quest/complete?ismemory=true&_u=niusianusia Page 1 of 2
Semantic Digital Libraries Evaluation - Results (Anna Karpinska/DSpace) 02/03/2008 14:37

3. Do you have any comments to this part of the evaluation?

[Main Page]

http://q.digime.name/quest/complete?ismemory=true&_u=niusianusia Page 2 of 2