Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study

Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study

• 1.
  School of something FACULTYOF OTHER D Thakker et al, Assisting User Browsing over Linked Data 1 School of Computing FACULTY OF ENGINEERING Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study Dhavalkumar Thakker, Vania Dimitrova, Lydia Lau, Fan Yang-Turner, Dimoklis Despotakis
• 2.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 2 Semantic-enriched intelligent support to make sense of user generated content Linked dataOntologies Content Data User model Semantic Linking Semantic tagging EnrichmentUser model update Semantic querying Reasoning Nudging engineViewpoints engineDialogue planner comparing reflecting connecting selectingorganising Interface dialogue search browse explorevisualise Sensemaking Support Framework
• 3.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 3 Interactive exploration of linked semantic data Pinta: Semantic Data Browser Shell Ontologies Content Data User model Semantic Linking Semantic tagging EnrichmentUser model update Semantic Querying Reasoning Nudging engineViewpoints engineDialogue planner comparing reflecting connecting selectingorganising Interface dialogue search browse explorevisualise Linked data
• 4.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 4 Multimedia ………Textual Description of the entity ……….. FOCUS ENTITY Facet 1 Facts about ‘focus entity’ <‘focus entity’, predicate, object> . . . . Facet 2 Terms related to ‘focus entity’ <subject, predicate, ‘focus entity’ > . . . . Facet 3 Content related to ‘focus entity’ <content entry annotated with ‘focus entity’> . . . . Layout of Pinta: Uni-focal exploration
• 5.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 5 Examine exploratory search interaction MusicPinta DBPedia Music ontology Data User model Semantic Linking Gate & OWLIM EnrichmentUser model update Sesame SPARQL Reasoning Nudging engineViewpoints engineDialogue planner comparing reflecting connecting selectingorganising Interface dialogue search browse explorevisualise DBTune MusicBrainz
• 6.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 6 Text & Multimedia Facts MusicPinta: I Focus Entity
• 7.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 7 Related Terms Content with Semantic Tags MusicPinta: II
• 8.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 8 User Study with MusicPinta Q1: How well can users without domain knowledge perform exploratory search tasks using MusicPinta, and what is the benefit/drawback of its features? Q2: Does browsing with MusicPinta support learning (which is traditionally associated with exploratory search), and does semantics play a role in this? Q3: What further improvements have to be addressed to make MusicPinta (and semantic data browsers in general) suitable for exploratory search tasks? 12 users, voluntary participation, within subjects design Pre-test Profile Schema association 5 min Training Explore tenor saxophone 10 min Task 1 Characteristics of an instrument NASA-TLX 15+5 min Task 2 Usage of an instrument NASA-TLX 15+5 min Post-test Schema association Usability 10 min Feed back Subjective perception 5 min
• 9.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 9 Task 1: Compare & Differentiate The music shop is extending its collection of instruments with international musical instruments. You work in an advertising agency which has been asked to prepare an advertisement script for some of the new instruments that will appear in the shop. A key part of the preparation of the advertisement script is the research of the product. You have been asked to conduct a research of one of the new instruments, called bouzouki, using the information available in MusicPinta. You have to identify: •the main characteristics of bouzouki; •up to five similar instruments to bouzouki; •features that make bouzouki distinctive from the similar ones you have chosen. Go to ‘Semantic Search’ in MusicPinta and type bouzouki. Browse the content and follow links. Complete the provided form.
• 10.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 10 Task 1: Compare & Differentiate
• 11.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 11 Task 2: Select & Summarise The music shop wants to increase the sales of its traditional musical instruments, such as electrical guitars. It intends to do this by adding links to creative commons album recordings with electric guitars, together with some interesting information about these albums to inspire customers to play/buy electric guitars or other musical instruments. Furthermore, when displaying its electric guitar items, the shop wants to highlight key features people look for when purchasing electric guitars. You are asked is to conduct the research to address the above requirements by using information provided in MusicPinta. You have to review the information about electric guitar and identify: •three interesting album recordings that include electric guitars and specify what is interesting; •key features that people look for when purchasing an electric guitar. Go to ‘Semantic Search’ in MusicPinta and type electric guitar. Browse the content and follow links. Complete the provided form.
• 12.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 12 Task 2: Select & Summarise
• 13.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 13 Task Performance and Difficulty Task 1 - 70% vs Task 2 - 48% Task 2 significantly poorer performance significantly more frustrating Task 2 used less ontology entities and required mainly content exploration
• 14.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 14 Learning Effect Users acquired new facts about focus and context entities Significantly more facts related to Task 1 than to Task 2 Positive correlation between the number of new facts added in the word association test and the number of clicks on classification level links
• 15.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 15 Observations Observations about user behaviour Requirements for nudging engine
• 16.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 16 Conclusions Semantics enables seamless exploration of heterogeneous content Semantic facets facilitate explorative search tasks Semantics empowers serendipitous learning Semantics nudges can be provided to improve task success and user experiences Measures of ‘value’ and ‘newness’ are needed considering both ontology and content Context should be considered
• 17.
  D. Thakker etal. Assisting User Browsing over Linked Data: Requirements Elicitation with a User Study (ICWE 2013) 17 School of Computing FACULTY OF ENGINEERING Thank You Dr. Dhavalkumar Thakker (Dhaval) Research Fellow, University of Leeds, UK Do you research semantic data exploration ? Checkout & take part in Intelligent Exploration of Semantic Data(IESD) workshop series @ http://imash.leeds.ac.uk/event/iesd.html