Tutorial semantic wikis and applications

Tutorialon Semantic Wikis and ApplicationsMark GreavesVulcan Inc.markg@vulcan.comDaniel HanschOntoprise GmbHhansch@ontoprise.deDenny VrandecicKarlsruhe Institue of TechnologyDenny.vrandecic@kit.eduJesse WangVulcan Inc.jessew@vulcan.com

2OutlineTutorial Introduction and Structure (Mark)Introduction to Semantic MediaWiki (Denny)Dive into Semantic MediaWiki (Denny)Applications for Semantic Wikis (Mark)Extensions for Semantic MediaWiki (Denny, Daniel, Jesse)Connecting Semantic MediaWiki with MS Office (Jesse)Augmenting Semantic MediaWiki with a Triple Store (Daniel)Future Development (Denny, Daniel, Jesse)Wrap Up and Q&A (Mark)Break (30 mins)

Context: Social Web, Semantic Web, and Semantic Wikis4SoftwareAgentsExpert SystemsFreebaseSchema IntegrationFacebookOpenGraphLinked DataOntologiesSemanticWikisSemantic DesktopsEvriThesauriTwine/T2Prediction MarketsIncreasing Data InterconnectionPIMsNingDatabasesFaceBookSearchEnginesAmazon ReviewsContent PortalsWeb sitesWikipediaFile serversBlogsTwitterIncreasing Social InterconnectionBased on a diagram by Nova Spivak, Radar Networks

A Range of Semantic Wiki PlatformsKiWi – Knowledge in a WikiKnoodl – Semantic Collaboration tool and application platformFreebase - Collaborative platform for almanac data by MetawebOntoWikiPhpWikiSemantic MediaWiki - an extension toMediaWikithat turns it into a semantic wiki (and SMW extensions)TikiWiki - CMS/Groupware integrates Semantic links as a core featureWikidsmart - adds semantics to Confluence (from zAgile)55

Semantic MediaWikiDenny Vrandečić, KIT / ISI, USCJune 22 2010, San Francisco

Wikis are greatEnable new scale of human collaborationEveryone can readEveryone can writeEveryone gets aggregatedEveryone is accountable for everythingBut some things are better left to machines…8

editwow. I can change the web.let’s write an encycolpedia!

Wiki Clockhttp://pageoftext.com/wikiclock

Wikis are greatEnable new scale of human collaborationEveryone can readEveryone can writeEveryone gets aggregatedEveryone is accountable for everythingBut how are semantic wikis different?Semantic+ computerv12

editediteditCountryCityPopulation = 745,514Area = 39 km2capitalmayorediteditBirthdate =1 April 1946

editeditediteditediteditMay 27 1994, Tim Berners-Lee, Keynote at WWW1

What humans are good atWhat machines are good atUnderstanding“Why”Tacit knowledgeStoriesFollowing hunchesChecking external refsExecutingFacts and figuresExplicit knowledgeKeeping track and logsAnalyzing big styleCalling web services

Universal Access toAll Knowledge

19What Wikipedia knowsWikipedia has articles about…… all cities… their populations… their mayors So can I ask for a list of the world’s ten largest cities with a female mayor?

What humans seeKarlsruhe... has a population of 285,812... is located inGermany... was founded in 1715... has mayor Heinz Fenrich36

What computers seeKarlsruhe... 285,812... Germany... 1715... Heinz Fenrich38

Computers don‘t make connections39

KarlsruheKarlsruhe is a city in[[Germany]].[[Country::Germany]].GermanyCountryKarlsruheCountryGermanyKarlsruheMayorHeinz FenrichHeinz FenrichGenderMale41

{{#ask: [[Category:City]] [[located in:: Baden-Württermberg]] | format=barchart | ?population}}

External data reuseExport formatsRDF/XMLSPARQLRDFaCSVJSONiCalvCardBibtex44

External data reuseComputer understands wiki contentKnowledge based applicationsA number of export formatsRDF/XML, SPARQL, RDFa, CSV, JSON, iCal, vCard, Bibtex, ...RDF APIs in programming languagesJava, JavaScript, C/C++, Python, Ruby, Haskell, .Net, PHP, Common Lisp, Prolog, …Standards basedURIs, XML, RDF, OWL, SPARQL, …

importSemanticMediaWikias smwwiki = smw.SMW("http://semanticweb.org/")denny = wiki.load(“DennyVrandecic")printdenny.affiliation

Test wikiGo to http://scratchpat.referata.comClick on log in and then on “Create an account”Suggestion: use your name as your loginEnter your eMail (for forgotten passwords)

Editing the wikiGo to your own page (page with your name)Click on “edit”Try to add or change text You can cancel anytime, preview (just for you), or save the changes so that everyone can see them

Quick overview of wiki markup'''three apostrophes''' will make text bold''two apostrophes''' will make text italic[[Text in double square brackets]] will be links to the page named as the text in the brackets[[Link target|link text]] will display a link that looks like link textbut links to link targetThe wiki is case sensitve – but not on the first letter of a linkThe wiki is Unicode

Overview of semantic markupTo add a page P to category C type [[Category:C]] on page PTo make a typed link of type R from page P1 to page P2 type [[R::P2]] on page P1To state the value V of an attribute A on page P type [[A::V]] on page PExample:

Data values and typesAttributes like [[birthdate::February 27 1978]] or [[population::3,635,389]] must know the type of the valueThis is done by adding [[has type::T]] on the page of the attributeAvailable, predefined types:Telephone numberRecordURLEmailAnnotation URIGeographiccoordinate (S Maps)EnumerationCustomunitsPageStringNumberBooleanDateTextCodeTemperature

Add your own informationNow add information about yourselfFor example: nationality, affiliation, age, birthday, hair color, likes…Save or preview to see if and how the information has been understoodBlue links mean there is a page about itRed link means there is no page about it

Collaborative ontology engineeringThere are pages describing categories and propertiesInformal descriptionCan be discussedCan be editedExtensional descript.List of all instancesBut: only direct onesSupercategories

Social aspectsTask: come up with a vocabulary and the relation between the vocabularies for the whole group, using the wikiHow to decide which properties and categories are important?How to define the properties or categories?How to ensure high quality data? What does it mean?How to control the wiki knowledge base and its growth?Browse the wiki to see the results and connections

Querying the knowledgeGo to Special:AskEnter a queryQueries look like this:Conditions on a category: [[Category:X]]Conditions on a property: [[R::X]]Property conditions can be ranges, [[R::>X]], [[R::<X]]Property conditions: any value [[R::+]]Print statements: ?RExamples followSee also online docs

Query examples[[population::>1,000,000]] anything with a population of over a Million[[located in::Korea]] anything that is located in Korea[[affiliation::+]] anything that has any stated affiliation[[Category:Tutor]] all tutors[[Category:Tutor||Student]] all tutors or students (logical or)[[Category:Tutor]] [[Category:Student]] everyone who is both

Querying and social aspectsQuerying can only be done on aligned vocabulariesIf half of the people use “affiliation” and the other half “works for” you cannot query the knowledge easilyInside SMW, information integration usually happens with social tools, not with technologyGardening tools can help with aligning vocabularies, but not replace themTools that allow you to rename a property throughout the wikiOr to join two different names

Querying the wiki{{#ask: [[Category:City]] [[Mayor.Gender::Female]]| sort=Population}}

Querying the wiki{{#ask: [[Category:Country]] [[Continent::North America]]|?Population}}

Querying the wiki{{#ask: [[Category:Country]] [[Continent::North America]]|?Population|format=piechart}}

Querying the wiki{{#ask: [[Category:Country]] [[Continent::North America]]|?Population|format=barchart}}

HL7 Healthcare Terminology Management70

Football Indexing WikiNon-Wikipedia Look/Feel

Search on crowd-defined patterns (“touchdowns with big hits”)

Tree-based navigation widgetMetacafe Video Indexing and Tagging Wiki

SMW+ with Automatic Document Annotation75

Collaborative Proposal Management at BT with SMW+76Active Bid Viewer Service Desk Selector

Lightweight Project Management with SMW+77Automatically populate tables

Just the data you want, at the level you want

MS Office integrationShared Documentation in SMW+

Wiki-based Communities of Interest with SMW+79

Employee Skill Registries with SMW+80

Community Maintained Resource Portals82

Timelines in the LiDAR Portal83

Social Networks in the LiDAR Portal84

SMW+ Extended Example: An Analytic EncyclopediaUltrapedia: An SMW demo built to explore data and text in a wikiWikipedia merged with the power of a databaseData extracted from Wikipedia Infobox and Table data; stored in RDFFor Authors: tools to create more compelling articlesGreat visualizations: charts, tables, timelines, photos, analyticsAlways up-to-date across the EncyclopediaEncourage data consistency and find data errorsLink in other web data sourcesFor Readers: Enhanced articles and data interactionFaceted navigationSophisticated queries (both standing and ad-hoc)Maintenance via the Wikipedia update processData is from the article text, with simple ways for article authors to maintain and extend it.Authors and readers always in the loop for merging, updating, validating, mapping87

TitleDescriptionLanguagesFurther DownWeb LinksCategorizationDomain specificDataImagesInfoboxPropertiesSources of Structured Data in Ultrapedia

Ultrapedia Data from Wikipedia Tables89TableData

Ultrapedia: An Analytic EncyclopediaGoal: Prototype a small semantic encyclopediaCreate an semantic version of a part of WikipediaSoftware is SMW+, Ontobrokertriplestore, DBpediaShow what a data-aware encyclopedia might look likeUltrapedia Prototype DetailsTest domain is German cars~2500 Wikipedia pages, ~40000 triplesFeaturesSimilar look and feel to WikipediaDynamic tables and chartsPowerful queriesNavigation beyond searchEdit, discuss and rate dataSPARQL-based queriesDerived assertions (via OntoBroker)

Wikipedia for Porsches (Acceleration Data Example)Information Need: All Porsche models that accelerate 0-100kph in under 5, 6, and 7 secondsMore Porsche Acceleration Data in Wikipedia

Tree View ControlAbstract/Summary quick previewSemantics for Improved Wiki Navigation

The Porsche 996 Acceleration Table In Ultrapedia

Which Porsches accelerate fast?Dynamically-Generated Tables for QueriesInformation Need: All Porsche models that accelerate 0-100kph in under 5, 6, and 7 secondsGraph Views of the Acceleration Data

External Data via a Live Ebay Query

Mercedes-Benz E-class W212 Gallery SectionPhotos in Wiki Articles as Data

Volkswagen Production Timeline ViewTimelines from Data

105Wrap-Up Part 1: Managing Data in the 21st CenturyA New Kind of Knowledge ManagementStructured and unstructured data together in one toolBuilt with Semantic Web standards, and with web energyEmpower users with lightweight, web-friendly toolsData sharing from the start: not just another siloBuilt for collaboration on the webExample: Semantic MediaWikiand SMW+Open-source semantic wiki softwareWiki-style text/article authorship based on MediaWikiLightweight enterprise-scale data publishing Collaborative, user-governed structured and unstructured data curationA comfortable tool users to own their dataA variety of applications and uses

ExtensionsHaloS FormsS Result FormatsS LayersS TasksS CalendarMokiWikiExternal DataMaps and S MapsS DrilldownWoogleInnsbruck Ontology EditorP2P ExtensionRDFaExporterand others

Extension architectureBuilt firmly on top of MediaWikiCore SMW to be smallProvide extension hooks of its ownAllow apps on top of it

The suite of halo extensions for Semantic MediaWikiDaniel Hansch, „Semantic Wikis and Applications“ tutorial, semtech 2010hansch@ontoprise.de

AgendaWho is ontoprise?The halo extensionsVisionBenefitsHow to get it?

ontoprise: leader in semantic technologies and solutions +50 employees in Karlsruhe, Germany

software vendor (more about us on: http://www.ontoprise.com)

flagship product: rdf-store with reasoning capabilities (OntoBroker)

selected partnersBuilding the best Semantic Wiki in project halo[1]SMW+halo extensions1. http://wiki.ontoprise.com/wiki/index.php/Faq/project_halo

halo extensions - visionLeverage adoption of Semantic MediaWiki by domain experts in scientific and commercial environments by improving key product features.UsabilityRetrievalSecuritySemanticMediaWikiData processingData re-useandconsistencyAdministration

Improve usability Enable a non-tech savvy Wiki community to efficiently use Wiki- and semantic features with minimal training time.

Improve usability Ontology browser

Improve usability Ontology browserEnable a non-tech savvy Wiki community to efficiently use Wiki- and semantic features with minimal training time.

Improve usability Graphical query interface

Improve usability Graphical query interfaceOntology browserEnable a non-tech savvy Wiki community to efficiently use Wiki- and semantic features with minimal training time.

Improve usability Annotation mode

Improve usability Graphical query interfaceAnnotation modeOntology browserEnable a non-tech savvy Wiki community to efficiently use Wiki- and semantic features with minimal training time.

Improve usability WYSIWYG editor

Improve usability Graphical query interfaceAnnotation modeOntology browserWYSIWYG editorEnable a non-tech savvy Wiki community to efficiently use Wiki- and semantic features with minimal training time.

Get better search resultsAugmented search resultsPath searchSemantic tree viewSMW blends text and data; this requires augmenting classic retrievaland navigation features with semantic data.

Enforce security policies for text and data Protection of content and dataProtection of annotations and queriesUser group managementCommercial environments require integration with central directory services and fine grained access rights to semantic data and content.

Leverage data re-use and improve consistency 2. Select available webservicesImport legacy data and tab data from web services to embed the Wikiinto a team’s data-environment. Data inconsistencies are automatically detected to improve data quality.3. Embedding webservices in articles1. Attach webservices using GUI

Powerful data processing Enhanced data modelProfessional Wiki communities request the ability to formulate complexrelationships in the Wiki (e.g. rules), which are processed automatically.Form based rule editor

Reduced administration overheadReduce the efforts for checking for compatible upgrades to a SMW installation and for downloading and installing new extensions.

Where to get it?Get a copy: http://sourceforge.net/projects/halo-extension/User forum: http://smwforum.ontoprise.comIt‘s all for free and GPL!**) Except OntoBroker and Triple store connector which are ontoprise licenses.

too complicated?then get all these features within 5 minutes: Product home page: http://wiki.ontoprise.com

Semantic FormsUtilizing the semanticsFacilitating data input

Benefits of Semantic FormsTo make MediaWiki templatesbetter to useTo provide a form-like User Interfaces for inexperienced users to input dataTo associate forms with a categoryHave a helper form to help wiki admins or advanced userscreate forms Variations to provide further usability enhancements

Image: Form with a (simple) stylehttp://www.thethirdturn.com/w/index.php?title=Form:Driver&action=edit

Image: Form with auto-completionAdvanced Auto-Completion on Customized Query ResultsBasic Auto-Completion on Static Permitted Values

Remember Special Properties?“Has type” is a special propertya pre-defined property for meta-dataExample: [[Has type::Type:Date]]“Allows value” is another special propertyTo specify the permitted values for the propertyExample: [[Allows value::Low]][[Allows value::Medium]][[Allows value::High]]

Form Field Input TypesString, Page, Number – text entry Text – TextArea Boolean – checkbox Date – date input or Javascriptdatepicker “Enumeration” (Page or String with “allowed values”) - DropDown list or RadioButtonList of "Enumerations" - ListBoxor CheckBoxes

More On Auto-CompletionBasic auto-completion is on “Allowed values”Current standard is on either category or propertyAdvanced auto-completion is based on queries{{{field|story|autocomplete on query=[[Category:Project stories]][[Project sprint::<q>[[Sprint start date::<{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]][[Sprint end date::>{{CURRENTYEAR}}/{{CURRENTMONTH}}/{{CURRENTDAY}}]]</q>]]}}}

Helper Form : Create a Template

Special Pages:Special:CreateForm - lets a user create a new form for adding/editing data. (See example of page)Special:CreateTemplate - lets a user create a new template. (See example of page)Special:CreateProperty - lets a user create a new property. (See example of page)Special:CreateCategory - lets a user create a new category. (See example of page)Special:CreateClass - a page that creates all the elements for a single "class" at the same time - properties, template, form and category (See example of page). Access to this page is dictated by the 'createclass' MediaWiki permission; by default, it is available to all logged-in users.Special:FormEdit - lets a user either create or edit a page using a user-defined form. (See example of page.) (This page was, until version 1.9, two separate pages: "Special:AddData" and "Special:EditData".)Special:FormStart - used to route a user to either 'FormEdit' or the relevant page's "edit with form" tab. This page should not be accessed directly by users. (This page was known until version 1.9 as "Special:AddPage".)Special:Forms - lists all form pages on the site. (See example of page)Special:RunQuery - lets a user run a query, using a form (See example of page)Special:Templates - lists all templates on the site. (See example of page)Special:UploadWindow - lets a user upload a file; very similar to the standard Special:Upload page, but without the skin. This page is called from within a form, and should not be accessed directly by users.

More InfoOn MediaWiki.org http://www.mediawiki.org/wiki/Extension:Semantic_FormsSMW User Forum (ontoprise GmbH) http://smwforum.ontoprise.com/smwforum/index.php?title=Help:Creating_Semantic_Forms&context=Help%3ASMW%2B+1.5.0

SMW:: powerful tools and contentsSemantic MediaWiki and related extensions have more potential power

Need Release ::The (more) PowerBe used by morepeopleContent in moreplacesAccessible via moreapplicationsEnhanced with moresemanticsThe more usersThe better

Need ::Workflow Integration + Usability EnhancementsInfrequentWiki users frequentlyforget where the wiki pages are locatedSearch is a break from current workflow Search result can be noisyorirrelevantUsability: Wiki/Template/SF markup syntax is not extremely hard, but enough to turn off many usersTo locate and consume info in SMW is just not easy enough, need something betterWhy don’t we leverage Microsoft Office suite?

Microsoft Office ::The Most Popular Productivity Suite

WikiTags:: How It WorksLeverage Microsoft SmartTags technologyBring SMW info to Office applications on-demandAPI for semantic data I/OUtilize semantics to improve relevanceSmart actions for semantic propertiesSmartTagAdd-insAPIAPIConnectionsSmarts

Some Semantic WikisBefore the demo, let’s look atFor more info, go to http://wiking.vulcan.com/dev/

Wiki:: Semantic Sci-Fi MovieFamiliar content just like another wikiSemantic markups shown in fact box

Wiki:: NGT - Proposal Handling

Wiki :: Agile Project ManagementProject Wiki for Milestones, User Stories, Developer Tasks, etc.

Page is form- based, with queries and semantics built-inLive actionsNow see the demoFor more info, go to http://wiking.vulcan.com/dev/

Backstage::WikiTags ExtensionWiki ValidationAuthenticationTo get the categoriesAnd descriptionsTo get the article titlesTo get the semantic propertiesTo get page infoGet all available formsSave page as a formSave page with datasetSet form of a pageCreate form templatesTo upload into the Wikihttp://wiking.vulcan.com/dev/index.php/SMW_Webservice_APIs

Extension to facilitate semantic data exchangeWeb UI to make semantic schema mapping for semantic wiki templates and formsWeb service APIs to do the samehttp://wiking.vulcan.com/dev/index.php/SemanticConnector_extensionBackstage::Semantic Connector

Special:ApiTest :: Results in JSON

Recap of demoWhat to take away from the demoFor more info, go to http://wiking.vulcan.com/wikitags/

Semantic Info::Across Office AppsDynamic Query Results from the article pageOutlookMultiple Wiki Sites supportedExcelVia SmartTagsWikiTags recognizes smartly the keywords or phrases relevant to you

Semantic Info::In Real-timeExplore related real-time semantic info across the links in articleSee articles in categories live

WikiTags::Semantic ActionsSemantic actions are based on semantic services of properties

Wiki Forms::In Microsoft OfficeView Semantic Content in familiar formsContribute into Wiki articles back

Screenshots::WikiMailUpload Emails into Wiki

Automatic upload by folder mapping

Use recipients, folders and textShortcut to create wiki articlesCustomize CategoriesConflict Resolution

Screenshot::Email in WikiAttachments automatically uploaded too

Screenshots::SettingsOption to choose categories of interestand more

WikiTags::Smart ConnectionsConsume relevant, targeted information

With the tools you are already familiar with

In the context – better relevance and productivity

Only when you need it – no information overload

In place – no search overhead to break workflow

In real time – data from wiki is live

Without knowing where the content is

Without learning wiki/template syntax170OutlineTutorial Introduction and Structure (Mark)Introduction to Semantic MediaWiki (Denny)Dive into Semantic MediaWiki (Denny)Applications for Semantic Wikis (Mark)Extensions for Semantic MediaWiki (Denny, Daniel, Jesse)Connecting Semantic MediaWiki with MS Office (Jesse)Augmenting Semantic MediaWiki with a Triple Store (Daniel)Future Development (Denny, Daniel, Jesse)Wrap Up and Q&A (Mark)Break (30 mins)

Making SMW smarter - AgendaRDF and Semantic MediaWiki (SMW)Current limitations of SMWWhat is a triple store?What is the Triple Store Connector?ExamplesDerived propertiesSemantic data integration (demo!)Where to get it?Wrap up

RDF and Semantic MediaWikiRDF (Resource Description Framework) is the underlying data model of the Semantic Web and essentially also for SMW.RDF is a graph-base datamodel, i.e. all data is represented in the form or nodes that are connected via directed, labeled arcs. Two nodes connected by a arc should be interpreted as a subject-predicate-object statement (triple).Examples of three triples.SMW stores such triples in the underlying relational database

Current limitations of SMWSMW is a great semantic Web application, in the sweet spot between feature richness and engineering complexity.Limitations:Triple stores overcome these limitations.

What is a triple store?A triple store is a dedicated database for storing and retrieving RDF data.Features:Ontoprise’s “Triple store connector" creates a bridge between SMW and a triple store.

What is the Triple Store Connector?Triple Store ConnectorSemantic MediaWikihalo ExtensionTriple StoreThe Triple Store Connector[1] is a ready-to-use product from ontoprise which is installed along with SMW and attaches it to Jena[2] or OntoBroker[3].[1] http://smwforum.ontoprise.com/smwforum/index.php/Triple_store_connector[2] Open source triple store with reasoning capabilities, http://www.openjena.org/[3] Highly scalable semantic Web middleware, http://www.ontoprise.de/en/home/products/ontobroker/

ExamplesDerived properties We formulate a rule in the Wiki to derive a property value from other properties (e.g. calculation). Advantage: reduced amount of annotations, improved data consistency and enriched knowledge.Semantic data integration An enterprise integrates sources of legacy data into one single source and publishes this data in the Wiki. Advantage: data from rigid legacy systems is available for highly collaborative and flexible workflows.

First example – derived propertiesWe have a Wiki which is used for generating bids; the project team wants to calculate the estimated costs of each task from the estimated work efforts which are given in person days.Want to try out this example by yourself?Go to our online demo installation and create an account:http://smwdemo.ontoprise.com

Formulating the calculation rule

Tutorial semantic wikis and applications

More Related Content

Similar to Tutorial semantic wikis and applications

Recently uploaded

Tutorial semantic wikis and applications

Editor's Notes