Publishing Linked Data from RDB
2 likes1,062 views
This document discusses publishing Linked Data from relational databases (RDBs). It covers specifying ontologies and URI design, modeling data using vocabularies like FOAF and BIBO, transforming RDB data to RDF using R2O and ODEMapster, linking the generated RDF data to external datasets, and publishing the data in a Virtuoso endpoint to enable discovery through search engines and metadata through VOiD and CKAN.
![Linking KOS Data [using SKOS and OWL2]](https://cdn.slidesharecdn.com/ss_thumbnails/zenglinkedkosdata-100623180741-phpapp02-thumbnail.jpg?width=560&fit=bounds)
Ad
More Related Content
What's hot (18)
Viewers also liked (20)
Ad
Similar to Publishing Linked Data from RDB (20)
Ad
More from Boris Villazón-Terrazas (20)
Recently uploaded (20)
Publishing Linked Data from RDB
- 1. Publishing Linked Data from RDB Boris Villazón-Terrazas. Oscar Corcho Facultad de Informática Universidad Politécnica de Madrid Informática, Campus de Montegancedo sn, 28660 Boadilla del Monte, Madrid http://www.oeg-upm.net [email protected] Phone: 34.91.3366605, Fax: 34 91 3524819 Ph 34 91 3366605 F 34.91.3524819 Slides available at: http://www.slideshare.net/boricles/ Acknowledgements: Freddy Priyatna, Jan Schulte, Richard Cyganiak and many others that we may have omitted. WorkdistributedunderthelicenseCreativeCommonsAttribution- Noncommercial-Share Alike 3.0
- 2. 2
- 3. Specification – RDB about Research Groups 3
- 4. Specification - URI design • Base URI • http://research.ull.es • TBOX URI • http://research.ull.es/ontology/{class|property} • ABOX URI • http://research.ull.es/resource/{resourceType}/{resource} 4
- 5. 5
- 6. Modelling Linked Open Vocabularies http://labs.mondeca.com/dataset/lov/ FOAF Friend of a Friend vocabulary BIBO The Bibliographic O t l Th Bibli hi Ontology GEOP FAO Geopolitical Ontology 6
- 7. Modelling – NeOn Toolkit http://neon-toolkit.org/ New Project New Ontology 7
- 8. Modelling – Creating some elements Classes Object Properties Obj t P ti Datatype Properties 8
- 9. 9
- 10. Transformation – RDB2RDF • A majority of dynamic Web content is backed by relational databases (RDB), and so are many enterprise systems. • W3C RDB2RDF Working Group 1 • R2RML: RDB to RDF Mapping Language - http://www.w3.org/TR/r2rml/ • Direct Mapping - http://www.w3.org/TR/rdb-direct-mapping/ • R2RML and Direct Mapping Test Cases - http://www.w3.org/2001/sw/rdb2rdf/test-cases/ R2RML/Direct Mapping in process to be a W3C Recommendation 1 http://www.w3.org/TR/r2rml/ 10
- 11. Transformation – R2O & ODEMapster • R2O is an e te s b e, fully dec a at e language to desc be s a extensible, u y declarative a guage describe mappings between relational database schemas and ontologies. • The ODEMapster processor generates RDF instances from relational instances based on the mapping description pp g p expressed in the R2O document www.oeg-upm.net/index.php/en/downloads/9-r2o-odempaster 11
- 12. Generation – Transformation - ODEMapster ODEMapster Research RDB • Included in the NTK – currently under revision 12
- 14. New R2O Mapping – DB connection information 14
- 15. ODEMapster – DB Connections 15
- 17. ODEMapster – Creating Mappings 17
- 18. ODEMapster – Creating Mappings 18
- 19. ODEMapster2 – command line version • Odemapster2 folder • research.r2o.properties 19
- 20. Main sections of an R2O Mapping 20
- 21. ODEMapster2 – command line version • research.r2o.xml conceptmap def conceptmap-def uri-as attributemap-def dbrelationmap-def 21
- 22. ODEMapster2 – command line version • research.bat 22
- 23. ODEMapster2 • File generated 23
- 24. Linking - Identify suitable data sets as linking targets http://ckan.net http://ckan net Semantic Web Dog Food Corpus http://data.semanticweb.org/ Endpoint http://data.semanticweb.org/snorql/ 24
- 25. Linking – Silk framework • http://www4.wiwiss.fu-berlin.de/bizer/silk/ • Copy workbench.war to the webapps directory (tomcat directory) • Silk Workbench 25
- 28. Silk framework • First source 28
- 29. Silk framework • Second source 29
- 30. Silk framework • Add a task 30
- 31. Silk framework • Add output 31
- 32. Silk framework • Edit Linking task 32
- 33. Silk framework • Edit researchlinks 33
- 34. Silk framework • Generate links 34
- 35. Silk framework • Validate links 35
- 36. Silk framework • Export 36
- 37. 37
- 38. Publication - Virtuoso Open-source edition • http://sourceforge.net/projects/virtuoso/files/virtuoso/6.1.4/virtuoso-opensource-win32- 20111101.zip/download • Unzip to C:software • ODBC Registration: • Set up VIRTUOSO_HOME variable pointing out to virtuoso-opensource directory: • cd %VIRTUOSO HOME%lib %VIRTUOSO_HOME%lib • regsvr32 virtodbc.dll • Creating a Windows Service • cd %VIRTUOSO_HOME%database • SET PATH=%PATH%;%VIRTUOSO_HOME%bin;%VIRTUOSO_HOME%lib • virtuoso-t -? //to verify • virtuoso-t +service screate +instance "Instance Name" +configfile virtuoso.ini • virtuoso-t +service list //to verify • virtuoso-t I Instance Name virtuoso t -I "Instance Name" +service start //start the service 38
- 39. Virtuoso - Conductor • http://localhost:8890/conductor 39
- 40. Virtuoso - Conductor • Upload the generated files • Ontology: http://research.ull.es/graph/ontology - research.owl • Dataset: http://research.ull.es/graph/dataset - research.rdf • Li k http://research.ull.es/graph/links - output.nt Links: h // h ll / h/li k 40
- 42. Virtuoso endpoint • Now you can play a bit with SPARQL … ;) 42
- 43. Metadata publication – VOiD • VOiD description • void.ttl 43
- 44. Metadata Publication – CKAN.net / thedatahub.org 44
- 45. Enable effective discovery • Sindice: the best RDF search engine 45
- 46. Enable effective discovery • Sitemap Protocol • Used by web crawlers • Efficiently find all your content & discover what has been updated http://sitemaps.org/ htt // it / A sitemap file contains information regarding one or more URLs on your Web site. The information that is stored there helps search engines better spider your website. A sitemap file contains information regarding one or more URLs on your Web site. The information that is stored there helps search engines better spider your website. 46
- 47. Sitemap.xml example <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>http://yoursite/</loc> </url> <url> <loc>http://yoursite/products/53546</loc> </url> <url> <loc>http://yoursite/products/98421</loc> </url> <url> <loc>http://yoursite/products/41003</loc> <lastmod>2010-06-24</lastmod> <changefreq>daily</changefreq> Optional parts </url> </urlset> 47
- 48. Sitemap Protocol: Huge sitemaps • Gzip-compress your sitemap • Limit: 50k URLs or 10MB • split into multiple sitemap files • add a sitemap i d fil dd it index file 48
- 49. Sitemap Protocol: Discovery • Publish the sitemap file • Add a line to http://yoursite/robots.txt • Web site owners use the /robots.txt file to give instructions about their site g to web robots; this is called The Robots Exclusion Protocol. Sitemap: http://yoursite/sitemap.xml 49
- 50. sitemap4rdf • Simple command line tool • Sends a SPARQL query to list all URIs • Generates sitemap sitemap4rdf http://yoursite/sparql http://yoursite/resource/ Example: sitemap4rdf http://geo.linkeddata.es/sparql http://geo.linkeddata.es/ sitemap4rdf http://localhost:8890/sparql http://research.ull.es/ • run sitemap4rdf specifying the SPARQL endpoint and the prefix of the URLs to include in the Sitemap 50
- 51. Submit the sitemap location - Sindice • http://sindice.com/main/submit 51
- 52. Submit the sitemap location - Google • https://www.google.com/webmasters/tools/ 52
- 53. 53
- 55. Publishing Linked Data from RDB Boris Villazón-Terrazas, Oscar Corcho Facultad de Informática Universidad Politécnica de Madrid Informática, Campus de Montegancedo sn, 28660 Boadilla del Monte, Madrid http://www.oeg-upm.net [email protected] Phone: 34.91.3366605, Fax: 34 91 3524819 Ph 34 91 3366605 F 34.91.3524819 Slides available at: http://www.slideshare.net/boricles/ Acknowledgements: Freddy Priyatna, Jan Schulte, Richard Cyganiak and many others that we may have omitted WorkdistributedunderthelicenseCreativeCommonsAttribution- Noncommercial-Share Alike 3.0