Working with data.open.ac.uk, the Linked Data Platform of the Open University
Download as PPTX, PDF6 likes3,105 views
Presentation of the Linked Data work realised at the Open University to the IT developer's forum - 10/05/2011
![SPARQLThe “SQL” of RDF and linked dataFits the graph data model of RDFSelect [variables: ?x ?name, etc.]From [graph, or all graphs if nothing]Where [triple patterns and filters]Order by, limit, offset, etc.SPARQL protocol: simply based on HTTPA SPARQL endpoint is a URL that takes a “query” parameterAnd return results in the SPARQL xml formatSee http://data.open.ac.uk](https://image.slidesharecdn.com/lucero-it-dev-forum-110513021443-phpapp01/85/Working-with-data-open-ac-uk-the-Linked-Data-Platform-of-the-Open-University-14-320.jpg)
![Example: Accessing data.open.ac.uk with PHP/Arc2include_once("arc2/ARC2.php");// declare the SPARQL endpoint$config = array('remote_store_endpoint' => 'http://data.open.ac.uk/query’,);$store = ARC2::getRemoteStore($config);// Execute a SPARQL query$postcodesq = 'select distinct ?p where {[] <http://data.ordnancesurvey.co.uk/ontology/postcode/postcode> ?p.}’;$rows = $store->query($postcodesq, 'rows');// Display the resultsforeach($rows as $row) { echo $row[‘p’].”</br/>”;}](https://image.slidesharecdn.com/lucero-it-dev-forum-110513021443-phpapp01/85/Working-with-data-open-ac-uk-the-Linked-Data-Platform-of-the-Open-University-31-320.jpg)
More Related Content
What's hot (20)
Similar to Working with data.open.ac.uk, the Linked Data Platform of the Open University (20)
More from Mathieu d'Aquin (20)
Recently uploaded (20)
Working with data.open.ac.uk, the Linked Data Platform of the Open University
- 1. Working with data.open.ac.uk, the linked data platform of the OUMathieu d’Aquin and the LUCERO team @mdaquinKnowledge Media Institute, the Open UniversityLUCERO project lucero-project.info – data.open.ac.uk
- 2. Linked DataAs set of principles and technologies for a Web of DataPutting the “raw” data online in a standard, web enabled representation (RDF)Make the data Web addressable (URIs)Link with other data
- 3. Graph (up to date)
- 4. So Linked Data for the OU?RAEDBPediaData from Research OutputsOpenLearnContentOROExposed as linked data, our data interlink with each other and the external world: become part of the “global data space” on the WebArchive of Course MaterialLibrary’sCatalogueOf Digital Contentgeonamesdata.gov.ukCurrently: OU public data sit in different systems – hard to discover, obtain, integrate by users.A/V MaterialPodcastsiTunesUBBCDBLP
- 5. Why is it important?The OU has been the first University to expose its data as linked data: http://data.open.ac.ukNow widely recognized as a critical step forward for the HE sector in the UK (and worldwide)Favor transparency and reuse of data, both externally and internallyReduces cost of dealing with our own public data: integration and reuse by designEnable both new kinds of applications, and to make the ones that are already feasible more cost effectiveAt least 3 other UK universities have now followed our example: http://data.online.lincoln.ac.uk/, http://data.ox.ac.uk/, http://data.southampton.ac.uk/And others in other countries are setting up similar initiatives
- 6. “if you are working in an IT department within a University you better read this report, as soon your department will need to be making these same decisions.” David Flanders, JISCExpoProgramme Manager,http://code.google.com/p/jiscexpo/wiki/luceroproject#Site_Visit_Report
- 7. The data.open.ac.uk StackApplicationsInstitutional repository dataResearch Data (Arts)Organizational infrastructureTechnical infrastructure
- 9. Technological principle: Everything has a URIExample:http://data.open.ac.uk/course/m366 – the course M366http://data.open.ac.uk/oro/21166 – an article in OROhttp://data.open.ac.uk/page/person/ext-911ee9dfa3db572830b00bd8a9983e39 – an Person, who authored the article abovehttp://xmlns.com/foaf/0.1/Person – the type personhttp://purl.org/dc/terms/creator – the property that links an author to an article
- 10. Technological principle: Content negotiationAccept: text/html Accept: application/rdf+xml<?xml version="1.0" encoding="UTF-8"?><rdf:RDFxmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"><rdf:Descriptionrdf:about="http://data.open.ac.uk/oro/9719"> <label xmlns="http://www.w3.org/2000/01/rdf-schema#" rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Aptamers directed to MUC1</label> <authorListxmlns="http://purl.org/ontology/bibo/" rdf:resource="http://data.open.ac.uk/oro/9719#authors"/> <title xmlns="http://purl.org/dc/terms/" rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Aptamers directed to MUC1</title> <abstract xmlns="http://purl.org/ontology/bibo/" rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Aptamers against the glycosylated form of MUC1 are described, along with their use in treatment and diagnosis of conditions associated with elevated production of MUC1.</abstract> <isPartOfxmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/oro/repository"/> <status xmlns="http://purl.org/ontology/bibo/" rdf:resource="http://purl.org/ontology/bibo/status/peerReviewed"/> <status xmlns="http://purl.org/ontology/bibo/" rdf:resource="http://purl.org/ontology/bibo/status/published"/> <creator xmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/person/ext-07bcb3718cb0de7883dc7b8fde7e283d"/> <creator xmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/person/b7fc322e6386517c5ebef3c09d13bd9e"/> <creator xmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/person/ext-7c8b5252e28115f91640559c2fe64ca3"/> <date xmlns="http://purl.org/dc/terms/">2007-11-15</date> <rdf:typerdf:resource="http://purl.org/ontology/bibo/Article"/> <rdf:typerdf:resource="http://purl.org/ontology/bibo/Patent"/></rdf:Description></rdf:RDF>
- 11. RDF<?xml version="1.0" encoding="UTF-8"?><rdf:RDFxmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"><rdf:Descriptionrdf:about="http://data.open.ac.uk/oro/9719"> <label xmlns="http://www.w3.org/2000/01/rdf-schema#" rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Aptamers directed to MUC1</label> <authorListxmlns="http://purl.org/ontology/bibo/" rdf:resource="http://data.open.ac.uk/oro/9719#authors"/> <title xmlns="http://purl.org/dc/terms/" rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Aptamers directed to MUC1</title> <abstract xmlns="http://purl.org/ontology/bibo/" rdf:datatype="http://www.w3.org/2001/XMLSchema#string">Aptamers against the glycosylated form of MUC1 are described, along with their use in treatment and diagnosis of conditions associated with elevated production of MUC1.</abstract> <isPartOfxmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/oro/repository"/> <status xmlns="http://purl.org/ontology/bibo/" rdf:resource="http://purl.org/ontology/bibo/status/peerReviewed"/> <status xmlns="http://purl.org/ontology/bibo/" rdf:resource="http://purl.org/ontology/bibo/status/published"/> <creator xmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/person/ext-07bcb3718cb0de7883dc7b8fde7e283d"/> <creator xmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/person/b7fc322e6386517c5ebef3c09d13bd9e"/> <creator xmlns="http://purl.org/dc/terms/" rdf:resource="http://data.open.ac.uk/person/ext-7c8b5252e28115f91640559c2fe64ca3"/> <date xmlns="http://purl.org/dc/terms/">2007-11-15</date> <rdf:typerdf:resource="http://purl.org/ontology/bibo/Article"/> <rdf:typerdf:resource="http://purl.org/ontology/bibo/Patent"/></rdf:Description></rdf:RDF>
- 12. By the way…On Study at the OU:http://data.open.ac.uk/course/m366 – if HTML requested, goes to http://www3.open.ac.uk/study/undergraduate/course/m366.htmTry http://www3.open.ac.uk/study/undergraduate/course/m366.rdf
- 13. Technological principle: link… also to external datasetsUsing URIs makes pieces of data directly addressable and linkable on the Web, independently of where the data is:http://data.open.ac.uk/course/m366 isAvailableInhttp://sws.geonames.org/458258/ (Republic of Latvia)http://data.open.ac.uk/organization/the_open_universitysameAshttp://education.data.gov.uk/doc/school/133849http://data.open.ac.uk/location/building/mbbn (Berrill Building North) postcode http://data.ordnancesurvey.co.uk/id/postcodeunit/MK76AAAnd others can link to our data…
- 14. SPARQLThe “SQL” of RDF and linked dataFits the graph data model of RDFSelect [variables: ?x ?name, etc.]From [graph, or all graphs if nothing]Where [triple patterns and filters]Order by, limit, offset, etc.SPARQL protocol: simply based on HTTPA SPARQL endpoint is a URL that takes a “query” parameterAnd return results in the SPARQL xml formatSee http://data.open.ac.uk
- 15. SPARQL: example queriesCourses available in Nigeriaselect distinct ?coursewhere {?course<http://data.open.ac.uk/saou/ontology#isAvailableIn> <http://sws.geonames.org/2328926/>. ?course a <http://purl.org/vocab/aiiso/schema#Module>}http://data.open.ac.uk/query?query=select%20distinct%20%3Fcourse%20where%20{%3Fcourse%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fsaou%2Fontology%23isAvailableIn%3E%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fsws.geonames.org%2F2328926%2F%3E.%20%3Fcourse%20a%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fpurl.org%2Fvocab%2Faiiso%2Fschema%23Module%3E}
- 16. SPARQL: example queriesCourses available in Nigeriaselect distinct ?coursewhere {?course<http://data.open.ac.uk/saou/ontology#isAvailableIn> <http://sws.geonames.org/2328926/>. ?course a <http://purl.org/vocab/aiiso/schema#Module>}http://data.open.ac.uk/query?query=select%20distinct%20%3Fcourse%20where%20{%3Fcourse%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fsaou%2Fontology%23isAvailableIn%3E%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fsws.geonames.org%2F2328926%2F%3E.%20%3Fcourse%20a%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fpurl.org%2Fvocab%2Faiiso%2Fschema%23Module%3E}
- 17. SPARQL: example queriesVideo podcasts related to postgraduate courses in computingselect ?x ?t where {?c <http://purl.org/dc/terms/subject> <http://data.open.ac.uk/topic/computing>. ?c <http://data.open.ac.uk/saou/ontology#courseLevel> <http://data.open.ac.uk/saou/ontology#postgraduate>.?x <http://data.open.ac.uk/podcast/ontology/relatesToCourse> ?c.?x <http://purl.org/dc/terms/title> ?t.?x <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://data.open.ac.uk/podcast/ontology/VideoPodcast>}http://data.open.ac.uk/query?query=select%20%3Fx%20%3Ft%0Awhere%20{%0A%20%20%20%3Fc%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fpurl.org%2Fdc%2Fterms%2Fsubject%3E%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Ftopic%2Fcomputing%3E.%0A%20%20%20%3Fc%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fsaou%2Fontology%23courseLevel%3E%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fsaou%2Fontology%23postgraduate%3E.%0A%20%20%20%3Fx%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fpodcast%2Fontology%2FrelatesToCourse%3E%20%3Fc.%0A%20%20%20%3Fx%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fpurl.org%2Fdc%2Fterms%2Ftitle%3E%20%3Ft.%0A%20%20%20%3Fx%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23type%3E%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fpodcast%2Fontology%2FVideoPodcast%3E%0A}&limit=0
- 18. SPARQL: example queriesThings related to “earthquake”select ?c ?desc where {?c <http://purl.org/dc/terms/description> ?desc .{ {?c <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://data.open.ac.uk/openlearn/ontology/OpenLearnUnit>}UNION{?c <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://data.open.ac.uk/podcast/ontology/VideoPodcast>} }FILTER regex(str(?desc), "earthquake", "i" )}http://data.open.ac.uk/query?query=select%20%3Fc%20%3Fdesc%20where%7B%0A%3Fc%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fpurl.org%2Fdc%2Fterms%2Fdescription%3E%20%3Fdesc%20.%0A%7B%7B%3Fc%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23type%3E%0A%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fopenlearn%2Fontology%2FOpenLearnUnit%3E%7D%0AUNION%0A%7B%3Fc%20%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fwww.w3.org%2F1999%2F02%2F22-rdf-syntax-ns%23type%3E%0A%3Chttps%3A%2F%2Fptop.only.wip.la%3A443%2Fhttp%2Fdata.open.ac.uk%2Fpodcast%2Fontology%2FVideoPodcast%3E%7D%7D%0AFILTER%20regex(str(%3Fdesc)%2C%20%22earthquake%22%2C%20%22i%22%20)%0A%7D&limit=0
- 19. ExposeStoreCollectExtractLinkOntologiesSchedulerCleaning rulesRDF file (add) RDF file (delete)URL redirection rulesRSS ExtractorDelete (1)Add (2)RDF CleanerWeb ServerORO, podcastRSS feedRDF file (add) RDF file (delete)Triple StoreRSS UpdaterSPARQLendpointRDF ExtractorNew itemsObsolete itemsEach datasetsIndexEntity Name SystemSearchXML UpdaterURI creation rulesLib, courses, locPlanning + LoggingGeneric processDataset specific process
- 20. Method for a exposing a dataset Identify data
- 21. Get sample data
- 22. Identify Copyright Issues
- 23. Identify possible links
- 24. Identify users and usageInitial Meeting with Data OwnerLucero Core TeamData OwnerData Modeling sessionsLucero KMi Team Find reusable ontologies
- 25. Map onto the data
- 26. Identify uncovered parts
- 27. Define URI SchemeData Modeling ValidationLucero Core TeamLucero membersData OwnerDevelopment of ExtractorURI Creation Rules DefinitionDeploymentLucero KMi Team
- 28. DatasetsAlready “officially” in place:ORO: more than 18,000 publications from OU researchersPodcasts: 2,500 audio and video tracks from podcast.open.ac.uk, linked to the relate coursesStudy at the OU: more than 600 live module descriptionsOpenLearn: more than 550 Units of course materialKMi Staff and Planet newsletterCurrently being processed:OU Buildings in MK and regional centersLibrary CatalogueYouTube channelOld Courses“Reading Experience Database” project People Profiles
- 29. Screenshot of the dataset page
- 30. Building applications with Linked DataEverything is based on HTTP/XMLIn principle, just need a Web connection…Libraries available in many languages to manipulate RDF dataJava: Jena (http://openjena.org/)PHP: ARC2 (https://github.com/semsol/arc2)Python:RDFLib (http://www.rdflib.net/)…
- 31. Example: Accessing data.open.ac.uk with PHP/Arc2include_once("arc2/ARC2.php");// declare the SPARQL endpoint$config = array('remote_store_endpoint' => 'http://data.open.ac.uk/query’,);$store = ARC2::getRemoteStore($config);// Execute a SPARQL query$postcodesq = 'select distinct ?p where {[] <http://data.ordnancesurvey.co.uk/ontology/postcode/postcode> ?p.}’;$rows = $store->query($postcodesq, 'rows');// Display the resultsforeach($rows as $row) { echo $row[‘p’].”</br/>”;}
- 32. ApplicationsFor education Mobile podcast explorer, podcast explorer on TV OU Building Map, OU location tracker (cf. foursquare)OU Expert SearchConnecting courses/OpenLearn to relevant podcastOU Course Profile Facebook app using list of courses, “Study Buddy” app connecting facebook users to relevant coursesFor ResearchDisplay connections in a research communityResearch Data/Impact AnalysisConnection research datasets to external data
- 34. Example application: Link OpenLearn to relevant course/podcasts
- 35. Example Application: keep track of location, meetings, tutorials, at the OU
- 36. Example application:Expert Search using publication information and connecting to contact information within the OU
- 37. Example application: Explore Information about a person in the “Reading Experience Database” based on data provided by DBPedia (Linked Data version of Wikipedia) New ways to look at humanities research data
- 38. Example application: exploring research communities
- 39. The futureMore data… always more dataMore links, especially to external entities BBCGovernment agenciesOther universitiesMore applications:Integration into main OU websites (e.g., study at the OU)Integration into common OU applications (people profile, Facebook course profile, etc.)Support for common OU processes (REF audit, course recommendation, providing resources to AL and lecturers)Connecting to other UniversitiesMany other universities in the UK and abroad are making the move to linked data (see linkeduniversities.org)Linked data has the potential to create connections across institutions, a data-based network on higher education course providers
- 40. ConclusionLinked data is more than an emerging, academic trend. data.open.ac.uk and linked data in general are fast becoming very valuable resources for developers, internally and externally We are very proud to have been the first university to really deploy a linked data platformNeeds to sustain and evolve as a core service at the OU… … and as a key component of the Web of University Linked Data
- 41. Thank YouSalmanElahi((Ex)-Dev)Carlo Allocca(Dev)Jane Whild(Admin)FouadZablith(Dev)KMiAndriyNikolov(linking)Enrico Motta(SGP)Mathieu d’Aquin(PD)ArtsSuzanne Duncanson-HunterJohn WolfePaul LawrenceRichard Nurse((ex-)PM)Owen Stephens(PM)Stuart BrownCom./StudentComp.ServicesData OwnersNon ScantleburyLibrary SpecialistsArts SpecialistsOU Library
Editor's Notes
- #3: Usual pitch: - data on the web = every piece of data is web addressable, so data across different places/stores/systems become linkable: the Web = 1 data space