SlideShare a Scribd company logo
Digital Enterprise Research Institute                                                    www.deri.ie




                 Implementing Semantic Web applications:
                   reference architecture and challenges

                             Benjamin Heitmann, Sheila Kinsella,
                              Conor Hayes, and Stefan Decker

                      Workshop on Semantic Web Enabled Software Engineering 2009




♥ Copyright 2009 Digital Enterprise Research Institute. All rights reserved.
                                                                               Chapter
Introduction
Digital Enterprise Research Institute                               www.deri.ie



     Focus of Semantic Web research until now:
         benefits of Semantic Web technology
     Less research on:
         costs, effort, challenges of Semantic Web technology
     Result:
         estimating cost/benefit offset for Semantic Web technologies is
         difficult
         obstacle for uptake of Semantic Web technologies by real-world
         projects
     Our contributions:
         identify main challenges and outline Software Engineering
         solutions


Benjamin.Heitmann
                             slide 2 of 14
@deri.org
Overview
Digital Enterprise Research Institute                           www.deri.ie




      Empirical Analysis of 98 Semantic Web applications
         architectural analysis + app functionality questionnaire
      Reference Architecture for Semantic Web
      applications
      Main challenges of implementing Semantic Web
      technologies
         and their effect on an example application
      Approaches for mitigating the challenges




Benjamin.Heitmann
                             slide 3 of 14
@deri.org
Empirical analysis - Architectural
Digital Enterprise Research Institute                www.deri.ie




      Goal: identify common functionality
      Result: components, allow comparison between apps
      98 papers about apps from SemWeb challenge 2003-2008
      & Scripting for SemWeb challenge 2006-2008


Benjamin.Heitmann
                             slide 4 of 14
@deri.org
Reference Architecture for
       Semantic Web applications
Digital Enterprise Research Institute                  www.deri.ie




            Empirical basis: architectural analysis
            provides standard decomposition criteria
            allows comparing of functionality




Benjamin.Heitmann
                             slide 5 of 14
@deri.org
Empirical analysis - Functionality
Digital Enterprise Research Institute                    www.deri.ie




      Goal: characterise capabilities of components
      Result: statistics about the range of variations for
     each component
      Results for 37 apps validated by authors
      Survey covers 27 properties in 7 areas of
     functionality




Benjamin.Heitmann
                             slide 6 of 14
@deri.org
Empirical analysis - Functionality
       Functionality Variations(examples)
Digital Enterprise Research Institute                  www.deri.ie




        Data Interface: data sources used
        (external/decentralised/evolving ?)
        Persistent Storage: Semantic Web standards
        supported (e.g. RDF, OWL, SPARQL ?)
        User Interface: generic/domain specific
        Data Integration: manual/automatic
        Search Service: structured/unstructured data
        Authoring: read-only/edit/create new data
        Crawling: one-time/continuous




Benjamin.Heitmann
                             slide 7 of 14
@deri.org
Implementation challenges (1)
Digital Enterprise Research Institute                             www.deri.ie




    1. Integrating noisy and heterogeneous data

            integration service is very common (72%)
            expensive: 80% require manual intervention
            76% allow updating data after initial integration
            Reasons:
                use of non-standard terms
                incorrect usage of vocabularies
               multiple URIs for the same objects and incorrect
               merging




Benjamin.Heitmann
                             slide 8 of 14
@deri.org
Implementation challenges (2)
Digital Enterprise Research Institute                            www.deri.ie




    2. Missing or belated conventions and standards
       70% allow access or importing of external data
       60% can export data or are reusable as source
       only 1/3 allow creation of new data
       Reason: standards are just emerging:
           Linked Data principles: 2006, ~8 years after RDF (1999)
           RDFa for embedding RDF in HTML: finalised 2008
           GRDDL for converting (X)HTML to RDF: finalised 2007
           SPARQL update: not finalised
           RDF forms and RDF pushback: not finalised



Benjamin.Heitmann
                             slide 9 of 14
@deri.org
Implementation challenges (3)
Digital Enterprise Research Institute                                  www.deri.ie



    3. Mismatch of data models and APIs between
    components:
     components have different data models (majority)
             object oriented (92%), relational database, graph based
         slow, non-native APIs between components
   4. Distribution of application logic across multiple
   components
     Logic included not just in code but queries, rules,
    formal vocabularies
           58% using inferencing, 24% using queries
    Result of 3+4: higher maintenance costs,
    performance loss due to non-native API overhead
Benjamin.Heitmann
                             slide 10of 14
@deri.org
Example Application: SIOC explorer
Digital Enterprise Research Institute                            www.deri.ie




                                             1 - Integration: all data
                                             is RDF+SIOC, still 2
                                             integration steps
                                             required
                                             2 - Unclear best
                                             practices: every SIOC
                                             exporter requires
                                             different crawling
 3 - Mismatched data models: graph/relational/OO
 Mismatched APIs: ruby<->java, SPARQL (slow)
 4 - distributed app logic: crawler, integration, primary app logic



Benjamin.Heitmann
                             slide 11of 14
@deri.org
Mitigating the challenges (1)
Digital Enterprise Research Institute                                  www.deri.ie




   1. Delegating generic functionality to external providers
      72% implement integration, 3 components
     required
              Delegating generic integration simplifies architecture
           Drawback: application specific integration may still be
         necessary


Benjamin.Heitmann
                             slide 12of 14
@deri.org
Mitigating the challenges (2)
Digital Enterprise Research Institute                 www.deri.ie


   2. Assembling applications from components:
     most apps in survey created on case-by-case basis:
            multiple libraries
            multiple programming languages
            mismatch of native APIs
            distributed application logic
      provide frameworks / software factories to assemble
    and customise complete applications
            provide generic data integration
            implement best practices and guidelines
            centralise application logic
            allow app specific customisation
      inspiration: Ruby on Rails, PHPCake, Django
    (Python), Struts (Java)
Benjamin.Heitmann
                             slide 13of 14
@deri.org
Summary
Digital Enterprise Research Institute                               www.deri.ie




          main challenges of implementing SemWeb tech
             cost of integrating noisy or heterogeneous data
            (non-RDF and RDF data)
              missing or belated standards and conventions
              mismatch of data models and APIs between components
              distribution of application logic across components
          approaches to mitigate the challenges:
              delegate generic functionality to external services
             support assembly of complete applications with
            frameworks
         empirical foundation: analysis of 98 Semantic Web
        applications

Benjamin.Heitmann
                             slide 14of 14
@deri.org
Ad

More Related Content

What's hot (20)

Presentation of current research: distributed architecture for recommendation...
Presentation of current research: distributed architecture for recommendation...Presentation of current research: distributed architecture for recommendation...
Presentation of current research: distributed architecture for recommendation...
Benjamin Heitmann
 
Swap2010 agave
Swap2010 agaveSwap2010 agave
Swap2010 agave
juanaya
 
Linked Open Data
Linked Open DataLinked Open Data
Linked Open Data
Derilinx
 
One-stop shop for software development information
One-stop shop for software development informationOne-stop shop for software development information
One-stop shop for software development information
Aftab Iqbal
 
Itgs scheme 2011-2012
Itgs scheme 2011-2012Itgs scheme 2011-2012
Itgs scheme 2011-2012
Yvonne Mafunga
 
Turning social disputes into knowledge representations DERI reading group 201...
Turning social disputes into knowledge representations DERI reading group 201...Turning social disputes into knowledge representations DERI reading group 201...
Turning social disputes into knowledge representations DERI reading group 201...
jodischneider
 
Rethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed SemanticRethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed Semantic
Alexandre Passant
 
Twitter and research impact
Twitter and research impactTwitter and research impact
Twitter and research impact
Marie Boran
 
Internet Science
Internet ScienceInternet Science
Internet Science
i_scienceEU
 
A PLATFORM FOR LEARNING INTERNET OF THINGS
A PLATFORM FOR LEARNING INTERNET OF THINGSA PLATFORM FOR LEARNING INTERNET OF THINGS
A PLATFORM FOR LEARNING INTERNET OF THINGS
eraser Juan José Calderón
 
23625509 internetworking-technologies
23625509 internetworking-technologies23625509 internetworking-technologies
23625509 internetworking-technologies
jayaprakash
 
Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...
Alexandre Passant
 
Artificial Intelligence (AI): Deep Learning
Artificial Intelligence (AI): Deep LearningArtificial Intelligence (AI): Deep Learning
Artificial Intelligence (AI): Deep Learning
Flevy.com Best Practices
 
Knowledge management on the desktop
Knowledge management on the desktopKnowledge management on the desktop
Knowledge management on the desktop
Laura Dragan
 
Service Integration - A Web of Things Perspective
Service Integration - A Web of Things PerspectiveService Integration - A Web of Things Perspective
Service Integration - A Web of Things Perspective
Simon Mayer
 
Making sense out of disagreement, University of Limerick Interaction Design C...
Making sense out of disagreement, University of Limerick Interaction Design C...Making sense out of disagreement, University of Limerick Interaction Design C...
Making sense out of disagreement, University of Limerick Interaction Design C...
jodischneider
 
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
J S
 
Are Centres Details
Are Centres DetailsAre Centres Details
Are Centres Details
threesixty
 
Business ontology - integrate knowledge 1/3 An overview
Business ontology - integrate knowledge 1/3 An overviewBusiness ontology - integrate knowledge 1/3 An overview
Business ontology - integrate knowledge 1/3 An overview
Heimo Hänninen
 
AN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENT
AN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENTAN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENT
AN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENT
csandit
 
Presentation of current research: distributed architecture for recommendation...
Presentation of current research: distributed architecture for recommendation...Presentation of current research: distributed architecture for recommendation...
Presentation of current research: distributed architecture for recommendation...
Benjamin Heitmann
 
Swap2010 agave
Swap2010 agaveSwap2010 agave
Swap2010 agave
juanaya
 
Linked Open Data
Linked Open DataLinked Open Data
Linked Open Data
Derilinx
 
One-stop shop for software development information
One-stop shop for software development informationOne-stop shop for software development information
One-stop shop for software development information
Aftab Iqbal
 
Turning social disputes into knowledge representations DERI reading group 201...
Turning social disputes into knowledge representations DERI reading group 201...Turning social disputes into knowledge representations DERI reading group 201...
Turning social disputes into knowledge representations DERI reading group 201...
jodischneider
 
Rethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed SemanticRethinking Microblogging: Open Distributed Semantic
Rethinking Microblogging: Open Distributed Semantic
Alexandre Passant
 
Twitter and research impact
Twitter and research impactTwitter and research impact
Twitter and research impact
Marie Boran
 
Internet Science
Internet ScienceInternet Science
Internet Science
i_scienceEU
 
23625509 internetworking-technologies
23625509 internetworking-technologies23625509 internetworking-technologies
23625509 internetworking-technologies
jayaprakash
 
Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...Federating Distributed Social Data to Build an Interlinked Online Information...
Federating Distributed Social Data to Build an Interlinked Online Information...
Alexandre Passant
 
Artificial Intelligence (AI): Deep Learning
Artificial Intelligence (AI): Deep LearningArtificial Intelligence (AI): Deep Learning
Artificial Intelligence (AI): Deep Learning
Flevy.com Best Practices
 
Knowledge management on the desktop
Knowledge management on the desktopKnowledge management on the desktop
Knowledge management on the desktop
Laura Dragan
 
Service Integration - A Web of Things Perspective
Service Integration - A Web of Things PerspectiveService Integration - A Web of Things Perspective
Service Integration - A Web of Things Perspective
Simon Mayer
 
Making sense out of disagreement, University of Limerick Interaction Design C...
Making sense out of disagreement, University of Limerick Interaction Design C...Making sense out of disagreement, University of Limerick Interaction Design C...
Making sense out of disagreement, University of Limerick Interaction Design C...
jodischneider
 
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
J S
 
Are Centres Details
Are Centres DetailsAre Centres Details
Are Centres Details
threesixty
 
Business ontology - integrate knowledge 1/3 An overview
Business ontology - integrate knowledge 1/3 An overviewBusiness ontology - integrate knowledge 1/3 An overview
Business ontology - integrate knowledge 1/3 An overview
Heimo Hänninen
 
AN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENT
AN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENTAN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENT
AN EMPIRICAL STUDY OF USING CLOUD-BASED SERVICES IN CAPSTONE PROJECT DEVELOPMENT
csandit
 

Similar to Implementing Semantic Web applications: reference architecture and challenges (20)

apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...
apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...
apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...
apidays
 
Content Oriented Architectures: Putting Content at the Center of CM Projects
Content Oriented Architectures: Putting Content at the Center of CM ProjectsContent Oriented Architectures: Putting Content at the Center of CM Projects
Content Oriented Architectures: Putting Content at the Center of CM Projects
Scott Abel
 
Content Oriented Architectures (COA)
Content Oriented Architectures (COA)Content Oriented Architectures (COA)
Content Oriented Architectures (COA)
Joe Gollner
 
Rich Internet Applications
Rich Internet ApplicationsRich Internet Applications
Rich Internet Applications
Youssef Shaath
 
Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source
Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source
Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source
Mark Brörkens
 
EconoME_EnglishPresentation_ArinaTozlovanu.pdf
EconoME_EnglishPresentation_ArinaTozlovanu.pdfEconoME_EnglishPresentation_ArinaTozlovanu.pdf
EconoME_EnglishPresentation_ArinaTozlovanu.pdf
Arina Tozlovanu
 
soa1.ppt
soa1.pptsoa1.ppt
soa1.ppt
ShanmugamS34
 
Bestpractices Portal Projects
Bestpractices Portal ProjectsBestpractices Portal Projects
Bestpractices Portal Projects
allerhed
 
2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...
2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...
2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...
SBGC
 
Organizing Design-Driven Development Using Rational Requirements Composer
Organizing Design-Driven Development Using Rational Requirements ComposerOrganizing Design-Driven Development Using Rational Requirements Composer
Organizing Design-Driven Development Using Rational Requirements Composer
Kurt Solarte
 
redpill Mobile Case Study (Salvation Army)
redpill Mobile Case Study (Salvation Army)redpill Mobile Case Study (Salvation Army)
redpill Mobile Case Study (Salvation Army)
Peter Presnell
 
01.egovFrame Training Book I
01.egovFrame Training Book I01.egovFrame Training Book I
01.egovFrame Training Book I
Chuong Nguyen
 
Web engineering
Web engineeringWeb engineering
Web engineering
•sreejith •sree
 
Yii Framework in the RAD context + Mashup demo built on YII
Yii Framework in the RAD context + Mashup demo built on YIIYii Framework in the RAD context + Mashup demo built on YII
Yii Framework in the RAD context + Mashup demo built on YII
George-Leonard Chetreanu
 
SA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterpriseSA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterprise
David Graham
 
Enabling High Level Application Development In The Internet Of Things
Enabling High Level Application Development In The Internet Of ThingsEnabling High Level Application Development In The Internet Of Things
Enabling High Level Application Development In The Internet Of Things
Pankesh Patel
 
Unlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analyticsUnlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analytics
source{d}
 
Aruna_SharepointDeveloper
Aruna_SharepointDeveloperAruna_SharepointDeveloper
Aruna_SharepointDeveloper
Aruna Ch
 
IBM Pulse 2013 session - DevOps for Mobile Apps
IBM Pulse 2013 session - DevOps for Mobile AppsIBM Pulse 2013 session - DevOps for Mobile Apps
IBM Pulse 2013 session - DevOps for Mobile Apps
Sanjeev Sharma
 
Ny Senate Open Source Initiatives
Ny Senate Open Source InitiativesNy Senate Open Source Initiatives
Ny Senate Open Source Initiatives
NY Senate
 
apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...
apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...
apidays LIVE Paris 2021 - APIs - How did we get here and where are we going n...
apidays
 
Content Oriented Architectures: Putting Content at the Center of CM Projects
Content Oriented Architectures: Putting Content at the Center of CM ProjectsContent Oriented Architectures: Putting Content at the Center of CM Projects
Content Oriented Architectures: Putting Content at the Center of CM Projects
Scott Abel
 
Content Oriented Architectures (COA)
Content Oriented Architectures (COA)Content Oriented Architectures (COA)
Content Oriented Architectures (COA)
Joe Gollner
 
Rich Internet Applications
Rich Internet ApplicationsRich Internet Applications
Rich Internet Applications
Youssef Shaath
 
Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source
Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source
Eclipse RMF - Requirements Modeling Framework - ReqIF in der Open Source
Mark Brörkens
 
EconoME_EnglishPresentation_ArinaTozlovanu.pdf
EconoME_EnglishPresentation_ArinaTozlovanu.pdfEconoME_EnglishPresentation_ArinaTozlovanu.pdf
EconoME_EnglishPresentation_ArinaTozlovanu.pdf
Arina Tozlovanu
 
Bestpractices Portal Projects
Bestpractices Portal ProjectsBestpractices Portal Projects
Bestpractices Portal Projects
allerhed
 
2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...
2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...
2012 ieee projects software engineering @ Seabirds ( Trichy, Chennai, Pondich...
SBGC
 
Organizing Design-Driven Development Using Rational Requirements Composer
Organizing Design-Driven Development Using Rational Requirements ComposerOrganizing Design-Driven Development Using Rational Requirements Composer
Organizing Design-Driven Development Using Rational Requirements Composer
Kurt Solarte
 
redpill Mobile Case Study (Salvation Army)
redpill Mobile Case Study (Salvation Army)redpill Mobile Case Study (Salvation Army)
redpill Mobile Case Study (Salvation Army)
Peter Presnell
 
01.egovFrame Training Book I
01.egovFrame Training Book I01.egovFrame Training Book I
01.egovFrame Training Book I
Chuong Nguyen
 
Yii Framework in the RAD context + Mashup demo built on YII
Yii Framework in the RAD context + Mashup demo built on YIIYii Framework in the RAD context + Mashup demo built on YII
Yii Framework in the RAD context + Mashup demo built on YII
George-Leonard Chetreanu
 
SA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterpriseSA 2014 - Integrating the heterogeneous enterprise
SA 2014 - Integrating the heterogeneous enterprise
David Graham
 
Enabling High Level Application Development In The Internet Of Things
Enabling High Level Application Development In The Internet Of ThingsEnabling High Level Application Development In The Internet Of Things
Enabling High Level Application Development In The Internet Of Things
Pankesh Patel
 
Unlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analyticsUnlocking Engineering Observability with advanced IT analytics
Unlocking Engineering Observability with advanced IT analytics
source{d}
 
Aruna_SharepointDeveloper
Aruna_SharepointDeveloperAruna_SharepointDeveloper
Aruna_SharepointDeveloper
Aruna Ch
 
IBM Pulse 2013 session - DevOps for Mobile Apps
IBM Pulse 2013 session - DevOps for Mobile AppsIBM Pulse 2013 session - DevOps for Mobile Apps
IBM Pulse 2013 session - DevOps for Mobile Apps
Sanjeev Sharma
 
Ny Senate Open Source Initiatives
Ny Senate Open Source InitiativesNy Senate Open Source Initiatives
Ny Senate Open Source Initiatives
NY Senate
 
Ad

More from Benjamin Heitmann (7)

A new direction for recommender systems: balancing privacy and personalisation
A new direction for recommender systems: balancing privacy and personalisationA new direction for recommender systems: balancing privacy and personalisation
A new direction for recommender systems: balancing privacy and personalisation
Benjamin Heitmann
 
Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...
Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...
Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...
Benjamin Heitmann
 
Representing discourse and argumentation as an application of Web Science
Representing discourse and argumentation as an application of Web ScienceRepresenting discourse and argumentation as an application of Web Science
Representing discourse and argumentation as an application of Web Science
Benjamin Heitmann
 
Web Science: Motivation, Goals and Contributions
Web Science: Motivation, Goals and ContributionsWeb Science: Motivation, Goals and Contributions
Web Science: Motivation, Goals and Contributions
Benjamin Heitmann
 
Lessons learned from Futures Studies: Towards a method for Web Science
Lessons learned from Futures Studies: Towards a method for Web ScienceLessons learned from Futures Studies: Towards a method for Web Science
Lessons learned from Futures Studies: Towards a method for Web Science
Benjamin Heitmann
 
Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...
Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...
Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...
Benjamin Heitmann
 
Applying the scientific method in Software Evaluation
Applying the scientific method in Software EvaluationApplying the scientific method in Software Evaluation
Applying the scientific method in Software Evaluation
Benjamin Heitmann
 
A new direction for recommender systems: balancing privacy and personalisation
A new direction for recommender systems: balancing privacy and personalisationA new direction for recommender systems: balancing privacy and personalisation
A new direction for recommender systems: balancing privacy and personalisation
Benjamin Heitmann
 
Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...
Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...
Benjamin Heitmann, PhD defence talk: An Open Framework for Multi-source, Cro...
Benjamin Heitmann
 
Representing discourse and argumentation as an application of Web Science
Representing discourse and argumentation as an application of Web ScienceRepresenting discourse and argumentation as an application of Web Science
Representing discourse and argumentation as an application of Web Science
Benjamin Heitmann
 
Web Science: Motivation, Goals and Contributions
Web Science: Motivation, Goals and ContributionsWeb Science: Motivation, Goals and Contributions
Web Science: Motivation, Goals and Contributions
Benjamin Heitmann
 
Lessons learned from Futures Studies: Towards a method for Web Science
Lessons learned from Futures Studies: Towards a method for Web ScienceLessons learned from Futures Studies: Towards a method for Web Science
Lessons learned from Futures Studies: Towards a method for Web Science
Benjamin Heitmann
 
Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...
Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...
Leveraging existing Web Frameworks for a SIOC explorer (Scripting for the Sem...
Benjamin Heitmann
 
Applying the scientific method in Software Evaluation
Applying the scientific method in Software EvaluationApplying the scientific method in Software Evaluation
Applying the scientific method in Software Evaluation
Benjamin Heitmann
 
Ad

Recently uploaded (20)

The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Build 3D Animated Safety Induction - Tech EHS
Build 3D Animated Safety Induction - Tech EHSBuild 3D Animated Safety Induction - Tech EHS
Build 3D Animated Safety Induction - Tech EHS
TECH EHS Solution
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdfThe Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
The Evolution of Meme Coins A New Era for Digital Currency ppt.pdf
Abi john
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Build 3D Animated Safety Induction - Tech EHS
Build 3D Animated Safety Induction - Tech EHSBuild 3D Animated Safety Induction - Tech EHS
Build 3D Animated Safety Induction - Tech EHS
TECH EHS Solution
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
AI Changes Everything – Talk at Cardiff Metropolitan University, 29th April 2...
Alan Dix
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
How analogue intelligence complements AI
How analogue intelligence complements AIHow analogue intelligence complements AI
How analogue intelligence complements AI
Paul Rowe
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
Rusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond SparkRusty Waters: Elevating Lakehouses Beyond Spark
Rusty Waters: Elevating Lakehouses Beyond Spark
carlyakerly1
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes Partner Innovation Updates for May 2025
ThousandEyes
 
Heap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and DeletionHeap, Types of Heap, Insertion and Deletion
Heap, Types of Heap, Insertion and Deletion
Jaydeep Kale
 
Big Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur MorganBig Data Analytics Quick Research Guide by Arthur Morgan
Big Data Analytics Quick Research Guide by Arthur Morgan
Arthur Morgan
 

Implementing Semantic Web applications: reference architecture and challenges

  • 1. Digital Enterprise Research Institute www.deri.ie Implementing Semantic Web applications: reference architecture and challenges Benjamin Heitmann, Sheila Kinsella, Conor Hayes, and Stefan Decker Workshop on Semantic Web Enabled Software Engineering 2009 ♥ Copyright 2009 Digital Enterprise Research Institute. All rights reserved. Chapter
  • 2. Introduction Digital Enterprise Research Institute www.deri.ie Focus of Semantic Web research until now: benefits of Semantic Web technology Less research on: costs, effort, challenges of Semantic Web technology Result: estimating cost/benefit offset for Semantic Web technologies is difficult obstacle for uptake of Semantic Web technologies by real-world projects Our contributions: identify main challenges and outline Software Engineering solutions Benjamin.Heitmann slide 2 of 14 @deri.org
  • 3. Overview Digital Enterprise Research Institute www.deri.ie Empirical Analysis of 98 Semantic Web applications architectural analysis + app functionality questionnaire Reference Architecture for Semantic Web applications Main challenges of implementing Semantic Web technologies and their effect on an example application Approaches for mitigating the challenges Benjamin.Heitmann slide 3 of 14 @deri.org
  • 4. Empirical analysis - Architectural Digital Enterprise Research Institute www.deri.ie Goal: identify common functionality Result: components, allow comparison between apps 98 papers about apps from SemWeb challenge 2003-2008 & Scripting for SemWeb challenge 2006-2008 Benjamin.Heitmann slide 4 of 14 @deri.org
  • 5. Reference Architecture for Semantic Web applications Digital Enterprise Research Institute www.deri.ie Empirical basis: architectural analysis provides standard decomposition criteria allows comparing of functionality Benjamin.Heitmann slide 5 of 14 @deri.org
  • 6. Empirical analysis - Functionality Digital Enterprise Research Institute www.deri.ie Goal: characterise capabilities of components Result: statistics about the range of variations for each component Results for 37 apps validated by authors Survey covers 27 properties in 7 areas of functionality Benjamin.Heitmann slide 6 of 14 @deri.org
  • 7. Empirical analysis - Functionality Functionality Variations(examples) Digital Enterprise Research Institute www.deri.ie Data Interface: data sources used (external/decentralised/evolving ?) Persistent Storage: Semantic Web standards supported (e.g. RDF, OWL, SPARQL ?) User Interface: generic/domain specific Data Integration: manual/automatic Search Service: structured/unstructured data Authoring: read-only/edit/create new data Crawling: one-time/continuous Benjamin.Heitmann slide 7 of 14 @deri.org
  • 8. Implementation challenges (1) Digital Enterprise Research Institute www.deri.ie 1. Integrating noisy and heterogeneous data integration service is very common (72%) expensive: 80% require manual intervention 76% allow updating data after initial integration Reasons: use of non-standard terms incorrect usage of vocabularies multiple URIs for the same objects and incorrect merging Benjamin.Heitmann slide 8 of 14 @deri.org
  • 9. Implementation challenges (2) Digital Enterprise Research Institute www.deri.ie 2. Missing or belated conventions and standards 70% allow access or importing of external data 60% can export data or are reusable as source only 1/3 allow creation of new data Reason: standards are just emerging: Linked Data principles: 2006, ~8 years after RDF (1999) RDFa for embedding RDF in HTML: finalised 2008 GRDDL for converting (X)HTML to RDF: finalised 2007 SPARQL update: not finalised RDF forms and RDF pushback: not finalised Benjamin.Heitmann slide 9 of 14 @deri.org
  • 10. Implementation challenges (3) Digital Enterprise Research Institute www.deri.ie 3. Mismatch of data models and APIs between components: components have different data models (majority) object oriented (92%), relational database, graph based slow, non-native APIs between components 4. Distribution of application logic across multiple components Logic included not just in code but queries, rules, formal vocabularies 58% using inferencing, 24% using queries Result of 3+4: higher maintenance costs, performance loss due to non-native API overhead Benjamin.Heitmann slide 10of 14 @deri.org
  • 11. Example Application: SIOC explorer Digital Enterprise Research Institute www.deri.ie 1 - Integration: all data is RDF+SIOC, still 2 integration steps required 2 - Unclear best practices: every SIOC exporter requires different crawling 3 - Mismatched data models: graph/relational/OO Mismatched APIs: ruby<->java, SPARQL (slow) 4 - distributed app logic: crawler, integration, primary app logic Benjamin.Heitmann slide 11of 14 @deri.org
  • 12. Mitigating the challenges (1) Digital Enterprise Research Institute www.deri.ie 1. Delegating generic functionality to external providers 72% implement integration, 3 components required Delegating generic integration simplifies architecture Drawback: application specific integration may still be necessary Benjamin.Heitmann slide 12of 14 @deri.org
  • 13. Mitigating the challenges (2) Digital Enterprise Research Institute www.deri.ie 2. Assembling applications from components: most apps in survey created on case-by-case basis: multiple libraries multiple programming languages mismatch of native APIs distributed application logic provide frameworks / software factories to assemble and customise complete applications provide generic data integration implement best practices and guidelines centralise application logic allow app specific customisation inspiration: Ruby on Rails, PHPCake, Django (Python), Struts (Java) Benjamin.Heitmann slide 13of 14 @deri.org
  • 14. Summary Digital Enterprise Research Institute www.deri.ie main challenges of implementing SemWeb tech cost of integrating noisy or heterogeneous data (non-RDF and RDF data) missing or belated standards and conventions mismatch of data models and APIs between components distribution of application logic across components approaches to mitigate the challenges: delegate generic functionality to external services support assembly of complete applications with frameworks empirical foundation: analysis of 98 Semantic Web applications Benjamin.Heitmann slide 14of 14 @deri.org