Rdf conjunctive query selectivity estimation

RDF
conjunc*ve
query
cardinality
es*ma*on
Owner
:
Stama,s/Damian
Presenter
:
Soudip

Overview
• This
project
provides
methods
to
es,mate
the
cardinality
of
(for
the
result
of)
a
conjunc,ve
query
• It
requires
a
summary
with
sta,s,cs
informa,on
that
can
be
provided
as
a
serialized
summary
or
by
providing
the
database
connec,on
containing
sta,s,cs
and
dic,onary
tables
informa,on
• This
project
also
include
methods
to
generate
a
dic,onary-‐
encoded
version
of
the
triples
table
and
the
triples
table
sta,s,cs
in
a
database,
for
both
the
plain
and
the
dic,onary-‐
encoded
triples
tables
• It
is
a
refactored
extrac,on
(for
code
reusability)
of
the
RDFViewSelec,on’s
(project)
cardinality
es,mator

Few
Details
• Online
repository:
– hLps://scm.gforge.inria.fr/svn/distriples/RDFOp,m
• Code
size
(java)
– 4041
(LoC),
15
packages
• List
of
people
contributed-‐
– Present:
Stama,s,
Damian,
Ioana
– Past:
Julien
Leblay
• Current
Owner
(OAK
member)
of
the
Code-‐
Stama,s/Damian
• Who
is
using
the
code
now
– Fragmented
Query
Execu,on
(Damian)
– CliqueSquare
(Stama,s)
– Op,mizer
(hLps://scm.gforge.inria.fr/svn/distriples/trunk/Op,mizer)
(Stama,s/Zoi)

Func*onal
Architecture
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
Triples Summary, Dictonary
Data Store (PostgreSQL DB)
Data Table Summary Table (6) Dictonary Table
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary

RDF
Loader
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary
–
Parses
input
RDF
files
content
–
Extracts
<subject,
property,
object>
triples
– Loads
the
triples
into
the
DB

Data
Store
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary
–
Stores
triples
in
the
DB
and
creates
3
different
tables
–
Data
Table
• Stores
the
basic
triples
– Summary
Table
• Stores
different
summaries
of
triples
• 6
different
summary
tables
– Dic,onary
Table
• Stores
integer
values
corresponding
to
each
entries
in
the
data
table

Cardinality
Es*mator
Module
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary
–
Takes
input
• A
conjunc,ve
query
• Data
from
Summary
and
Dic,onary
tables
– Outputs
cardinality
informa,on
for
the
input
query

CQ
Parser
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary
–
Taken
as
it
is
from
the
project
Conjunc,ve
Query

DB
Interfaces
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary
–
Contains
two
interfaces
to
load
data
from
the
DB
to
the
memory
• Summary
Interface
–
to
get
data
from
the
Summary
table
• Dic,onary
Interface
-‐
to
get
data
from
the
Dic,onary
table

Cardinality
Es*mator
RDF
RDF Loader
Parser
Importer
Conjunctive
Query
CQ Parser
DB Interfaces
Cardinality Info.
Main Modules
Cardinality
Estimator
S P O S
Key Value
Count
(*)
Count
(P)
Count
(O)
Min
(P)
Max
(P)
Min
(O)
Max
(O)
P
Count
(*)
Count
(S)
Count
(O)
Min
(S)
Max
(S)
Min
(O)
Max
(O)
O
Count
(*)
Count
(S)
Count
(P)
Min
(S)
Max
(S)
Min
(P)
Max
(P)
S P
Count
(*)
Count
(O)
Min
(O)
Max
(O)
P O
Count
(*)
Count
(S)
Min
(S)
Max
(S)
S O
Count
(*)
Count
(P)
Min
(P)
Max
(P)
CQ, Summary,
Dictonary
–
Takes
as
input
CQ
and
Summary
data
and
produces
the
cardinality
info
for
the
input
CQ
as
output
– It
uses
3
algorithms
(two
use
sta,c
summary
and
one
uses
MaxMin
Summary)
for
calcula,ng
the
cardinality
(hLps://scm.gforge.inria.fr/svn/distriples/RDFOp,m/)

Rdf conjunctive query selectivity estimation

Recommended

More Related Content

What's hot (20)

Similar to Rdf conjunctive query selectivity estimation (20)

More from INRIA-OAK (20)

Recently uploaded (20)

Rdf conjunctive query selectivity estimation