Home

Awesome

GeoSPARQL Compliance Benchmark

This is the GeoSPARQL Compliance Benchmark, integrated into the HOBBIT Platform.

The GeoSPARQL Compliance Benchmark aims to evaluate the GeoSPARQL compliance of RDF storage systems. The benchmark uses 206 SPARQL queries to test the extent to which the benchmarked system supports the 30 requirements defined in the GeoSPARQL standard.

As a result, the benchmark provides two metrics:

Results

You can find a set of results from the latest experiments on the hosted instance of the HOBBIT Platform (log in as Guest). [last update: 07.07.2021]

If you want your RDF triplestore tested, you can add it as a system to the HOBBIT Platform, and then run an experiment using the hosted instance of the HOBBIT Platform.

Publications

Mapping Requirements to Queries

Req.Set of corresponding queriesDescription
<tr><th colspan="3">Core component (CORE)</th></tr>
R1Q01.rqSelecting of the first triple where geometry A is the subject
R2Q02.rqSelecting of the first entity of type geo:SpatialObject
R3Q03.rqSelecting of the first entity of type geo:Feature
<tr><th colspan="3">Topology vocabulary extension (TOP)</th></tr>
R4Q04-1.rq, Q04-2.rq, Q04-3.rq, Q04-4.rq, <br /> Q04-5.rq, Q04-6.rq, Q04-7.rq, Q04-8.rqTesting the properties geo:sfEquals, geo:sfDisjoint, geo:sfIntersects, geo:sfTouches, geo:sfCrosses, geo:sfWithin, geo:sfContains and geo:sfOverlaps
R5Q05-1.rq, Q05-2.rq, Q05-3.rq, Q05-4.rq, <br /> Q05-5.rq, Q05-6.rq, Q05-7.rq, Q05-8.rqTesting the properties geo:ehEquals, geo:ehDisjoint, geo:ehMeet, geo:ehOverlap, geo:ehCovers, geo:ehCoveredBy, geo:ehInside and geo:ehContains
R6Q06-1.rq, Q06-2.rq, Q06-3.rq, Q06-4.rq, <br /> Q06-5.rq, Q06-6.rq, Q06-7.rq, Q06-8.rqTesting the properties geo:rcc8eq, geo:rcc8dc, geo:rcc8ec, geo:rcc8po, geo:rcc8tppi, geo:rcc8tpp, geo:rcc8ntpp and geo:rcc8ntppi
<tr><th colspan="3">Geometry extension (GEOEXT)</th></tr>
R7Q07.rqSelecting of all entities of type geo:Geometry
R8Q08-1.rq, Q08-2.rqSelecting of the value of geometry A denoted by the properties geo:hasGeometry and geo:hasDefaultGeometry
R9Q09-1.rq, Q09-2.rq, Q09-3.rq, Q09-4.rq, <br /> Q09-5.rq, Q09-6.rqSelecting of the value of geometry A denoted by the properties geo:dimension, geo:coordinateDimension, geo:spatialDimension, geo:isEmpty, geo:isSimple and geo:hasSerialization
R10Q10.rqChecking of the datatype of a correctly defined WKT literal from the dataset
R11Q11.rqChecking of the equality of two geometries from the dataset
R12Q12.rqChecking if the system interprets the axis order within a point geometry according to the spatial reference system being used
R13Q13-1.rq, Q13-2.rqChecking if an empty RDFS Literal of type geo:wktLiteral is interpreted as an empty geometry
R14Q14.rqChecking of the geo:asWKT value of geometry A against the expected literal value
R15Q15.rqChecking whether all the values of the geo:asGML property contain a valid GM_Object subtype in it and whether its datatype is geo:gmlLiteral
R16Q16-1.rq, Q16-2.rqChecking if an empty geo:gmlLiteral is interpreted as an empty geometry
R17------
R18Q18.rqChecking the geo:asGML value of geometry A against the expected literal value
R19Q19-1-1.rq, Q19-1-2.rq, Q19-1-3.rq, Q19-1-4.rq, <br /> Q19-2-1.rq, Q19-2-2.rq, Q19-3-1.rq, Q19-3-2.rq, <br /> Q19-4-1.rq, Q19-4-2.rq, Q19-4-3.rq, Q19-4-4.rq, <br /> Q19-5-1.rq, Q19-5-2.rq, Q19-5-3.rq, Q19-5-4.rq, <br /> Q19-6-1.rq, Q19-6-2.rq, Q19-6-3.rq, Q19-6-4.rq, <br /> Q19-7-1.rq, Q19-7-2.rq, Q19-7-3.rq, Q19-7-4.rq, <br /> Q19-8-1.rq, Q19-8-2.rq, Q19-9-1.rq, Q19-9-2.rqChecking a support of the geospatial functions geof:distance, geof:buffer, geof:convexHull, geof:intersection, geof:union, geof:difference, geof:symDifference, geof:envelope and geof:boundary
R20Q20-1.rq, Q20-2.rqChecking a support of the geospatial function geof:getSRID
<tr><th colspan="3">Geometry topology extension (GTOP)</th></tr>
R21Q21-1.rq, Q21-2.rq, Q21-3.rq, Q21-4.rqChecking a support of the geospatial operator geof:relate
R22Q22-1-1.rq, Q22-1-2.rq, Q22-1-3.rq, Q22-1-4.rq, <br /> Q22-2-1.rq, Q22-2-2.rq, Q22-2-3.rq, Q22-2-4.rq, <br /> Q22-3-1.rq, Q22-3-2.rq, Q22-3-3.rq, Q22-3-4.rq, <br /> Q22-4-1.rq, Q22-4-2.rq, Q22-4-3.rq, Q22-4-4.rq, <br /> Q22-5-1.rq, Q22-5-2.rq, Q22-5-3.rq, Q22-5-4.rq, <br /> Q22-6-1.rq, Q22-6-2.rq, Q22-6-3.rq, Q22-6-4.rq, <br /> Q22-7-1.rq, Q22-7-2.rq, Q22-7-3.rq, Q22-7-4.rq, <br /> Q22-8-1.rq, Q22-8-2.rq, Q22-8-3.rq, Q22-8-4.rqChecking a support of the geospatial functions geof:sfEquals, geof:sfDisjoint, geof:sfIntersects, geof:sfTouches, geof:sfCrosses, geof:sfWithin, geof:sfContains and geof:sfOverlaps
R23Q23-1-1.rq, Q23-1-2.rq, Q23-1-3.rq, Q23-1-4.rq, <br /> Q23-2-1.rq, Q23-2-2.rq, Q23-2-3.rq, Q23-2-4.rq, <br /> Q23-3-1.rq, Q23-3-2.rq, Q23-3-3.rq, Q23-3-4.rq, <br /> Q23-4-1.rq, Q23-4-2.rq, Q23-4-3.rq, Q23-4-4.rq, <br /> Q23-5-1.rq, Q23-5-2.rq, Q23-5-3.rq, Q23-5-4.rq, <br /> Q23-6-1.rq, Q23-6-2.rq, Q23-6-3.rq, Q23-6-4.rq, <br /> Q23-7-1.rq, Q23-7-2.rq, Q23-7-3.rq, Q23-7-4.rq, <br /> Q23-8-1.rq, Q23-8-2.rq, Q23-8-3.rq, Q23-8-4.rqChecking a support of the geospatial functions geof:ehEquals, geof:ehDisjoint, geof:ehMeet, geof:ehOverlap, geof:ehCovers, geof:ehCoveredBy, geof:ehInside and geof:ehContains
R24Q24-1-1.rq, Q24-1-2.rq, Q24-1-3.rq, Q24-1-4.rq, <br /> Q24-2-1.rq, Q24-2-2.rq, Q24-2-3.rq, Q24-2-4.rq, <br /> Q24-3-1.rq, Q24-3-2.rq, Q24-3-3.rq, Q24-3-4.rq, <br /> Q24-4-1.rq, Q24-4-2.rq, Q24-4-3.rq, Q24-4-4.rq, <br /> Q24-5-1.rq, Q24-5-2.rq, Q24-5-3.rq, Q24-5-4.rq, <br /> Q24-6-1.rq, Q24-6-2.rq, Q24-6-3.rq, Q24-6-4.rq, <br /> Q24-7-1.rq, Q24-7-2.rq, Q24-7-3.rq, Q24-7-4.rq, <br /> Q24-8-1.rq, Q24-8-2.rq, Q24-8-3.rq, Q24-8-4.rqChecking a support of the geospatial functions geof:rcc8eq, geof:rcc8dc, geof:rcc8ec, geof:rcc8po, geof:rcc8tppi, geof:rcc8tpp, geof:rcc8ntpp and geof:rcc8ntppi
<tr><th colspan="3">RDFS entailment extension (RDFSE)</th></tr>
R25Q25-1.rq, Q25-2.rq, Q25-3.rqChecking if the system supports selecting both materialized RDF triples, as well as inferred RDF triples based on the RDFS Entailment Regime
R26Q26-1.rq, Q26-2.rqChecking if the system supports selecting both materialized RDF triples, as well as inferred RDF triples based on the RDFS/OWL class hierarchy of geometry types from Simple Features
R27Q27.rqChecking if the system supports selecting both materialized RDF triples, as well as inferred RDF triples based on the RDFS/OWL class hierarchy of geometry types of the GML schema
<tr><th colspan="3">Query rewrite extension (QRW)</th></tr>
R28Q28-1.rq, Q28-2.rq, Q28-3.rq, Q28-4.rq, <br /> Q28-5.rq, Q28-6.rq, Q28-7.rq, Q28-8.rqTesting the properties geor:sfEquals, geor:sfDisjoint, geor:sfIntersects, geor:sfTouches, geor:sfCrosses, geor:sfWithin, geor:sfContains and geor:sfOverlaps using both materialized RDF triples and inferred RDF triples
R29Q29-1.rq, Q29-2.rq, Q29-3.rq, Q29-4.rq, <br /> Q29-5.rq, Q29-6.rq, Q29-7.rq, Q29-8.rqTesting the properties geor:ehEquals, geor:ehDisjoint, geor:ehMeet, geor:ehOverlap, geor:ehCovers, geor:ehCoveredBy, geor:ehInside and geor:ehContains using both materialized RDF triples and inferred RDF triples
R30Q30-1.rq, Q30-2.rq, Q30-3.rq, Q30-4.rq, <br /> Q30-5.rq, Q30-6.rq, Q30-7.rq, Q30-8.rqTesting the properties geor:rcc8eq, geor:rcc8dc, geor:rcc8ec, geor:rcc8po, geor:rcc8tppi, geor:rcc8tpp, geor:rcc8ntpp and geor:rcc8ntppi using both materialized RDF triples and inferred RDF triples

Acknowledgement

The benchmark has been developed as part of the HOBBIT and SAGE research projects.