Overview

XQuery is a feature rich language with complex semantics. This makes it hard to come up with a benchmark suite which covers all performance-critical features of the language, and at the same time allows one to individually validate XQuery evaluation techniques.

This is why we created this micro-benchmark repository, allowing the evaluation of an XQuery implementation with respect to precise evaluation techniques. We are convinced that a fixed set of queries is probably insufficient to allow the testing of various performance aspects. Thus, users will be able to add new data sets and/or queries for specific performance assessment tasks. These new benchmarks will be then validated via a peer-review process.

For a quick start with the MemBeR repository, please read about:

• micro-benchmarks
• the repository

Besides the MemBeR repository, this site contains links to:

• XCheck - a tool that facilitates running and interpreting the benchmark results on XQuery engines.
• Other XQuery benchmarks - a list of all published and publically available XQuery benchmarks (XMach-1, XMark, X007, the Michigan benchmark, and XBench), a syntactically correct version of their queries and the benchmark results on Galax, SaxonB, Qizx/Open, and MonetDB/XQuery.
• Open-source engines - a list of all open-source XQuery engines.

For more details about our ideas and the repository, please read: MemBeR: A Micro-Benchmark Repository for XQuery, Project Description.