![]() |
|
|
About XCheck Documentation Adapters Download Examples Contacts |
About XCheck XCheck is an open source software for automatic execution of a benchmark on XML query processors (XPath and XQuery processors). Running a benchmark on different applications takes a lot of time and usually generates huge amounts of raw data. Moreover, interpreting the outcomes of the evaluation is a subtle and crucially important task. The main goals of XCheck are to automatize some of the tasks involved in the practice of benchmarking XML query processors (or query engines) and, most importantly, to help the user to spot the weaknesses of a given processor and to compare the performance of the different engines under evaluation. XCheck focuses on performance benchmarks, as opposed to correctness benchmarks. Thus, the benchmarks do not need to specify correct answers. Nevertheless, XCheck helps to detect incorrect answers by comparing the sizes of the query results obtained from different engines. XCheck works in two phases: running and data analysis. In the running phase XCheck executes the benchmark on available XML engines and stores the engine execution times that it measures itself, as well as the execution times that the engines output. Optionally, it also stores the benchmark query results. In the data analysis phase XCheck elaborates some statistics on the execution times gathered in the previous phase. As a result it generates performance reports (in HTML format) containing lots of plots (in PostScript and PNG formats). XCheck makes plots using Gnuplot, a free software for generating plots. |
ISLA, University of Amsterdam (The Netherlands) XCheck is released under the GNU General Public License. |
|