Submit results

Before submitting micro-benchmark results, please become a MemBeR.

For submitting micro-benchmark results, you need to create a webpage that contains detailed information about the benchmark execution and the results, and you need to provide detailed information about the benchmark execution and indicate the URL of the webpage with the results in XML format.

First, create a webpage that contains the following:
  • The name and the title of the micro-benchmark and a link to its MemBeR page.
  • The description of the running scenario(s), including the description of all micro-benchmark parameters and their values. The parameter values should correspond to the values described in the micro-benchmark, i.e. should fall in the same value range or should coincide with the given values. If the running scenario coincides with one described in the micro-benchmark, just say so (refer to the the micro-benchmark by its name!)
  • Hard- and software specifications of the machine on which you run the experiments, including
    • CPU - includes at least name, version, configuration parameters (if other than default), reference to the system website when available.
    • main memory size
    • hard disk - characterization of the hard disk used by the system (brand, transfer speed...) This is needed especially if the cold execution results are reported.
    • OS
  • List the XQuery engines that you ran. Don't forget to mention all the important specification of the programs, like
    • version,
    • programming language,
    • compile optimizations, if any,
    and other special options that might influence the results.
  • Besides this,describe the running enviroment for each engine:
    • main memory allocation - the main memory available to the system under test for performing the measure.
    • hot or cold cache - specify whether the measures are made "hot" or "cold" (whether the same query has been executed previously in the same environment on the same document, or not).
    • number of runs - specify the number of runs over which the average execution time is reported.
  • And finally, the actual results. Please, make sure that the results are easily readable and interpretable.

Second, describe this information in an XML file that is valid with respect to the DTD mb-results.dtd. For your convinience we created a template file resid.tmpl containing the structure of the micro-benchmark results report without any content. You can fill in the text and the attribute values in your favorite editor for XML and submit the resulting document. For examples of result reports see the results that are already in the repository.

Once you have these, you are ready to submit your results to MemBeR by uploading your XML file here:

Load the XML file containing the results report:

*Please, make sure that the document you want to submit is valid with respect to the provided DTD!

If you have any question regarding the submission of the results, please contact Loredana Afanasiev.