At the SBML Forum in Heidelberg on the 14th and 15th October 2004 we
announced
the beta release of the SBML Semantic Test Suite. The semantic test suite
consists of a set of SBML models each with correct simulation output. The
test suite comes with automation facilities that allow a suitably wrapped
simulator to be systematically tested against the test suite. The
automation
scripts are portable and should run on both Windows, Unix and Unix like
platforms. In its beta version the test suite is reasonably comprehensive
covering
all the MathML functions and operators, all types of rules, all possible
configurations of reactions and different configurations of local and global
parameters.
Whilst the beta version of the suite is useable we hope to release the first
production release of the suite before next year. This will include the
following work:
- complete coverage of the SBML standard
- clean up of file naming scheme
- creation of plots showing both correct result and simulator result
together
- parameterized test criteria
- placing the suite under CVS in sourceforge
- further testing against more simulators
The goal of the test suite is to test the interpretation of SBML by
simulators
rather than benchmarking their performance. We strongly encourage simulator
developers to test their simulators with the suite and to make the results
available.
We also encourage debate as how we can develop a set of web accessible
simulator
reviews based on the suite.
yours
Andrew Finney
+44 (0)1453 549548
from US - 011 44 1453 549548
University of Hertfordshire, UK
Fellow at the Molecular Sciences Institute, USA http://www.sbml.org/
| 
19 Oct '04 07:59
