1. Introduction
The dynamic simulation of quantitative biological models belongs to the key aspects of research in systems biology [
1]. Biological network models are typically encoded in Extensible Markup Language (XML)-based description formats [
2], such as the Systems Biology Markup Language (SBML) [
3]. In the most common scenario, such a model can be interpreted in terms of an ordinary differential equation (ODE) system with additional constructs, such as discrete events, delays, or algebraic rules [
4,
5]. A graphical display of the resulting curves can greatly facilitate the analysis of the system. The calculation of these dynamics requires the initial values of each model component to be known, including the concentration of reactive species as well as parameters, such as Michaelis constants. However, in many cases some of these values are missing or at least uncertain [
6,
7]. This makes their estimation or adjustment with respect to given experimental data necessary [
8] (e.g., available in Gene Expression Omnibus [
9] or KiMoSys databases [
10]). To this end, heuristic optimization routines can be applied to fit the model to the experimental data. Nature-inspired optimization methods are known to handle even highly nonlinear optimization problems [
11]. The basic idea of these methods is that many natural processes can be seen as optimization tasks, for instance the evolution of a population or the flight of a swarm of birds. In several applications, the Java
TM framework EvA2 [
12] has been shown to be promising for the optimization of biological systems [
11,
13,
14,
15,
16].
Many systems biology simulation and optimization frameworks are available, e. g., AMIGO [
17], SBToolbox2 [
18], SBML-PET [
19], COPASI [
20], or Potters-Wheel [
21]. The focus of SBMLsimulator is to provide the scientific community with an easily usable and flexible parameter estimation tool that understands and supports all aspects of the modeling format SBML through all of its levels and versions. Programs that do not completely cover the full standard, might have run-time advantages under certain conditions, but cannot guarantee that all models can be solved. Important features of SBMLsimulator include that it (a) is a free platform-independent open-source solution (b) does not depend on any commercial software (c) fully supports all specifications of SBML (d) comes with an easily usable program layout.
The SBMLsimulator project unifies two powerful libraries in one tool with a common user interface. Consequently, SBMLsimulator benefits from all the optimization algorithms provided by EvA2 [
12] and as well as from all the modeling languages and ODE solvers that the Systems Biology Simulation Core Library (SBSCL) makes available. This modular program design opens the door to independently extend and exchange both libraries. SBMLsimulator hence evolves with the improvements of either one of its underlying libraries. With little effort, SBMLsimulator can then be modified to take advantage on all enhancements. The SBSCL already supports all elements of SBML and comprises several ODE solvers including a solver for stiff ODE systems (for a comparison of SBSCL to related simulation frameworks see [
5] and the up-to-date comparisons of the SBML standard compliance [
22]). EvA2 provides a plethora of nature-inspired heuristic optimization algorithms, such as evolution strategies [
23], genetic algorithm [
24], differential evolution [
25], and particle swarm optimization [
26], and many more. Teams of core developers maintain both open-source libraries SBSCL and EvA2 that can also be easily extended by the scientific community.
2. Implementation
The simulation of a model is done with the SBSCL [
5] and JSBML [
27] is used as internal data structure for model representation. The SBSCL outputs the simulation results in a specific format, which enables SBMLsimulator to plot the time course of the model’s species.
The basis of all those routines is a target function for model calibration, the so-called fitness function. Given a set of parameter values and experimental data, this function returns a value to EvA2 that reflects the quality of the current model configuration. That is, how precise the given set of parameters can reproduce the experimental data. For model calibration, the fitness is a distance function between simulation output and experimental data. Both, simulation and distance, are computed by the SBSCL. EvA2 optimizes the parameters of the model with respect to the fitness function. Hence, EvA2 tries to find a parameter set that accounts for the smallest possible deviation of simulation results and the given experimental data set. Before a parameter estimation can be performed, optimization targets and search intervals need to be specified by the user (see description in Results section).
The estimation with EvA2 can take several hours or days, as for each fitness evaluation a simulation has to be conducted. Hence, the time of one simulation run greatly influences the time needed for parameter estimation. Such parameter estimations will often be conducted in the command-line mode, which is an alternative to the graphical user interface (GUI) that SBMLsimulator launches by default. However, in the GUI mode the simulation results of the current parameter combination producing the best fitness are always plotted in SBMLsimulator. This enables the user to investigate intermediate results.
3. Results and Discussion
SBMLsimulator is straightforward to use and runs on every platform where a Java Virtual Machine is available. Its graphical user interface provides an intuitive way for displaying the curves of model entities chosen by the user. In addition, it comprises a graphical and command-line user interface that both provide a connection to EvA2. The program estimates all uncertain quantities with respect to given time-series of metabolite or gene expression values.
3.1. Graphical User Interface
The graphical user interface (see
Figure 1) comprises several separated sub-windows for the presentation of simulation results as well as for settings that can be modified by the user: at the lower part of the GUI, SBMLsimulator enables the user to choose the numerical solver and to set the start and end point as well as the step size of the simulation. For some solvers an error tolerance can also be specified under Edit/Preferences. The user also has the choice between different quality functions for calculating the distance between simulated and experimental data. The upper left part of the window allows the user to select, which model quantities should be plotted. Furthermore, the compartment, parameter and initial values of metabolites can be modified in the middle left part. Finally, the simulation of the model with the chosen settings can be conducted by one of the GUI’s control elements.
A dedicated dialog assists with the import of experimental data. SBMLsimulator suggests the most intuitive mapping of columns in the experimental data to model quantities. The user can then confirm this suggestion or adapt the mapping accordingly. The given experimental data are plotted together with the simulation results (as shown in
Figure 1) in the user interface in order to facilitate the comparison with the simulation results of the model. Furthermore, after model simulation, the distance of the simulated data to the loaded experimental data is computed and displayed at the bottom of the SBMLsimulator window.
Figure 1.
The graphical user interface (GUI) of The Systems Biology Markup Language (SBML)simulator. The figure shows the main window of SBMLsimulator after importing the model by Bucher
et al. [
28]. SBMLsimulator enables the user to modify initial quantities (middle left part of window) and to choose the quantities for plotting (upper left). Furthermore, at the bottom of the window the user can specify settings for simulation, such as the integration routine, the simulation start and end time, the simulation step size, and the quality function for comparing the simulated data to experimental data. The simulation can be started by clicking on the simulation button. The right part shows an intermediate solution, whereby the original values are depicted by shapes and the simulated values dependent on the current set of parameters are shown as curves. In the given state, the parameter optimization already found a set of parameters that fit the predefined values with a small error.
Figure 1.
The graphical user interface (GUI) of The Systems Biology Markup Language (SBML)simulator. The figure shows the main window of SBMLsimulator after importing the model by Bucher
et al. [
28]. SBMLsimulator enables the user to modify initial quantities (middle left part of window) and to choose the quantities for plotting (upper left). Furthermore, at the bottom of the window the user can specify settings for simulation, such as the integration routine, the simulation start and end time, the simulation step size, and the quality function for comparing the simulated data to experimental data. The simulation can be started by clicking on the simulation button. The right part shows an intermediate solution, whereby the original values are depicted by shapes and the simulated values dependent on the current set of parameters are shown as curves. In the given state, the parameter optimization already found a set of parameters that fit the predefined values with a small error.
Besides the main window (Simulation), which shows the simulation results and enables the modification of simulation settings, there are also windows for displaying the simulation data (Computed data) and the imported experimental data (Experimental data) in table format. Furthermore, the user has the possibility to investigate the structure of the model in another window (Model).
Besides a comparison with simulated values, the import of experimental data facilitates a parameter estimation with respect to that data is possible. The user needs to specify the parameters as well as their ranges in a dedicated window. An alternative provided to set the parameters in this window, is to import a text file listing the parameters to estimate and their ranges. After the user has chosen the parameters and their limits, the user can select the type of evolutionary algorithm and change specific settings of the desired routine in EvA2. Eva2 lets the user choose between a large number of different optimization routines including hill climbing [
29], simulated annealing [
30], evolution strategies [
23,
31] with support for covariance matrix adaptation [
32], genetic algorithm [
24], differential evolution [
25,
33], and particle swarm optimization [
26,
34,
35] as well as multi-modal approaches [
15].
3.2. Parameter Estimation Study
In order to assess the capabilities of SBMLsimulator, we estimated the parameters of a model by Bucher
et al. [
28] explaining the biotransformation of atorvastatin (model BIOMD0000000328 of BioModels Database [
36]). We first obtained an artificial data set by simulating the model with the respective start and end time described in the publication. We saved the simulated data and extracted time points similar to those used in the publication. This data set was then read in by SBMLsimulator, the parameters were deleted from the model, and optimization with EvA2 was launched with respect to the artificial data set using differential evolution [
25]. The same parameters as in the publication were estimated with the intervals given in
Table 1.
Here initial minimum/maximum stands for the interval, in which the parameters are randomly initiated, and minimum/maximum for the interval during the estimation procedure. We chose the same intervals for initiation and parameter estimation. The numerical integration was conducted with a Rosenbrock solver [
37] (absolute error tolerance:
, relative error tolerance:
), as this routine is suitable for solving stiff differential equation systems. As fitness function we used the relative squared error, which has been suggested by, e.g., Dräger
et al. [
11,
38].
During an optimization, SBMLsimulator plots the best simulation curves together with the respective data each time it has finished processing a new generation of parameter combinations.
Figure 1 shows such an intermediate result for the artificial data set. Hence, the user can nicely see how the distance between the simulated time course and data set drastically decreases over time. For such large-scale parameter estimations it is most suitable to run SBMLsimulator in command-line mode, because it can take a long time (see
Section 5) and this task can then be performed on a computer cluster. Running parameter estimations on a computer cluster is also recommended, because estimations are usually conducted multiple times. This is done because an optimization run can get stuck in a local optimum of the fitness function. Another reason for repeating a parameter estimation multiple times is that this is a straightforward way to assess whether the estimated quantities are identifiable [
39]. In order to test the identifiability of the parameters with SBMLsimulator, we estimated the model quantities of the atorvastatin biotransformation model 100 times on a computer cluster. Afterwards those 50% of the parameter estimates with the best fits were extracted and the distributions of the estimated quantity values were plotted (see
Figure 2). It can be seen that the estimated parameter values had a low standard deviation, which means that SBMLsimulator could reliably identify these parameters. A very high standard deviation of a parameter would in contrast to that have suggested that this parameter could not be identified.
Figure 2.
Distribution of parameters estimated with SBMLsimulator. One hundred parameter estimations with SBMLsimulator for the model by Bucher
et al. [
28] were run on a computer cluster. The distribution of the 50 estimations with the best fitness values is shown here. For each parameter the estimated values were divided by the original parameter value prior to plotting. It is obvious from the plot that all parameters were estimated closely around their original values. The figure has been created with R software package [
40].
Figure 2.
Distribution of parameters estimated with SBMLsimulator. One hundred parameter estimations with SBMLsimulator for the model by Bucher
et al. [
28] were run on a computer cluster. The distribution of the 50 estimations with the best fitness values is shown here. For each parameter the estimated values were divided by the original parameter value prior to plotting. It is obvious from the plot that all parameters were estimated closely around their original values. The figure has been created with R software package [
40].
The results of this experiment show that our linkage of parameter estimation and simulation works well.
Table 1.
Estimated parameters with units, their initial intervals and their intervals throughout parameter estimation for the model by Bucher
et al. [
28].
Table 1.
Estimated parameters with units, their initial intervals and their intervals throughout parameter estimation for the model by Bucher et al. [28].
Parameter | Unit | Minimum Initial Value | Maximum Initial Value | Minimum Value | Maximum Value |
---|
Import_ASLpOH_k | | | 0.1 | | 0.1 |
Import_ASLoOH_k | | | 0.1 | | 0.1 |
Import_ASpOH_k | | | 0.1 | | 0.1 |
Export_ASLpOH_k | | | 0.1 | | 0.1 |
Export_ASLoOH_k | | | 0.1 | | 0.1 |
Export_ASoOH_k | | | 0.1 | | 0.1 |
Export_AS_k | | | 0.1 | | 0.1 |
Export_ASL_k | | | 0.1 | | 0.1 |
Import_AS_k | | | 0.1 | | 0.1 |
Import_ASoOH_k | | | 0.1 | | 0.1 |
Export_ASpOH_k | | | 0.1 | | 0.1 |
k_PON_OH_c | | | 0.1 | | 0.1 |
k_PON_ASL_c | | | 0.1 | | 0.1 |
Import_ASL_k | | | 1 | | 1 |
fu_AS | dimensionless | | 1 | | 1 |
fu_ASL | dimensionless | | 1 | | 1 |
CYP3A4_ASoOH_Vmax | | | 100 | | 100 |
CYP3A4_ASLpOH_Vmax | | | 100 | | 100 |
CYP3A4_ASLoOH_Vmax | | | 100 | | 100 |
CYP3A4_ASpOH_Vmax | | | 100 | | 100 |
UGT1A3_AS_Vmax | | | 100 | | 100 |
4. Conclusions
With SBMLsimulator we provide a freely usable platform-independent tool for simulation and parameter estimation of biochemical models, which fully supports all SBML elements. It combines two powerful toolboxes under one graphical interface: SBSCL for simulation and the nature-inspired optimization framework EvA2 for estimation of uncertain parameter values. SBMLsimulator is useful for both, the interactive simulation and exploration of the parameter space and for the large-scale model calibration. With a parameter estimation study based on a published model we have demonstrated its capability to identify model parameters with respect to experimental data. SBMLsimulator allows users to easily run models and to calibrate them to their experiments, to learn about simulation, or to gain new insight into the model’s behavior by modifying individual parameters or model components. All this is facilitated by the platform independence of SBMLsimulator. Since the SBSCL is also an open-source library, the user can even modify how different elements of a model are interpreted and learn from deviating simulation results. For large-scale simulation experiments, the use of native libraries can offer an advantage with respect to calculation speed. However, with a comprehensive command-line interface SBMLsimulator can also easily be deployed on a computer cluster to perform several simulations in parallel. A comprehensive users’ guide is available on the project’s homepage, which describes all program features and their use in detail.
In future versions of SBMLsimulator we are planning to include the possibility that the parameter search is conducted in log-scale. As the parameters are often of different magnitudes, this log-scale can be of advantage [
16]. In order to satisfy the growing interest in other modeling languages like the Cell Markup Language (CellML) [
41], SBMLsimulator should also be able to simulate models given in a different format. To this end, the SBSCL needs to be extended and after some minor modifications SBMLsimulator will gain the capability to simulate models in different formats, such as the simulation of models given in CellML similar to CellMLSimulator [
42].
5. Availability and Requirements
The current version of SBMLsimulator is available at the project’s homepage as a runnable JavaTM archive file (JAR) together with a documentation of the program.
Project name: SBMLsimulator
Operating systems: Platform independent, i.e., for all systems for which a JavaTM Virtual Machine (JVM) is available.
Programming language: JavaTM
Other requirements: JavaTM Runtime Environment (JRE) 1.6 or above
License: GNU Lesser General Public License (LGPL) version 3
Acknowledgments
The authors thank Stephanie Hoffmann, Benjamin Kandel, Marcus Klein, Maria Thomas, Ulrich M. Zanger, and Bernhard Ø. Palsson for fruitful discussions, Marcel Kronfeld who helped implementing the connection to EvA2, and the students Max Zwießele and Philipp Stevens for implementing parts of the plot function.
This work was funded by the Federal Ministry of Education and Research (BMBF, Germany) in the project Virtual Liver Network (BMBF, Germany, grant number 0315756), the European Commission as part of a Marie Curie International Outgoing Fellowship within the EU 7th Framework Program for Research and Technological Development (EU project AMBiCon, 332020), and a National Institute of Health grant for the continued development of essential SBML software support (NIH, USA, award number GM070923).
Author Contributions
AlD and RK contributed equally, implemented the majority of the source code, and declare shared first authorship. AnD initialized and coordinated the project, drafted the manuscript, and supervised the work together with AZ. All authors contributed to the implementation, read and approved the final manuscript.
Abbreviations/Nomenclature
AMIGO | Advanced Model Identification in systems biology using Global Optimization |
COPASI | COmplex PAthway SImulator |
CellML | Cell Markup Language |
GUI | graphical user interface |
JAR | JavaTM archive file |
JRE | JavaTM Runtime Environment |
JSBML | JavaTM SBML |
JVM | JavaTM Virtual Machine |
LGPL | GNU Lesser General Public License |
ODE | ordinary differential equation |
SBML | Systems Biology Markup Language |
SBML-PET | SBML Parameter Estimation Tool |
SBSCL | Systems Biology Simulation Core Library |
XML | Extensible Markup Language |
Conflicts of Interest
The authors declare no conflict of interest.
References
- Jamshidi, N.; Wiback, S.J.; Palsson, B.Ø. In Silico Model-Driven Assessment of the Effects of Single Nucleotide Polymorphisms (SNPs) on Human Red Blood Cell Metabolism. Genome Res. 2002, 12, 1687–1692. [Google Scholar] [CrossRef] [PubMed]
- Dräger, A.; Palsson, B.Ø. Improving collaboration by standardization efforts in systems biology. Front. Bioeng. 2014, 2. [Google Scholar] [CrossRef]
- Hucka, M.; Finney, A.; Bornstein, B.J.; Keating, S.M.; Shapiro, B.E.; Matthews, J.; Kovitz, B.L.; Schilstra, M.J.; Funahashi, A.; Doyle, J.C.; et al. Evolving a lingua franca and associated software infrastructure for computational systems biology: The Systems Biology Markup Language (SBML) project. Syst. Biol. IEE 2004, 1, 41–53. [Google Scholar] [CrossRef]
- Dräger, A.; Planatscher, H. Encyclopedia of Systems Biology; Springer-Verlag: New York, NY, USA, 2013; pp. 1249–1251. [Google Scholar]
- Keller, R.; Dörr, A.; Tabira, A.; Funahashi, A.; Ziller, M.J.; Adams, R.; Rodriguez, N.; Le Novère, N.; Hiroi, N.; Planatscher, H.; et al. The systems biology simulation core algorithm. BMC Syst. Biol. 2013, 7, 55. [Google Scholar] [CrossRef] [PubMed]
- Costa, R.; Machado, D.; Rocha, I.; Ferreira, E. Critical perspective on the consequences of the limited availability of kinetic data in metabolic dynamic modelling. IET Syst. Biol. 2011, 5, 157–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Chen, N.; Del, V.I.; Kyriakopoulos, S.; Polizzi, K.; Kontoravdi, C. Metabolic network reconstruction: Advances in in silico interpretation of analytical information. Curr. Opin. Biotechnol. 2012, 23, 77–82. [Google Scholar] [CrossRef] [PubMed]
- Dräger, A.; Planatscher, H. Encyclopedia of Systems Biology; Springer-Verlag: New York, NY, USA, 2013; pp. 1627–1631. [Google Scholar]
- Barrett, T.; Wilhite, S.E.; Ledoux, P.; Evangelista, C.; Kim, I.F.; Tomashevsky, M.; Marshall, K.A.; Phillippy, K.H.; Sherman, P.M.; Holko, M.; et al. NCBI GEO: Archive for functional genomics data sets-update. Nucl. Acids Res. 2013, 41, 991–995. [Google Scholar] [CrossRef]
- Costa, R.S.; Veríssimo, A.; Vinga, S. KiMoSys: A web-based repository of experimental data for KInetic MOdels of biological SYStems. BMC Syst. Biol. 2014, 8, 85. [Google Scholar] [CrossRef] [PubMed]
- Dräger, A.; Kronfeld, M.; Ziller, M.J.; Supper, J.; Planatscher, H.; Magnus, J.B.; Oldiges, M.; Kohlbacher, O.; Zell, A. Modeling metabolic networks in C. glutamicum: A comparison of rate laws in combination with various parameter optimization strategies. BMC Syst. Biol. 2009, 3, 5. [Google Scholar] [CrossRef] [PubMed]
- Kronfeld, M.; Planatscher, H.; Zell, A. The EvA2 Optimization Framework. In Learning and Intelligent Optimization; Blum, C., Battiti, R., Eds.; Springer Verlag: Venice, Italy, 2010; pp. 247–250. [Google Scholar]
- Dräger, A.; Supper, J.; Planatscher, H.; Magnus, J.B.; Oldiges, M.; Zell, A. Comparing Various Evolutionary Algorithms on the Parameter Optimization of the Valine and Leucine Biosynthesis in Corynebacterium glutamicum. In Proceedings of the 2007 IEEE Congress on Evolutionary Computation, Singapore, 25–28 September 2007; pp. 620–627.
- Dräger, A.; Kronfeld, M.; Supper, J.; Planatscher, H.; Magnus, J.B.; Oldiges, M.; Zell, A. Benchmarking Evolutionary Algorithms on Convenience Kinetics Models of the Valine and Leucine Biosynthesis in C. glutamicum. In Proceedings of the 2007 IEEE Congress on Evolutionary Computation, Singapore, 25–28 September 2007; pp. 896–903.
- Kronfeld, M.; Dräger, A.; Aschoff, M.; Zell, A. On the Benefits of Multimodal Optimization for Metablic Network Modeling. In Proceedings of the German Conference on Bioinformatics, Halle, Germany, 30 September 2009; pp. 191–200.
- Raue, A.; Schilling, M.; Bachmann, J.; Matteson, A.; Schelke, M.; Kaschek, D.; Hug, S.; Kreutz, C.; Harms, B.D.; Theis, F.J.; Klingmüller, U.; Timmer, J. Lessons Learned from Quantitative Dynamical Modeling in Systems Biology. PLoS ONE 2013, 8, e74335. [Google Scholar] [CrossRef] [PubMed]
- Balsa-Canto, E.; Banga, J.R. AMIGO, a toolbox for advanced model identification in systems biology using global optimization. Bioinformatics 2011, 27, 2311–2313. [Google Scholar] [CrossRef] [PubMed]
- Schmidt, H.; Jirstrand, M. Systems Biology Toolbox for MATLAB: A computational platform for research in systems biology. Bioinformatics 2006, 22, 514–515. [Google Scholar] [CrossRef] [PubMed]
- Zi, Z.; Klipp, E. SBML-PET: A Systems Biology Markup Language-based parameter estimation tool. Bioinformatics 2006, 22, 2704–2705. [Google Scholar] [CrossRef] [PubMed]
- Hoops, S.; Sahle, S.; Gauges, R.; Lee, C.; Pahle, J.; Simus, N.; Singhal, M.; Xu, L.; Mendes, P.; Kummer, U. COPASI—A COmplex PAthway SImulator. Bioinformatics 2006, 22, 3067–3074. [Google Scholar] [CrossRef] [PubMed]
- Maiwald, T.; Timmer, J. Dynamical modeling and multi-experiment fitting with PottersWheel. Bioinformatics 2008, 24, 2037–2043. [Google Scholar] [CrossRef] [PubMed]
- Bergmann, F.T.; Hucka, M.; Smith, L.; Keating, S.M. SBML Test Suite Database. Available online: http://sbml.org/Facilities/Database/ (accessed on 17 December 2014).
- Rechenberg, I. Evolutionsstrategie: Optimierung Technischer Systeme nach Prinzipien der Biologischen Evolution; Frommann-Holzboog: Stuttgart, Germany, 1973. (In German) [Google Scholar]
- Holland, J. Adaptation in Natural and Artificial Systems; University of Michigan Press: Ann Arbor, MI, USA, 1975. [Google Scholar]
- Storn, R.; Price, K. Differential evolution—A simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Opt. 1997, 11, 341–359. [Google Scholar] [CrossRef]
- Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; Volume 4, pp. 1942–1948.
- Dräger, A.; Rodriguez, N.; Dumousseau, M.; Dörr, A.; Wrzodek, C.; le Novère, N.; Zell, A.; Hucka, M. JSBML: A flexible Java library for working with SBML. Bioinformatics 2011, 27, 2167–2168. [Google Scholar] [CrossRef] [PubMed]
- Bucher, J.; Riedmaier, S.; Schnabel, A.; Marcus, K.; Vacun, G.; Weiss, T.S.; Thasler, W.E.; Nüssler, A.K.; Zanger, U.M.; Reuss, M. A systems biology approach to dynamic modeling and inter-subject variability of statin pharmacokinetics in human hepatocytes. BMC Syst. Biol. 2011, 5, 66. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Tovey, C.A. Hill climbing with multiple local optima. SIAM J. Algebr. Discret. Methods 1985, 6, 384–393. [Google Scholar] [CrossRef]
- Kirkpatrick, S.; Gelatt, C.D.; Vecchi, M.P. Optimization by Simulated Annealing. Science 1983, 220, 671–680. [Google Scholar] [CrossRef] [PubMed]
- Schwefel, H.P. Evolutionsstrategie und Numerische Optimierung. Ph.D. Thesis, Department of Process Engineering, Technical University of Berlin, Berlin, Germany, 1975. [Google Scholar]
- Hansen, N.; Ostermeier, A. Completely Derandomized Self-Adaptation in Evolution Strategies. Evolut. Comput. 2001, 9, 159–195. [Google Scholar] [CrossRef] [PubMed]
- Storn, R. On the Usage of Differential Evolution for Function Optimization. In Proceedings of the 1996 Biennial Conference of the North American Fuzzy Information Processing Society, Berkeley, CA, USA, June 1996; pp. 519–523.
- Clerc, M.; Kennedy, J. The Particle Swarm—Explosion, Stability, and Convergence in a Multidimensional Complex Space. IEEE Trans. Evolut. Comput. 2002, 6, 58–73. [Google Scholar] [CrossRef]
- Clerc, M. Particle Swarm Optimization; ISTE Ltd.: London, UK, 2005; pp. 139–149. [Google Scholar]
- Chelliah, V.; Laibe, C.; le Novère, N. BioModels Database: A Repository of Mathematical Models of Biological Processes. In In Silico Systems Biology; Schneider, M.V., Ed.; Springer: New York, NY, USA, 2013; Volume 1021, pp. 189–199. [Google Scholar]
- Press, W.H.; Teukolsky, S.A.; Vetterling, W.T.; Flannery, B.P. Numerical Recipes in FORTRAN; The Art of Scientific Computing; Cambridge University Press: New York, NY, USA, 1993. [Google Scholar]
- Dräger, A. Computational Modeling of Biochemical Networks. Ph.D. Thesis, University of Tuebingen, Tübingen, Germany, 31 March 2011. [Google Scholar]
- Schilling, M.; Maiwald, T.; Hengl, S.; Winter, D.; Kreutz, C.; Kolch, W.; Lehmann, W.D.; Timmer, J.; Klingmüller, U. Theoretical and experimental analysis links isoform-specific ERK signalling to cell fate decisions. Mol. Syst. Biol. 2009, 5. [Google Scholar] [CrossRef] [PubMed]
- R Development Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2008. [Google Scholar]
- Cooling, M.T. A Primer on Modular Mass-Action Modelling with CellML. In Systems Biology for Signaling Networks; Choi, S., Ed.; Springer: New York, NY, USA, 2010; Volume 1, pp. 721–750. [Google Scholar]
- Nickerson, D.P.; Corrias, A.; Buist, M.L. Reference descriptions of cellular electrophysiology models. Bioinformatics 2008, 24, 1112–1114. [Google Scholar] [CrossRef] [PubMed]
© 2014 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).