Team:USP-UNESP-Brazil/Associative Memory/Modeling
From 2012.igem.org
Line 121: | Line 121: | ||
<h1 id="discussion">Discussion</h1> | <h1 id="discussion">Discussion</h1> | ||
+ | The Associative Memory Network project was based on a mathematical formulation of a neural network developed in 1982 by John Hopfield [3]. In order to connect the bacteria behavior during quorum sensing to a Hopfield network, we introduced an interaction between two populations in a mathematical model for quorum sensing, in order to represent neuronal repression/activation. Through steady-state analysis, it was possible to find up to four equilibrium points, representing the activation of both populations, activation of one population and repression of the other, and repression of both populations. The existence of these steady-state solutions depends on the set of parameters, and stability analysis is being conducted to answer which regions in parameter space guarantee stability of each equilibria. | ||
+ | However, numerical simulations indicate that the carrying capacity $K$ is a fundamental parameter in the determination of the stability of quorum-state fixed points: changing its value had no effect on the location of these equilibria in $(x,y)$ space, but Figure 1 shows increasing $K$ leads to quorum. Therefore, even though $K$ does not affect the existence of any fixed points, their stability seems to depend on its value - it would change a steady state from unstable to stable, so that for a population that would not reach quorum at a low carrying capacity might reach it when this parameter is increased. | ||
+ | |||
+ | In summary, the goal has been achieved: it was proven that two bacterial populations are able to interact through repression and activation in order to reproduce a Hopfield Network, and that different combinations of parameters and initial conditions may lead to different activation patterns: both populations activated, both repressed, or the asymetrical case - one up, one down. | ||
+ | |||
+ | Our further steps are to find the conditions for stability, and to investigate patterns on the initial conditions and the stable steady states - in other words, input and output. A network with more than two interacting populations holds a systemic memory capable of storing and responding to a much wider range of patterns - a possibility that is being now explored by our team. | ||
Line 131: | Line 137: | ||
<p>[2] http://partsregistry.org/ </p> | <p>[2] http://partsregistry.org/ </p> | ||
+ | |||
+ | <p>[3] J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities", Proceedings of the National Academy of Sciences of the USA, vol. 79 no. 8 pp. 2554–2558, April 1982.</p> | ||
{{:Team:USP-UNESP-Brazil/Templates/Foot}} | {{:Team:USP-UNESP-Brazil/Templates/Foot}} |
Revision as of 22:30, 26 September 2012
Network
Contents |
Associative Memory
We introduced a mathematical model for two populations of bacteria that interact via quorum sensing. Each population produces its own quorum sensing molecule (QSM) and the QSM of one population can be repressive or excitatory to the other population in a mechanism analogous to a neuron communication. In our case, a neuron is represented by a population of bacteria and a synapse by a communication via QSM. In our analogy, a neuron is activated when the majority of the population is in quorum, which means producing the QSM at a high rate.
Mathematical Model
Ward et al [1] introduced a mathematical model to describe the growth of populations of bacteria consisting in cell that can be either up-regulated or down-regulated. An up-regulated cell produces QSM faster than a down-regulated cell, which produces it in a basal rate. If the most bacteria in the population is up-regulated, we say the population reached the quorum. The model consists in the following differential equations:
\begin{align} \frac{d}{dt} N_{d} &= rN_{t}\Big[1 - \frac{N_{t}}{K}\Big] - \alpha A N_{d} + \beta N_{u} \\ \frac{d}{dt} N_{u} &= \alpha A N_{d} - \beta N_{u} \\ \frac{d}{dt} A &= \kappa_{u} N_{u} + \kappa_{d} N_{d} - \alpha A N_{d} - \lambda A \\ N_{t} &= N_{d} + N_{u} \end{align}
where $N_d$ and $N_u$ are the down-regulated and up-regulated subpopulations density (number of cells per volume), $A$ is the density of QSM, $\kappa_{d}$ and $\kappa_{u}$ are the QSM prodution rate of down-regulated and up-regulated, respectively. The variable $\lambda$ is the degradation rate of the QSM and $r$ is the cell-division rate. It is assumed that down-regulated cells become up-regulated by QSMs with rate constant $\alpha$ and up-regulated becomes down-regulated with the rate $\beta$.
We proposed a model for two different types of population of bacteria by introducing an interaction between them in the model proposed by Ward et al [1].
One population of bacteria are distinguishable of the other by the QSM that it produce. Lets call bacteria type A the population that produces QSM A and the same for B.
The interation is represented by an aditional term in the model that makes a type A up-regulated cells becomes down-regulated by QSM B with the rate
$\phi_B$ and vice-versa.
\begin{align} \frac{d}{dt}N_{Ad} &= rN_{At}\Big[1 - \frac{N_{At}}{K}\Big] - \alpha_A A N_{Ad} + \beta_A N_{Au} + \phi_B B N_{Au} \\ \frac{d}{dt}N_{Bd} &= rN_{Bt}\Big[1 - \frac{N_{Bt}}{K}\Big] - \alpha_B A N_{Bd} + \beta_B N_{Bu} + \phi_A A N_{Bu} \\ \frac{d}{dt}N_{Au} &= \alpha_A A N_{Ad} - \beta_A N_{Au} - \phi_B B N_{Au}\\ \frac{d}{dt}N_{Bu} &= \alpha_B B N_{Bd} - \beta_B N_{Bu} - \phi_A A N_{Bu} \\ \frac{d}{dt}A &= \kappa_{Au} N_{Au} + \kappa_{Ad} N_{Ad} - \alpha_A A N_{Ad} - \lambda_A A - \phi_A A N_{Bu} \\ \frac{d}{dt}B &= \kappa_{Bu} N_{Bu} + \kappa_{Bd} N_{Bd} - \alpha_B B N_{Bd} - \lambda_B B - \phi_B B N_{Au} \\ N_{At} &= N_{Ad}+N_{Au} \\ N_{Bt} &= N_{Bd}+N_{Bu} \end{align}
Results
We first evaluated the fraction of up-regulated cells as a function of the carrying capacity ($K$) and of the $\frac{\phi_A}{\phi_B}$ ratio, and $K$ turned out to be an important parameter of the model. For values of $K$ up to $10^8$, in the equilibrium, no population can reach the quorum state, since the density of cells is too low. On the other hand, for values higher than $10^8$ the population that has a higher repression rate, represented by $\phi$, reaches quorum and represses the other population, as presented in Figure 1.
Equilibrium points
At equilibrium point we have:
\begin{align} &-\alpha_A A N_{Ad} + \beta_A N_{Au} + \phi_B B N_{Au} &= 0 \\ &\kappa_{Au} N_{Au} + \kappa_{Ad} N_{Ad} - \alpha_A A N_{Ad} - \lambda_A A - \phi_A A N_{Bu} &= 0 \\ &-\alpha_B B N_{Bd} + \beta_B N_{Bu} + \phi_A A N_{Bu} &= 0 \\ &\kappa_{Bu} N_{Bu} + \kappa_{Bd} N_{Bd} - \alpha_B B N_{Bd} - \lambda_B B - \phi_B B N_{Au} &= 0 \\ &N_{Au} + N_{Ad} &= K \\ &N_{Bu} + N_{Bd} &= K \end{align}
These equations can be reduced to two expressions involving $x = N_{Au}/K$ and $y = N_{Bu}/K$:
\begin{align} \hspace{-0.5 cm} \frac{y(\kappa_{Bu} - \kappa_{Bd}) + \kappa_{Bd}}{\alpha_B (1-y) + \lambda^*_B + y\phi_B} = \frac{\Big[x(\kappa_{Au} - \kappa_{Ad}) + \kappa_{Ad}\Big]\alpha_A (1-x)} {\Big[\alpha_A (1-x) + \lambda^*_A + y\phi_A\Big]x\phi_B} - \frac{\beta_A}{\phi_B} \\ \hspace{-0.5 cm} \frac{x(\kappa_{Au} - \kappa_{Ad}) + \kappa_{Ad}}{\alpha_A (1-x) + \lambda^*_A + x\phi_A} = \frac{\Big[y(\kappa_{Bu} - \kappa_{Bd}) + \kappa_{Bd}\Big]\alpha_B (1-y)} {\Big[\alpha_B (1-y) + \lambda^*_B + x\phi_B\Big]y\phi_A} - \frac{\beta_B}{\phi_A} \end{align}
where $\lambda^* = \lambda/K$, and $x$ and $y$ range from 0 up to 1. These expressions are similar, since exchanging $A$ and $B$ turns one equation into the other.
Thus, the equilibrium points $(x,y)$ are placed in the intersection between the solutions for the relations above. Depending on the set of parameters, one can find two to four equilibria - the first one close to $(0,0)$, representing the repression of both populations, and the second one close to $(1,1)$, representing the activation of both populations, as presented in Fig. 2. In this case we used the parameters presented in Table 1, for 20% serum solution growth medium. The same behavior was found using the parameters for LB growth medium.
A third equilibrium point emerges when $\frac{\phi_A}{\phi_B} \gg 1$ - which means the repression of population A over population B is much greater than its counterpart, Fig. 3. In this case, the system reaches an equilibrium close to $(1,0)$: population A activated, population B repressed. The behavior is analogous if $\frac{\phi_A}{\phi_B} \ll 1$.
Finally, when both $\phi_A$ and $\phi_B$ are big when compared to $\alpha_A$ and $\alpha_B$, both populations A and B are able to
repress each other, depending on the initial conditions: there are equilibria both close to $(1,0)$ and to $(0,1)$ - with repression
of one population and activation of the other, Fig. 4.
Discussion
The Associative Memory Network project was based on a mathematical formulation of a neural network developed in 1982 by John Hopfield [3]. In order to connect the bacteria behavior during quorum sensing to a Hopfield network, we introduced an interaction between two populations in a mathematical model for quorum sensing, in order to represent neuronal repression/activation. Through steady-state analysis, it was possible to find up to four equilibrium points, representing the activation of both populations, activation of one population and repression of the other, and repression of both populations. The existence of these steady-state solutions depends on the set of parameters, and stability analysis is being conducted to answer which regions in parameter space guarantee stability of each equilibria.
However, numerical simulations indicate that the carrying capacity $K$ is a fundamental parameter in the determination of the stability of quorum-state fixed points: changing its value had no effect on the location of these equilibria in $(x,y)$ space, but Figure 1 shows increasing $K$ leads to quorum. Therefore, even though $K$ does not affect the existence of any fixed points, their stability seems to depend on its value - it would change a steady state from unstable to stable, so that for a population that would not reach quorum at a low carrying capacity might reach it when this parameter is increased.
In summary, the goal has been achieved: it was proven that two bacterial populations are able to interact through repression and activation in order to reproduce a Hopfield Network, and that different combinations of parameters and initial conditions may lead to different activation patterns: both populations activated, both repressed, or the asymetrical case - one up, one down.
Our further steps are to find the conditions for stability, and to investigate patterns on the initial conditions and the stable steady states - in other words, input and output. A network with more than two interacting populations holds a systemic memory capable of storing and responding to a much wider range of patterns - a possibility that is being now explored by our team.
References
[1] J. P. Ward, J.R. King, A. J. Koerber, P. Williams, J. M. Croft and R. E. Sockett Mathematical modelling of quorum sensing in bacteria.
Math Med Biol (2001) 18(3)
[2] http://partsregistry.org/
[3] J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities", Proceedings of the National Academy of Sciences of the USA, vol. 79 no. 8 pp. 2554–2558, April 1982.