Team:Grenoble/Modeling/Amplification/Stochastic/results

From 2012.igem.org

(Difference between revisions)
 
(49 intermediate revisions not shown)
Line 4: Line 4:
<body id="Modeling">
<body id="Modeling">
<div id="cadre">
<div id="cadre">
 +
 +
<section>
 +
<center>
 +
<a href="https://2012.igem.org/wiki/index.php?title=Team:Grenoble/Modeling/Amplification/Stochastic/what"><img src="https://static.igem.org/mediawiki/2012/5/5a/What_small.png" alt="" /></a>
 +
<a href="https://2012.igem.org/Team:Grenoble/Modeling/Amplification/Stochastic/results"><img src="https://static.igem.org/mediawiki/2012/f/f2/Results_small.png" alt="" /></a>
 +
</center>
 +
</section>
<section>
<section>
<h1>Goal</h1>
<h1>Goal</h1>
Line 10: Line 17:
</br>
</br>
</br>
</br>
-
<ul><ul><img src="https://static.igem.org/mediawiki/2012/4/49/1_mod.png" alt="" /> How much time do we need to wait to get a response ?</ul></ul>
+
<a href="#1"><img src="https://static.igem.org/mediawiki/2012/4/49/1_mod.png" alt="" /> How much time do we need to wait to get a response ?</a>
-
<ul><ul><img src="https://static.igem.org/mediawiki/2012/1/1e/2_mod.png" alt="" /> Is the sensitivity given by stochastic modeling the same as in ODE modeling ?
+
<br/>
-
</ul></ul>
+
<a href="#2"><img src="https://static.igem.org/mediawiki/2012/1/1e/2_mod.png" alt="" /> Is the sensitivity of the amplification loop given by stochastic modeling the same as in ODE modeling ?</a>
-
<ul><ul><img src="https://static.igem.org/mediawiki/2012/5/57/3_mod.png" alt="" /> What is the part of false positives ?
+
<br/>
-
</ul></ul>Thanks to those 3 questions we will be able to establish if our device is still performing when we take into account random variations.
+
<a href="#3"><img src="https://static.igem.org/mediawiki/2012/5/57/3_mod.png" alt="" /> What is the part of false positives ?</a>
 +
<br/>
 +
Thanks to those 3 questions we will be able to establish if our device is still performing when we take into account random variations.
</section>
</section>
<section>
<section>
-
<h1><img src="https://static.igem.org/mediawiki/2012/4/49/1_mod.png" alt="" /> Time </h1>
+
<h1 id="1"><img src="https://static.igem.org/mediawiki/2012/4/49/1_mod.png" alt="" /> Time </h1>
</br>
</br>
-
The purpose of our device is to act more quickly than current techniques to detect the Golden Staph. Therefore we would like to evaluate the time needed to get an answer. We need to establish a time not too small to avoid false negatives and not too long to avoid false positives and to be performing. Indeed, if we take a short time we can miss some visible output signals which are longer to appear. Then we will conclude that nothing has been detected whereas there was something to detect. If we wait too long, some visible output signals can appear whereas there was nothing to detect. This phenomenon is due to the randomness the bacterium and espacially beacouse of basal values.
+
We would like to evaluate the time needed to get an answer. Once a bacterium has detected a Golden staph, the quorum sensing will allow the propagation of the information. Thus we will be able to get the answer really quickly and visible.  
</br>
</br>
 +
We need to establish a time not too small to avoid false negatives and not too long to avoid false positives and to be efficient. Indeed, if we take a short time we could miss some visible output signals which are longer to appear. Then we will conclude that nothing has been detected whereas there was something to detect. If we wait too long, some visible output signals can appear whereas there was nothing to detect. This phenomenon is due to the randomness inside the bacterium and espacially because of basal values. Indeed, because of the leaks at the promoter level, the production of proteins could be nonzero even when the gene is not up-regulated. We call this "basal production".
</br>
</br>
-
In this first part we try to determine that time and in the third part we will analyse if it still be a good scale of time with respect to false positives.
 
</br>
</br>
 +
In this first part we try to determine the ideal duration of observations and in the third part we will analyse if it would still be a good scale of time with respect to false positives.
</br>
</br>
-
Thanks to the deterministic modeling we can have an estimation of the time needed to get an answer in differentt proportions. In the graph below you can observe the evolution of the output signal through time for an initial concentration of CAMP of 10<SUP>-3</SUP> mol/L.
+
</br>
 +
Thanks to the deterministic modeling we can have an estimation of the time needed to get an answer in different proportions. In the graph below you can observe the evolution of the output signal through time for an initial concentration of cAMP of 10<SUP>-3</SUP> mol.L<span class="exposant">-1</span>.
<center><img src="https://static.igem.org/mediawiki/2012/8/81/Time_det.png" alt="" /></center>
<center><img src="https://static.igem.org/mediawiki/2012/8/81/Time_det.png" alt="" /></center>
</br>
</br>
Line 32: Line 43:
</br>
</br>
</br>
</br>
-
We would like to observe what happens after 400 minutes of waiting for several initial concentrations of CAMP. To perform that study, we use a Gillespie Algorithm to add randomness in our system. Moreover, we simulate the algorithm 100 times for each initial concentration of CAMP which interest us.
+
We would like to observe what happens after 400 minutes of waiting for several initial concentrations of cAMP. To perform that study, we use a Gillespie Algorithm to add randomness in our system. Moreover, we simulate the algorithm 100 times for each initial concentration of cAMP which interest us.
</br>
</br>
</br>
</br>
Line 38: Line 49:
</br>
</br>
</br>
</br>
-
We can notice that when we wait 400 minutes we get a visible output signal as soon as we have an initial concentration of CAMP of 5,25.10<SUP>-5</SUP> mol/L (10<SUP>4,5</SUP> molecules of CAMP<SUB>i</SUB>). We will see in the next part that this concentration corresponds to the sensitivity of our system. Thus, our stochastic model doesn't contradict our deterministic model and we can make our further studies at a time of 400 minutes.
+
We can notice that when we wait 400 minutes we get a visible output signal as soon as we have an initial concentration of cAMP of 5,25.10<SUP>-5</SUP> mol.L<span class="exposant">-1</span> (10<SUP>4,5</SUP> molecules of cAMP<SUB>i</SUB>). We will see in the next part that this concentration corresponds to the sensitivity of our system. Thus, our stochastic model doesn't contradict our deterministic model and we can make our further studies at a time of 400 minutes.
 +
</br>
 +
</br>
 +
You can find the scripts of our simulations <a href="https://2012.igem.org/wiki/index.php?title=Team:Grenoble/Modeling/Amplification/Stochastic/Scripts">here</a>.
</section>
</section>
<section>
<section>
-
<h1><img src="https://static.igem.org/mediawiki/2012/1/1e/2_mod.png" alt="" /> Sensibility </h1>
+
<h1 id="2"><img src="https://static.igem.org/mediawiki/2012/1/1e/2_mod.png" alt="" /> Sensitivity </h1>
</br>
</br>
-
The ODE modeling gave 10<SUP>-6</SUP> mol/L of CAMP<SUB>i</SUB> as the sensitivity. This means, if we have 10<SUP>-6</SUP> mol/L of CAMP at the initial point, the system will turn on.  
+
The ODE modeling gave 10<SUP>-6</SUP> mol.L<span class="exposant">-1</span> of CAMP<SUB>i</SUB> as the sensitivity of the amplification loop. This means, if we have 10<SUP>-6</SUP> mol/L of cAMP at the initial point, the system will turn on.  
But this result is given by a deterministic analysis. What happens if we take into account the random phenomena of the bacterium ? Is the sensitivity still so good ?
But this result is given by a deterministic analysis. What happens if we take into account the random phenomena of the bacterium ? Is the sensitivity still so good ?
</br>
</br>
</br>
</br>
-
We want to obtain the evolution of the output signal (CA or GFP) depending on the concentration of the input signal (CAMPi) after 6h40 (400 min).
+
We want to obtain the evolution of the output signal (Ca or GFP) depending on the concentration of the input signal (cAMPi) after 6h40 (400 min).
To get that graph we simulate the algorithm hundreed times for each concentration of CAMPi (10, 10<SUP>1,5</SUP>, 10<SUP>2</SUP>, …, 10<SUP>6</SUP> molecules).
To get that graph we simulate the algorithm hundreed times for each concentration of CAMPi (10, 10<SUP>1,5</SUP>, 10<SUP>2</SUP>, …, 10<SUP>6</SUP> molecules).
</br>
</br>
Line 55: Line 69:
<center><img src="https://static.igem.org/mediawiki/2012/4/47/Ca_Deterministic.png" alt="" /></center>
<center><img src="https://static.igem.org/mediawiki/2012/4/47/Ca_Deterministic.png" alt="" /></center>
<center><img src="https://static.igem.org/mediawiki/2012/c/cf/CA_Stoch.png" alt="" /></center>
<center><img src="https://static.igem.org/mediawiki/2012/c/cf/CA_Stoch.png" alt="" /></center>
-
We can notice that, when we add stochastic variations to the model, the sensitivity decreases from 10<SUP>-5,5</SUP> mol/L to 3,3.10<SUP>-5</SUP> mol/L. In other words, we loose a sensitivity of 2,98.10<SUP>-5</SUP> mol/L, that is 18 000 molecules of CAMP<SUB>i</SUB>. However this loss of sensitivity is low and doesn't penalize our device at all.
+
We can notice that, when we add stochastic variations to the model, the sensitivity of the amplification loop decreases from 10<SUP>-5,5</SUP> mol/L to 3,3.10<SUP>-5</SUP> mol.L<span class="exposant">-1</span>. In other words, we loose a sensitivity of 2,98.10<SUP>-5</SUP> mol/L, that is 18 000 molecules of cAMP<SUB>i</SUB>. However this loss of sensitivity is low and doesn't penalize our device at all.
 +
</br>
 +
</br>
 +
To observe those results you can use our scripts <a href="https://2012.igem.org/wiki/index.php?title=Team:Grenoble/Modeling/Amplification/Stochastic/Scripts">here</a>.
</section>
</section>
<section>
<section>
-
<h1><img src="https://static.igem.org/mediawiki/2012/5/57/3_mod.png" alt="" /> False positives </h1>
+
<h1 id="3"><img src="https://static.igem.org/mediawiki/2012/5/57/3_mod.png" alt="" /> False positives </h1>
 +
</br>
 +
We know the time we need to wait to get a response and the sensitivity of the amplification loop. But we don't know yet if that device is reliable.
 +
</br>
 +
To answer this question we generate 10 000 simulations of the Gillespie Algorithm when there is no cAMP at the initial point. After 400 minutes we evaluate the number of output signals to establish the percentage of false positives. We consider as "output signal" the production of 35 molecules of Ca which represents the lower bound of molecules of Ca produced for an initial concentration of cAMP equal to the sensitivity of the amplification loop after 400 minutes according to our last modeling (part 2).
 +
</br>
 +
</br>
 +
We get the results below.
 +
</br>
 +
<center><img src="https://static.igem.org/mediawiki/2012/f/fc/False_positives.png" alt="" /></center>
 +
The percentage of false positives is low. That means, if we wait 400 minutes after the beginning of our test, we will obtain 43 false answers out of 10 000. 43 times out of 10 000 we can see an output signal whereas there was nothing to detect.
 +
</br>
 +
This result is interesting regarding our device. Indeed we would like to use a 96-well plate. Thus we will be able to make 96 tests in the same time. According to our study, if no Golden staph has to be detected, no more than one sample on 96 will get a visible output signal.
 +
</br>
 +
However, in order to be more rigorous, we need to validate these promising results by experiments.
 +
</br>
 +
</br>
 +
Finally we can study how many output signals we have when the initial concentration of cAMP is lower than the sensitivity of the amplification loop.
 +
</br>
 +
</br>
 +
<center><img src="https://static.igem.org/mediawiki/2012/a/af/Perc_sous_sens.png" alt="" /></center>
 +
</br>
 +
</br>
 +
We can notice that if zero, one or two samples become green, we can't be sure if there was something to detect or not. But as soon as we have an initial concentration of CAMP of the order of 10<SUP>3</SUP> molecules (1,66.10<SUP>-6</SUP> mol.L<span class="exposant">-1</span>), approximately 6 samples become green. Thus, even if the initial concentration of cAMP is not higher than 10<SUP>-6</SUP> mol.L<span class="exposant">-1</span>, we should be able to detect the Golden staph.
 +
</br>
 +
After the amount of 10<SUP>3,5</SUP> molecules of cAMP (5,25.10<SUP>-6</SUP> mol.L<span class="exposant">-1</span>) at the initial pont, we are pretty sure to detect the Golden staph since almost the whole plate should become green.
 +
</br>
 +
</br>
 +
You can find the scripts of our simulations <a href="https://2012.igem.org/wiki/index.php?title=Team:Grenoble/Modeling/Amplification/Stochastic/Scripts">here</a>.
 +
</section>
 +
<section>
 +
<h1>Conclusion</h1>
 +
</br>
 +
With that stochastic modeling we have confirmed and slightly modified the results from the deterministic modeling. Indeed, the 400 minutes of waiting to get a response is also true in stochastic than in deterministic modeling. The sensitivity is slightly higher than in the ODE modeling but still be correct for our device. What's more, the proportion of false positives is expected to be low. Thus, a 96-well plate will be efficient to detect the Golden staph for little concentrations and will be reliable.
 +
</section>
 +
<section>
 +
<h1>References</h1>
 +
</br>
 +
<ul><li><u>Stochastic Simulation of Chemical Kinetics</u> from Daniel T. Gillespie</li></ul>
</section>
</section>
</div>
</div>

Latest revision as of 00:15, 27 September 2012

iGEM Grenoble 2012

iGEM Grenoble iGEM
iGEM 2012
main page
Project

Goal


In this part we would like to answer 3 questions thanks to the stochastic modeling.

How much time do we need to wait to get a response ?
Is the sensitivity of the amplification loop given by stochastic modeling the same as in ODE modeling ?
What is the part of false positives ?
Thanks to those 3 questions we will be able to establish if our device is still performing when we take into account random variations.

Time


We would like to evaluate the time needed to get an answer. Once a bacterium has detected a Golden staph, the quorum sensing will allow the propagation of the information. Thus we will be able to get the answer really quickly and visible.
We need to establish a time not too small to avoid false negatives and not too long to avoid false positives and to be efficient. Indeed, if we take a short time we could miss some visible output signals which are longer to appear. Then we will conclude that nothing has been detected whereas there was something to detect. If we wait too long, some visible output signals can appear whereas there was nothing to detect. This phenomenon is due to the randomness inside the bacterium and espacially because of basal values. Indeed, because of the leaks at the promoter level, the production of proteins could be nonzero even when the gene is not up-regulated. We call this "basal production".

In this first part we try to determine the ideal duration of observations and in the third part we will analyse if it would still be a good scale of time with respect to false positives.

Thanks to the deterministic modeling we can have an estimation of the time needed to get an answer in different proportions. In the graph below you can observe the evolution of the output signal through time for an initial concentration of cAMP of 10-3 mol.L-1.

After 200 minutes we get half of the maximum output signal. If we wait 200 minutes more we reach 80% of the output signal. Therefore we can assess the time needed to get a correct answer as 400 minutes for the time being. We then have to check if that time is still appropriate when we take into accout the randomness.

We would like to observe what happens after 400 minutes of waiting for several initial concentrations of cAMP. To perform that study, we use a Gillespie Algorithm to add randomness in our system. Moreover, we simulate the algorithm 100 times for each initial concentration of cAMP which interest us.



We can notice that when we wait 400 minutes we get a visible output signal as soon as we have an initial concentration of cAMP of 5,25.10-5 mol.L-1 (104,5 molecules of cAMPi). We will see in the next part that this concentration corresponds to the sensitivity of our system. Thus, our stochastic model doesn't contradict our deterministic model and we can make our further studies at a time of 400 minutes.

You can find the scripts of our simulations here.

Sensitivity


The ODE modeling gave 10-6 mol.L-1 of CAMPi as the sensitivity of the amplification loop. This means, if we have 10-6 mol/L of cAMP at the initial point, the system will turn on. But this result is given by a deterministic analysis. What happens if we take into account the random phenomena of the bacterium ? Is the sensitivity still so good ?

We want to obtain the evolution of the output signal (Ca or GFP) depending on the concentration of the input signal (cAMPi) after 6h40 (400 min). To get that graph we simulate the algorithm hundreed times for each concentration of CAMPi (10, 101,5, 102, …, 106 molecules).

We can compare the graph obtained with the one from the ODE modeling.
We can notice that, when we add stochastic variations to the model, the sensitivity of the amplification loop decreases from 10-5,5 mol/L to 3,3.10-5 mol.L-1. In other words, we loose a sensitivity of 2,98.10-5 mol/L, that is 18 000 molecules of cAMPi. However this loss of sensitivity is low and doesn't penalize our device at all.

To observe those results you can use our scripts here.

False positives


We know the time we need to wait to get a response and the sensitivity of the amplification loop. But we don't know yet if that device is reliable.
To answer this question we generate 10 000 simulations of the Gillespie Algorithm when there is no cAMP at the initial point. After 400 minutes we evaluate the number of output signals to establish the percentage of false positives. We consider as "output signal" the production of 35 molecules of Ca which represents the lower bound of molecules of Ca produced for an initial concentration of cAMP equal to the sensitivity of the amplification loop after 400 minutes according to our last modeling (part 2).

We get the results below.
The percentage of false positives is low. That means, if we wait 400 minutes after the beginning of our test, we will obtain 43 false answers out of 10 000. 43 times out of 10 000 we can see an output signal whereas there was nothing to detect.
This result is interesting regarding our device. Indeed we would like to use a 96-well plate. Thus we will be able to make 96 tests in the same time. According to our study, if no Golden staph has to be detected, no more than one sample on 96 will get a visible output signal.
However, in order to be more rigorous, we need to validate these promising results by experiments.

Finally we can study how many output signals we have when the initial concentration of cAMP is lower than the sensitivity of the amplification loop.



We can notice that if zero, one or two samples become green, we can't be sure if there was something to detect or not. But as soon as we have an initial concentration of CAMP of the order of 103 molecules (1,66.10-6 mol.L-1), approximately 6 samples become green. Thus, even if the initial concentration of cAMP is not higher than 10-6 mol.L-1, we should be able to detect the Golden staph.
After the amount of 103,5 molecules of cAMP (5,25.10-6 mol.L-1) at the initial pont, we are pretty sure to detect the Golden staph since almost the whole plate should become green.

You can find the scripts of our simulations here.

Conclusion


With that stochastic modeling we have confirmed and slightly modified the results from the deterministic modeling. Indeed, the 400 minutes of waiting to get a response is also true in stochastic than in deterministic modeling. The sensitivity is slightly higher than in the ODE modeling but still be correct for our device. What's more, the proportion of false positives is expected to be low. Thus, a 96-well plate will be efficient to detect the Golden staph for little concentrations and will be reliable.

References


  • Stochastic Simulation of Chemical Kinetics from Daniel T. Gillespie

Retrieved from "http://2012.igem.org/Team:Grenoble/Modeling/Amplification/Stochastic/results"