Disordered Systems and Neural Networks
Disordered Systems and Neural Networks
Competition to bind microRNAs induces an effective positive crosstalk between their targets, therefore known
as competing endogenous RNAs or ceRNAs. While such an effect is known to play a significant role in specific
conditions, estimating its strength from data and, experimentally, in physiological conditions appears to be far
from simple. Here we show that the susceptibility of ceRNAs to different types of perturbations affecting their
competitors (and hence their tendency to crosstalk) can be encoded in quantities as intuitive and as simple to
measure as correlation functions. We confirm this scenario by extensive numerical simulations and validate
it by re-analyzing PTENs crosstalk pattern from TCGA breast cancer dataset. These results clarify the links
between different quantities used to estimate the intensity of ceRNA crosstalk and provide new keys to analyze
transcriptional datasets and effectively probe ceRNA networks in silico.
INTRODUCTION
[(hm2i i
2
hmi i )( m2j hmj i )]1/2
(1)
with the idea that, if ij is large enough, a perturbation altering the level of ceRNA j will cause part of the miRNA population to move from one target to the other, effectively broadcasting the perturbation from ceRNA j to ceRNA i through
miRNA-mediated interactions. A more direct description of
this mechanism is attained instead via susceptibilities like [1]
ij =
hmi i
0 ,
bj
(2)
(A)
(B)
miRNA
target j
target i
mj
induces mi
FIG. 1. (A) A miRNA species interacts with two different target RNAs who are competing to bind it, partially repressing their pools (repression
ways
quantify
the ceRNA
: of one of the targets can induce a de-repression of the
being representedDifferent
by red crosses).
(B) to
In specific
conditions,
an increase effect
in the level
competitor, thereby establishing an effective positive coupling between the targets. Note that a similar effect can in principle be obtained
between ceRNAs that are not co-regulated by the same miRNA species through chains of miRNA-mediated interactions.
(C)
ij>0
ij>0
fluctuations of mi and
mi increases
upon
date them by computer simulations and
gene expression
data
Supporting Text)
mj their
are consequences.
statistically
increasing target js
analysis, and explore
correlated
transcription rate
RESULTS
Theory
a = a a a
kia
mi a +
(kia
+ ia )cia
i
m
i = bi d i m i
+
kia
mi a
a
+
cia = kia
mi a
kia
cia
(3)
cia
,
ia
(4)
For ia + kia
ia (i.e. when stoichiometric degradation
without miRNA recycling is the dominant channel of complex processing), this allows to re-cast (3) in the form (see
BUT
ij>0
ij>0
L
m
i ' mi
,
mi
L
a ' a
,
a
(5)
(bi log mi di mi )
X
X
+
(a log a a a ) +
kia
mi a . (6)
a
i,a
1 X
f (m, )eL/T ,
Z(T ) m,
(7)
3
where
Z(T ) =
eL/T
(8)
m,
is a normalization factor, the deterministic limit being obtained for T 0. In particular, defining
hf gic hf gi hf i hgi ,
(9)
log Z(T ) ,
di
hmi i
hmi mj ic = T
T ij ,
dj
hmi log mj ic = T ij .
hmi i = T
(10)
miRNA-ceRNA complex processing dominated by the stoichiometric channel, with the former playing the key role in deriving the function L (see Supporting Text). We note however
that the overall scenario just described also holds for when
complexes evolve over time scales much longer than those of
free molecular levels, i.e. for ia 1/di and ia 1/a .
In particular, (3) can again be re-cast in the form of (23) with
L given by (22), albeit with re-scaled transcription rates (see
Supporting Text for details).
Therefore we conclude that, as long as molecular noise can
be approximated by a uniform effective temperature,
(i) the ceRNA-ceRNA covariance Cij = hmi mj ic is a
proxy for the susceptibility ij , and
(11)
(12)
(13)
(14)
b2 , 1 [molec. min1 ]
10
+
k11
[molec.1 min1 ] e5
+
k21
[molec.1 min1 ] e6
k11
, k21
[min1 ]
0.001
d1 , d2 , 1 [min1 ]
0.1
11 , 21 [min1 ]
1
11 , 21 [min1 ]
0.001
10
e5
e6
0.001
0.05
0.05
0.001
10
e5
e6
0.001
0.2
0.05
0.001
<< d-1
10
20
b1
30
40
1.0
12
0.5
X12/T
21
0.0
12
1.5
-1
<< d
1.8
1.6
1.4
1.2
1.0
0.8
0.6
0.4
10
20
b1
30
40
6
5
4
3
2
1
0
21
<< d-1
X21/T
10
20
b1
21
12
2.0
30
100
-21
-12
C21/T
-21
-12
C21/T
100
6
5
4
3
2
1
0
0
= d -1
10
20
b1
30
40
12
X12/T
0
10
0.25
0.20
0.15
0.10
0.05
0.00
12
1.4
1.2
1.0
0.8
0.6
0.4
0.2
0.0
(C)
1/,1/d
T 0.09
20
b1
= d -1
30
40
21
7
6
5
4
3
2
1
= d -1
X21/T
10
20
b1
30
21
100
(B)
1/,1/d
T 0.14
(A)
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0.0
1/,1/d
T 0.2
-21
-12
C21/T
>> d-1
10
20
b1
30
40
12
X12/T
>> d-1
10
20
b1
30
21
>> d-1
0.35
0.30
0.25
0.20
0.15
X21/T
0
10
20
b1
30
FIG. 2. Results from Gillespie simulations (markers) versus analytical predictions for susceptibilities (lines) for a miRNA-ceRNA network with
N = 2 ceRNA and M = 1 miRNA species and different values of the transcription rate of ceRNA species 1, b1 . Numerical susceptibilities
have been obtained by perturbing the system at steady state and recording the new steady state at which the system settles after a transient.
Analytical lines correspond to the numerical derivatives of the steady state levels obtained from (3). Sets (A)(C) are for different values of the
mean lifetime of miRNA-ceRNA complexes , and refer, respectively, to the cases in which complex processing is much faster, comparable
or much slower, than the degradation dynamics of free miRNAs and ceRNAs. Also reported is the value of T that provides the best fit in each
case. See Table I for parameter values. Results obtained for stronger miRNA-ceRNA couplings are shown in the Supporting Text.
These results confirm that (12) and (14) are indeed good
predictors of the response of a ceRNA to a perturbation affecting one of its competitors within a miRNA-ceRNA network. Notably, such correlation functions are easy to estimate
from transcription data sets. Our framework therefore has the
potential to offer new insight into post-transcriptional regulation, its system-level organization and its impact on cellular
functions.
In order to test this idea, we analyzed the ceRNA scenario
emerging from 1098 breast cancer samples obtained from The
Cancer Genome Atlas [19], focusing on the widely studied
oncosuppressor PTEN and its immediate competitors (i.e. the
ceRNAs sharing at least one miRNA regulator with PTEN).
In particular, we computed
CPTEN,ceRNA = hmPTEN mceRNA ic
XceRNA,PTEN = hmceRNA log mPTEN ic
XPTEN,ceRNA = hmPTEN log mceRNA ic
(16)
(17)
(18)
TE
N
ESR1
RN
TE
N
,ce
RN
RAPH1
ZEB2
1.5
DTWD2
PRELP PIK3C2A
MS4A7
C11ORF63
1.3
SERINC1
SMAD5
QKI
ZNF175
SEPT11
ANKRD36C
ANKRD36B
1.1
GALNT16
NUBPL
ZFP14
KIAA1958
IL6R
CD28
0.9
KIAA0391
AMY2B
NUDT13
0.7
0.5
NBR1
KCTD20
SLC1A2
GNB5
FAM217B
NRIP2
0.0
VCAN
VKORC1L1
PRKCA
PAK2
WDR82
IFNAR1
1.0
RAPH1
ZEB2
1.5
DTWD2
C11ORF63
1.3
ZNF175
1.5
2.0
2.5
3.0
3.5
4.0
4.5
5.0
SERINC1
SMAD5
QKI
SEPT11
ANKRD36B
GALNT16
NUBPL
ZFP14
VKORC1L1
PRKCA
KCTD20
KIAA1958
SLC1A2 IFNAR1
PAK2
IL6R
WDR82
CD28
GNB5
KIAA0391
FAM217B
FAM84B
AMY2B
NRIP2
1.1
NUDT13
0.7
PRELP PIK3C2A
MS4A7
ANKRD36C
0.9
HACD3
MLEC
VAPA
0.5
XPTEN,ceRNA XceRNA,PTEN
1.7
RNF213
FAM84B
0.6
1.9
A=
1.7
0.4
ESR1
Xce
XPTEN,ceRNA XceRNA,PTEN
XP
XPTEN,ceRNA
(1000)
COV(PTEN,
log ceRNA)
x 103
1.9
PTEN,ceRNA
Pearson(PTEN,
ceRNA)
0.2
2.1
A,P
2.1
(B)
7
CCOV(PTEN,
(10
PTEN,ceRNA
ceRNA)
x 10)7
1
X
(1000)
PTEN,ceRNA
COV(PTEN,
log ceRNA)
x 103
(A)
0.5
0.0
VAPA
0.5
1.0
VCAN
NBR1
RNF213
HACD3
MLEC
1.5
2.0
2.5
3.0
COV(ceRNA, log PTEN) x 103
X
ceRNA,PTEN (1000)
3.5
4.0
4.5
5.0
FIG. 3. Values of different correlation functions of PTEN with its ceRNAs computed from breast cancer samples from TCGA. (A) XceRNA,PTEN
and XPTEN,ceRNA are reported on the x and y axes respectively, while the color code gives the value of CPTEN,ceRNA . (B) Same as (A), except
that the color code now corresponds to the Pearson coefficient PTEN,ceRNA = Cij /(mi mj ). Notice that in (B) PTEN-ceRNA pairs occupy
the same positions in the plane as in (A). See Supporting Text for higher-resolution versions of both panels.
PTEN.
On the other hand, smaller values of (16) (orange markers in Fig. 3A) are associated to strongly asymmetric PTENceRNA pairs for which (18) is much larger than (17). This
suggests that PTEN will respond to an increase of its competitors bare transcription rate (and not vice-versa), while no response of PTEN should be expected upon perturbing the bare
decay rate of the same ceRNA as Cij is small. Within the
steady state theory of [1], ceRNA pairs with strongly different values of ij and ji pertain to cases where the responding
ceRNA (PTEN here) is susceptible to variations in the miRNA
levels while the perturbed one (PTENs competitor) is fully
repressed. Our data analysis fully confirms both this scenario
and the theory presented here in linking such cases to low values of the bare covariance (14).
Finally, note (Fig. 3B) that the above information can not
be retrieved if Cij is replaced by the Pearson coefficient ij ,
Eq. (1), which just amounts to normalizing Cij by the product of the standard deviations mi and mj of mi and mj .
Indeed, using the value of ij to color-code PTENs ceRNAs,
one sees that the Pearson coefficient can mislead into expecting (or not expecting) a response to a perturbation when the
actual susceptibilities are small (resp. large).
For instance, ij is rather small for the pair formed by
PTEN and SLC1A2, which seems to suggest absence of mutual cross-talk between these two transcripts. However, while
both CPTEN,SLC1A2 and XSLC1A2,PTEN are small, XPTEN,SLC1A2
is significant. This suggests that (i) SLC1A2 will not respond
to a perturbation affecting the transcription rate of PTEN, and
(ii) the pair will be insensitive to changes in each others
bare decay rate; however, (iii) PTEN will be affected by a
change in the bare transcription rate of its competitor despite
the small statistical correlation that exists between their levels. Likewise, the large value of the Pearson coefficient between PTEN and DTWD2 can mislead into generically expecting a response when instead the susceptibility is strongly
perturbation-dependent. In particular, the level of DTWD2
6
a cornerstone of statistical mechanics [21]. Their derivation
in our context has relied on an equilibrium framework that
presupposes stationarity of molecular levels. Since ceRNA
crosstalk can be substantially more complex away from the
steady state [22], a more refined mathematical study will
be required to extend the theory developed here to offequilibrium dynamical regimes. Our results on the other hand
may also open the way to the application of recently devel-
[17] Denzler R, McGeary SE, Title AC, Agarwal V, Bartel DP, Stoffel M. Impact of microRNA levels, target-site complementarity, and cooperativity on competing endogenous RNA-regulated
gene expression. Mol Cell (2016) 64:565-579
[18] Gillespie DT. Stochastic simulation of chemical kinetics. Annu
Rev Phys Chem (2007) 58:35-55
[19] The TCGA Research Network: http://cancergenome.nih.gov/
[20] Nitzan M, Steiman-Shimony A, Altuvia Y, Biham O, Margalit
H. Interactions between distant ceRNAs in regulatory networks.
Biophys J (2014) 106:2254-66
[21] Marconi UM, Puglisi A, Rondoni L, Vulpiani A. Fluctuationdissipation: response theory in statistical physics. Phys Rep
(2008) 461:111-95
[22] Figliuzzi M, De Martino A, Marinari E. RNA-based regulation:
dynamics and response to perturbations of competing RNAs.
Biophys J (2014) 107:1011-22
[23] Roudi Y, Aurell E, Hertz J. Statistical physics of pairwise probability models. Front Comput Neurosci (2009) 3:22
Acknowledgments
We gratefully acknowledge Carla Bosia and Andrea Pagnani for useful insight and suggestions.
7
SUPPORTING TEXT
I.
1
Starting from Eq. (3) of the Main Text, namely (with ia = (ia + ia + kia
) )
X
X
+
a = a a a
kia
mi a +
(kia
+ ia )cia ,
i
m
i = bi di mi
+
kia
mi a
kia
cia ,
(19)
+
cia = kia
mi a
cia
,
ia
we assume that complexes equilibrate much faster than miRNA and ceRNA levels and substitute cia with its steady state value
+
hcia i = kia
ia mi a . One finds
X
ia
+
a ' a a a
kia mi a ,
+
k
ia
ia
ia
i
(20)
X
ia + ia
+
m
i ' bi d i m i
k
m
.
ia i a
ia + ia + kia
a
For ia + kia
ia , this reduces to
a ' a a a
m
i ' bi di mi
+
kia
mi a ,
(21)
+
kia
mi a ,
which is easily seen to be equivalent to Eq. (5) in the Main Text, with
X
X
X
+
L=
(bi log mi di mi )
(a log a a a ) +
kia
mi a .
a
II.
(22)
i,a
By direct differentiation and using the fact that (see Eq. (5) in the Main Text)
L
m
i
'
,
mi
mi
L
a
'
,
a
a
(23)
one finds
L =
X L
X m i 2 X a 2
X L
m i +
a =
0 .
mi
a
mi
a
a
a
i
i
(24)
In other words, under the approximations discussed above, L decreases along the dynamics of the miRNA-ceRNA network.
Therefore the minimum of L (which is unique by virtue of the concavity of L) describes a steady state of the dynamics (19).
III.
APPROXIMATE CALCULATION OF ij FOR A SYSTEM WITH ONE MIRNA AND N CERNA SPECIES
Starting from Eq. (21) taken for N ceRNA species and a single miRNA species (we suppress its index for simplicity) in the
limit i ki + i , the steady-state level of mi reads
mi =
bi
Fi ()
di
Fi () =
0,i
0,i +
0,i =
di
.
ki+
(25)
8
Now noting that
1 0,i
Fi () ' 21 40,i0,i
0,i
0,i
dFi
Fi0 ' 410,i
d
0,i
2
(26)
(27)
and that the steady state miRNA level can be approximated by [1]
P
P
iRepr bi 14 iSusc bi
,
'
P
P
b k+
b k+
+ iExpr idii + 41 iSusc idii
(28)
so that
X bi k +
X bi k +
1
i
i
+
,
= +
d
4
d
i
i
iExpr
bj
'
41
dj
dj 0,j
0
(29)
(30)
iSusc
= Fi0
dj
di dj
ij
(i 6= j) .
(31)
One finds
ij '
bi bj
WR(i),R(j)
di dj
(i 6= j) ,
(32)
c is a 33 matrix that only depends on the regime R(i) (repressed, susceptible or expressed) to which ceRNA i belongs.
where W
c are found to be 1 (for
By considering the definitions of the different regimes in terms of the value of , all elements of W
instance, WExpr,Expr = /(0,i 0,j ) 1 as 0,i and 0,j if ceRNAs i and j are both expressed) except for
WSusc,Susc , which is given by
WSusc,Susc =
,
16 0,i 0,j
(33)
Assuming complex levels cia are roughly stationary over time scales for which mi and a evolve (i.e. ia 1/di and
ia 1/a for each i and a), then all terms in (19) that involve the variables cia can be taken to be roughly constant for short
enough characteristic times. In such conditions, miRNAs are effectively transcribed at rates
X
aeff ' a +
(kia
+ ia )cia ,
(34)
i
X
a
kia
cia .
(35)
9
In this limit, (19) can again be cast as
L
,
mi
L
a ' a
,
a
m
i ' mi
(36)
with
L=
(beff
i log mi di mi )
X
X
+
(aeff log a a a ) +
kia
mi a .
a
(37)
i,a
The main difference from the previous case lies in the fact that the minimum of L should now be computed self-consistently
from the asymptotic value of cia : after the (fast) equilibration of mi s and a s following (36), a new steady state value for
+
complexes is computed as cia = kia
ia mi a , leading in turn to new values for the effective transcription rates aeff and beff
i and
hence to new values for mi s and a s from (36), and so on until convergence.
V.
The time evolution of our miRNA-ceRNA network with N ceRNA species (labeled i), M miRNA species (labeled a) and
intrinsic (molecular) noise is described by the system
X
X
+
a = a a a
kia
mi a +
(kia
+ ia )cia + a ,
i
m
i = bi di mi
+
kia
mi a
kia
cia + i ,
(38)
cia
+ ia ,
ia
+
cia = kia
mi a
1
where ia = (ia + ia + kia
) while a , a and ia represent stochastic variables. As each noise source contributes independently to the overall noise level, one has
X
X
X
+
a = a
ia
+
ia
+
ia
,
(39)
i
i = mi
X
a
+
ia
ia
(40)
ia = ia
+ ia
ia
ia
(41)
where mi , a , ia
, ia
, and ia
and are mutually independent zero-average random variables representing, respectively, the intrinsic noise in ceRNA levels, in miRNA levels, in the binding/unbinding dynamics of complexes, in the stoichiometric complex
degradation channel and in the catalytic complex degradation channel. Correlations are, for each component, described by
+
+ 0
+
ia (t)ia
(t ) = kia
mi a (t t0 ) ,
ia (t)ia
(t ) = kia
cia (t t0 ) ,
(42)
0
hia
(t)ia
(t )i = ia cia (t t0 ) ,
0
hia
(t)ia
(t )i = ia cia (t t0 ) ,
where
P
bi + a kia
cia
,
P +
di + a kia
a
P
a + i (kia
+ ia )cia
a =
,
P +
a + i kia mi
mi =
cia =
+
kia
a mi
ia + kia
+ ia
(43)
(44)
(45)
10
denote the mean steady-state molecular levels. To obtain Fig. 2 of the Main Text, we have simulated the above system with
M = 1, N = 2 using the Gillespie algorithm [2].
[1] Figliuzzi M, Marinari E, De Martino A. MicroRNAs as a selective channel of communication between competing RNAs: a steady-state
theory. Biophys J (2013) 104:1203-13
[2] Gillespie DT. Stochastic simulation of chemical kinetics. Annu Rev Phys Chem (2007) 58:35-55
30
= -
(C)
1/,1/d
T 0.27
100
0.30
0.25
0.20
0.15
0.10
0.05
0.00
0
C21/T
10
20
b1
21
0.0
30
5
4
3
2
1
0
X12/T
0
10
20
b1
30
10
20
b1
X21/T
10
20
b1
30
= -
20
15
10
X21/T
X12/T
0
<< d -1
= -
0.8
30
>> -
10
20
b1
30
>> -
1.5
0.6
12
1/,1/d
T 0.08
1.0
21
20
b1
0.5
(B)
10
<< d -1
1.5
C21/T
10
20
b1
>> -
30
21
100
6
5
4
3
2
1
0
0
C21/T
12
1/,1/d
T 0.16
2.0
<< d -1
(A)
12
100
1.4
1.2
1.0
0.8
0.6
0.4
0.2
0.0
0
0.4
0.2
0.0
10
20
b1
X21/T
0.5
X12/T
0
1.0
30
10
20
b1
30
FIG. 4. Same as Figure 2 in the Main Text but for stronger miRNA repression. Parameter values are as in Table I of the Main Text except for
+
+
k11
= e3 and k21
= e4 . Note that, for small values of b1 , m1 gets too small to accurately estimate Xij s.
11
XPTEN,ceRNA
(1000)
COV(PTEN,
log ceRNA)
x 103
SMAD5
QKI
MS4A7
PRELP PIK3C2A
ZEB2
7
CCOV(PTEN,
(10
PTEN,ceRNA
ceRNA)
x 10)7
SEPT11
NBR1
RNF213
2.5
3.0
3
3.5
SERINC1
4.0
XPTEN,ceRNA XceRNA,PTEN
HACD3
MLEC
2.0
4.5
ESR1
VCAN
5.0
XPTEN,ceRNA XceRNA,PTEN
RAPH1
DTWD2
C11ORF63
ZNF175
ANKRD36C
GALNT16
VKORC1L1
KCTD20
PAK2
IFNAR1
WDR82
VAPA
1.5
FAM84B
1.0
NA
,PT
EN
ceR
2.1
1.9
ANKRD36B
PRKCA
NUBPL
ZFP14
SLC1A2
0.5
GNB5
FAM217B
NRIP2
KIAA1958
IL6R
CD28
KIAA0391
AMY2B
NUDT13
0.0
=X
NA
,ce
R
TE
N
1.7
1.5
1.3
1.1
0.9
0.7
0.5
XP
12
X
(1000)
PTEN,ceRNA
COV(PTEN,
log ceRNA)
x 103
2.1
1.9
1.7
1.5
1.3
1.1
0.9
0.7
RAPH1
DTWD2
C11ORF63
ZNF175
0.5
CD28
GNB5
KIAA0391
FAM217B
AMY2B
NRIP2
NUDT13
0.0
ZEB2
0.2
PRELP PIK3C2A
MS4A7
SMAD5
QKI
VAPA
FAM84B
1.0
1.5
0.4
RNF213
2.5
3.0
PTEN,ceRNA
Pearson(PTEN,
ceRNA)
2.0
HACD3
MLEC
SEPT11
ANKRD36C
ANKRD36B
GALNT16
NBR1
NUBPL
ZFP14
VKORC1L1
PRKCA
KCTD20
KIAA1958
SLC1A2 IFNAR1
PAK2
IL6R
WDR82
0.5
3.5
SERINC1
4.0
0.6
4.5
ESR1
VCAN
5.0