Theta model

The theta model, or Ermentrout–Kopell canonical model, is a biological neuron model originally developed to model neurons in the animal Aplysia, and later used in various fields of computational neuroscience. The model is particularly well suited to describe neuron bursting, which are rapid oscillations in the membrane potential of a neuron interrupted by periods of relatively little oscillation. Bursts are often found in neurons responsible for controlling and maintaining steady rhythms. For example, breathing is controlled by a small network of bursting neurons in the brain stem. Of the three main classes of bursting neurons (square wave bursting, parabolic bursting, and elliptic bursting), the theta model describes parabolic bursting. Parabolic bursting is characterized by a series of bursts that are regulated by a slower external oscillation. This slow oscillation changes the frequency of the faster oscillation so that the frequency curve of the burst pattern resembles a parabola.
The model has just one state variable which describes the membrane voltage of a neuron. In contrast, the Hodgkin–Huxley model consists of four state variables (one voltage variable and three gating variables) and the Morris–Lecar model is defined by two state variables (one voltage variable and one gating variable). The single state variable of the theta model, and the elegantly simple equations that govern its behavior allow for analytic, or closed-form solutions (including an explicit expression for the phase response curve). The dynamics of the model take place on the unit circle, and are governed by two cosine functions and a real-valued input function.
Similar models include the quadratic integrate and fire (QIF) model, which differs from the theta model by only by a change of variables and Plant's model, which consists of Hodgkin–Huxley type equations and also differs from the theta model by a series of coordinate transformations.
Despite its simplicity, the theta model offers enough complexity in its dynamics that it has been used for a wide range of theoretical neuroscience research as well as in research beyond biology, such as in artificial intelligence.
Background and history.
Bursting is "an oscillation in which an observable [part] of the system, such as voltage or chemical concentration, changes periodically between an active phase of rapid spike oscillations (the fast sub-system) and a phase of quiescence". Bursting comes in three distinct forms: square wave bursting, parabolic bursting, and elliptic bursting. There exist some models that do not fit neatly into these categories by qualitative observation, but it is possible to sort such models by their topology (i.e. such models can be sorted "by the structure of the fast subsystem").
All three forms of bursting are capable of beating and periodic bursting. Periodic bursting (or just bursting) is of more interest because many phenomena are controlled by, or arise from, bursting. For example, bursting due to a changing membrane potential is common in various neurons, including but not limited to cortical chattering neurons, thalamacortical neurons, and pacemaker neurons. Pacemakers in general are known to burst and synchronize as a population, thus generating a robust rhythm that can maintain repetitive tasks like breathing, walking, and eating. Beating occurs when a cell bursts continuously with no periodic quiescent periods, but beating is often considered to be an extreme case and is rarely of primary interest.
Bursting cells are important for motor generation and synchronization. For example, the pre-Bötzinger complex in the mammalian brain stem contains many bursting neurons that control autonomous breathing rhythms. Various neocortical neurons (i.e. cells of the neocortex) are capable of bursting, which "contribute significantly to [the] network behavior [of neocortical neurons]". The R15 neuron of the abdominal ganglion in "Aplyisa", hypothesized to be a [pneurosecretory[] cell (i.e. a cell that produces hormones), is known to produce bursts characteristic of neurosecretory cells. In particular, it is known to produce parabolic bursts.
Since many biological processes involve bursting behavior, there is a wealth of various bursting models in scientific literature. For instance, there exist several models for interneurons and cortical spiking neurons. However, the literature on parabolic bursting models is relatively scarce.
Parabolic bursting models are mathematical models that mimic parabolic bursting in real biological systems. Each burst of a parabolic burster has a characteristic feature in the burst structure itself – the frequency at the beginning and end of the burst is low relative to the frequency in the middle of the burst. A frequency plot of one burst resembles a parabola, hence the name "parabolic burst". Furthermore, unlike elliptic or square-wave bursting, there is a slow modulating wave which, at its peak, excites the cell enough to generate a burst and inhibits the cell in regions near its minimum. As a result, the neuron periodically transitions between bursting and quiescence.
Parabolic bursting has been studied most extensively in the R15 neuron, which is one of six types of neurons of the "Aplysia" abdominal ganglion and one of thirty neurons comprising the abdominal ganglion. The "Aplysia" abdominal ganglion was studied and extensively characterized because its relatively large neurons and proximity of the neurons to the surface of the ganglion made it an ideal and "valuable preparation for cellular electrophysical studies".
Early attempts to model parabolic bursting were for specific applications, often related to studies of the R15 neuron. This is especially true of R. E. Plant and Carpenter, whose combined works comprise the bulk of parabolic bursting models prior to Ermentrout and Kopell's canonical model.
Though there was no specific mention of the term "parabolic bursting" in Plant's papers, Plant's model(s) do involve a slow, modulating oscillation which control bursting in the model(s). This is, by definition, parabolic bursting. Both of Plant's papers on the topic involve a model derived from the Hodgkin–Huxley equations and include extra conductances, which only add to the complexity of the model.
Carpenter developed her model primarily for a square wave burster. The model was capable of producing a small variety of square wave bursts and produced parabolic bursts as a consequence of adding an extra conductance. However, the model applied to only spatial propagation down axons and not situations where oscillations are limited to a small region in space (i.e. it was not suited for "space-clamped" situations).
The lack of a simple, generalizable, space-clamped, parabolic bursting model motivated Ermentrout and Kopell to develop the theta model.
Characteristics of the model.
General equations.
It is possible to describe a multitude of parabolic bursting cells by deriving a simple mathematical model, called a canonical model. Derivation of the Ermentrout and Kopell canonical model begins with the general form for parabolic bursting, and notation will be fixed to clarify the discussion. The letters formula_1, formula_2, formula_3, formula_4 are reserved for functions; formula_5, formula_6, formula_7 for state variables; formula_8, formula_9, and formula_10 for scalars.
In the following generalized system of equations for parabolic bursting, the values of formula_1 describe the membrane potential and ion channels, typical of many conductance-based biological neuron models. Slow oscillations are controlled by formula_3, and ultimately described by formula_6. These slow oscillations can be, for example, slow fluctuations in calcium concentration inside a cell. The function formula_2 couples formula_15 to formula_16, thereby allowing the second system, formula_15, to influence the behavior of the first system, formula_16. In more succinct terms, "formula_5 generates the spikes and formula_6 generates the slow waves". The equations are:
where formula_5 is a vector with formula_9 entries (i.e. formula_25), formula_6 is a vector with formula_10 entries (i.e. formula_28), formula_8 is small and positive, and formula_1, formula_2, formula_3 are smooth (i.e. infinitely differentiable). Additional constraints are required to guarantee parabolic bursting. First, formula_33 must produce a circle in phase space that is invariant, meaning it does not change under certain transformations. This circle must also be attracting in formula_34 with a critical point located at formula_35. The second criterion requires that when formula_36, there exists a stable limit cycle solution. These criteria can be summarized by the following points:
The theta model can be used in place of any parabolic bursting model that satisfies the assumptions above.
Model equations and properties.
The theta model is a reduction of the generalized system from the previous section and takes the form,
This model is one of the simplest excitable neuron models. The state variable formula_7 represents the angle in radians, and the input function, formula_44, is typically chosen to be periodic. Whenever formula_7 reaches the value formula_46, the model is said to produce a spike.
The theta model is capable of a single saddle-node bifurcation and can be shown to be the "normal form for the saddle-node on a limit cycle bifurcation" (SNIC). When formula_47, the system is excitable, i.e., given an appriate perturbation the system will produce a spike. Incidentally, when viewed in the plane (formula_34), the unstable critical point is actually a saddle point because formula_49 is attracting in formula_34. When formula_51, formula_52 is also positive, and the system will give rise to a limit cycle. Therefore, the bifurcation point is located at formula_53.
Near the bifurcation point, the theta model resembles the quadratic integrate and fire model:
For I > 0, the solutions "blow up" rather quickly. By resetting the trajectory formula_55 to formula_56 when it reaches formula_57, the total period is then
Therefore, the period diverges as formula_59 and the frequency converges to zero.
Example.
When formula_44 is some slow wave which can be both negative and positive, the system is capable of producing parabolic bursts. Consider the simple example formula_61, where formula_62 is relatively small. Then for formula_63, formula_44 is strictly positive and formula_7 makes multiple passes through the angle formula_66, resulting in multiple bursts. Note that whenever formula_67 is near zero or formula_66, the theta neuron will spike at relatively a low frequency, and whenever formula_67 is near formula_70 the neuron will spike with very high frequency. When formula_71, the frequency of spikes is zero since the period is infinite since formula_7 can no longer pass through formula_46. Finally, for formula_74, the neuron is excitable and will no longer burst. This qualitative description highlights the characteristics that make the theta model a parabolic bursting model. Not only does the model have periods of quiescence between bursts which are modulated by a slow wave, but the frequency of spikes at the beginning and end of each burst is high relative to the frequency at the middle of the burst.
Derivation.
The derivation comes in the form of two lemmas in Ermentrout and Kopell (1986). Lemma 1, in summary, states that when viewing the general equations above in a subset formula_75, the equations take the form:
By lemma 2 in Ermentrout and Kopell 1986, "There exists a change of coordinates... and a constant, c, such that in new coordinates, the two equations above converge pointwise as formula_78 to the equations
for all formula_81. Convergence is uniform except near formula_46." (Ermentrout and Kopell, 1986). By letting formula_83, resemblance to the theta model is obvious.
Phase response curve.
In general, given a scalar phase model of the form
where formula_85 represents the perturbation current, a closed form solution of the phase response curve (PRC) does not exist.
However, the theta model is a special case of such an oscillator and happens to have a closed-form solution for the PRC. The theta model is recovered by defining formula_1 and formula_2 as
In the appendix of Ermentrout 1996, the PRC is shown to be formula_90.
Similar models.
Plant's model.
The authors of Soto-Treviño et al. (1996) discuss in great detail the similarities between Plant's (1976) model and the theta model. At first glance, the mechanisms of bursting in both systems are very different: In Plant's model, there are two slow oscillations – one for conductance of a specific current and one for the concentration of calcium. The calcium oscillations are active only when the membrane potential is capable of oscillating. This contrasts heavily against the theta model in which one slow wave modulates the burst of the neuron and the slow wave has no dependence upon the bursts. Despite these differences, the theta model is shown to be similar to Plant's (1976) model by a series of coordinate transformations. In the process, Soto-Trevino, et al. discovered that the theta model was more general than originally believed.
Quadratic integrate-and-fire.
The quadratic integrate-and-fire (QIF) model was created by Latham et al. in 2000 to explore the many questions related to networks of neurons with low firing rates. It was unclear to Latham et al. why networks of neurons with "standard" parameters were unable to generate sustained low frequency firing rates, while networks with low firing rates were often seen in biological systems.
According to Gerstner and Kistler (2002), the quadratic integrate-and-fire (QIF) model is given by the following differential equation:
where formula_92 is a strictly positive scalar, formula_93 is the membrane potential, formula_94 is the resting potential formula_95 is the minimum potential necessary for the membrane to produce an action potential, formula_96 is the membrane resistance, formula_97 the membrane time constant and formula_98. When there is no input current (i.e. formula_99), the membrane potential quickly returns to rest following a perturbation. When the input current, formula_4, is large enough, the membrane potential (formula_93) surpasses its firing threshold and rises rapidly (indeed, it reaches arbitrarily large values in finite time); this represents the peak of the action potential. To simulate the recovery after the action potential, the membrane voltage is then reset to a lower value formula_102. To avoid dealing with arbitrarily large values in simulation, researchers will often set an upper limit on the membrane potential, above which the membrane potential will be reset; for example Latham et al. (2000) reset the voltage from +20 mV to −80 mV. This voltage reset constitutes an action potential.
The theta model is very similar to the QIF model since the theta model differs from the QIF model by means of a simple coordinate transform. By scaling the voltage appropriately and letting formula_103 be the change in current from the minimum current required to elicit a spike, the QIF model can be rewritten in the form
Similarly, the theta model can be rewritten as
The following proof will show that the QIF model becomes the theta model given an appropriate choice for the coordinate transform.
Define formula_106. Recall that formula_107, so taking the derivative yields
An additional substitution and rearranging in terms of formula_7 yields
Using the trigonometric identities formula_111, formula_112 and formula_52 as defined above, we have that
Therefore, there exists a change of coordinates, namely formula_106, which transforms the QIF model into the theta model. The reverse transformation also exists, and is attained by taking the inverse of the first transformation.
Applications.
Neuroscience.
Lobster stomatogastric ganglion.
Though the theta model was originally used to model slow cytoplasmic oscillations that modulate fast membrane oscillations in a single cell, Ermentrout and Kopell found that the theta model could be applied just as easily to systems of two electrically coupled cells such that the slow oscillations of one cell modulates the bursts of the other. Such cells serve as the central pattern generator (CPG) of the pyloric system in the lobster stomatograstic ganglion. In such a system, a slow oscillator, called the anterior burster (AB) cell, modulates the bursting cell called the pyloric dilator (PD), resulting in parabolic bursts.
Visual cortex.
A group led by Boergers, used the theta model to explain why exposure to multiple simultaneous stimuli can reduce the response of the visual cortex below the normal response from a single (preferred) stimulus. Their computational results showed that this may happen due to strong stimulation of a large group of inhibitory neurons. This effect not only inhibits neighboring populations, but has the extra consequence of leaving the inhibitory neurons in disarray, thus increasing the effectiveness of inhibition.
Theta networks.
Osan et al. (2002) found that in a network of theta neurons, there exist two different types of waves that propagate smoothly over the network, given a sufficiently large coupling strength. Such traveling waves are of interest because they are frequently observed in pharmacologically treated brain slices, but are hard to measure in intact animals brains. The authors used a network of theta models in favor of a network of leaky integrate-and-fire (LIF) models due to two primary advantages: first, the theta model is continuous, and second, the theta model retains information about "the delay between the crossing of the spiking threshold and the actual firing of an action potential". The LIF fails to satisfy both conditions.
Artificial intelligence.
Steepest gradient descent learning rule.
The theta model can also be applied to research beyond the realm of biology. McKennoch et al. (2008) derived a steepest gradient descent learning rule based on theta neuron dynamics. Their model is based on the assumption that "intrinsic neuron dynamics are sufficient to achieve consistent time coding, with no need to involve the precise shape of postsynaptic currents..." contrary to similar models like SpikeProp and Tempotron, which depend heavily on the shape of the postsynaptic potential (PSP). Not only could the multilayer theta network perform just about as well as Tempotron learning, but the rule trained the multilayer theta network to perform certain tasks neither SpikeProp nor Tempotron were capable of.
Limitations.
According to Kopell and Ermentrout (2004), a limitation of the theta lies in its relative difficulty in electrically coupling two theta neurons. It is possible to create large networks of theta neurons – and much research has been done with such networks – but it may be advantageous to use Quadratic Integrate-and-Fire (QIF) neurons, which allow for electrical coupling in a "straightforward way".