Stereotyped sequences of neural activity are thought to underlie reproducible behaviors and cognitive processes ranging from memory recall to arm movement. One of the most prominent theoretical models of neural sequence generation is the synfire chain, in which pulses of synchronized spiking activity propagate robustly along a chain of cells connected by highly redundant feedforward excitation. But recent experimental observations in the avian song production pathway during song generation have shown excitatory activity interacting strongly with the firing patterns of inhibitory neurons, suggesting a process of sequence generation more complex than feedforward excitation. Here we propose a model of sequence generation inspired by these observations in which a pulse travels along a spatially recurrent excitatory chain, passing repeatedly through zones of local feedback inhibition. In this model, synchrony and robust timing are maintained not through redundant excitatory connections, but rather through the interaction between the pulse and the spatiotemporal pattern of inhibition that it creates as it circulates the network. These results suggest that spatially and temporally structured inhibition may play a key role in sequence generation.
From the kingfisher’s dive to the performance of a piano concerto, sequences of stereotyped actions are central to the everyday lives of humans and animals. One of the most well-studied behavioral sequences in nature is birdsong, and the physiology underlying HVC (the songbird analogue of mammalian premotor cortex and presumed neural sequence generator) has been a topic of intense interest. Principal neurons in HVC produce sparse, time-locked bursts of activity that are stereotyped from trial to trial [1,2]. Temporally-ordered neural activity has also been observed in other species in the context of various sequential behaviors [3–5], but the extreme precision and sparsity of the songbird premotor projection cells in HVC are unmatched. How is this spike timing precision maintained in the presence of biological noise? What makes neural sequence generation in this context robust? A well-studied model that provides a possible answer is the synfire chain [6,7]. The synfire chain assumes that excitatory (principal) neurons are organized into pools arranged in a redundant feedforward geometry (Fig 1A). Although synfire chains have not been directly observed in HVC, simulations have shown that the redundant synfire geometry combined with a threshold non-linearity can generate stereotyped, precisely timed sequential activity similar to that observed experimentally in HVC. Typically, models based on the synfire chain either exclude inhibition entirely [8], or simply use global inhibition to prevent runaway excitation or select between competing chains [9,10]. But a series of recent findings in zebra finch suggest that inhibitory spiking plays a larger role in defining the timing of excitatory cell sequences HVC than has been previously assumed. Guitchounts et al. [11] find that inhibitory spiking in HVC, like excitatory spiking, is extremely stereotyped from trial to trial. Kosche et al. [12] find that principal cells that project to the vocal motor pathway (HVCRA) receive stereotyped excitatory inputs at multiple points during the song, but only burst when excitatory inputs align with pauses in inhibition. And Markowitz et al. [13] recently observed that in a given region of HVC, excitatory cells that project to the basal ganglia (HVCX) and inhibitory cells (HVCI) fired at distinct phases of a stereotyped 30Hz component of the local field potential. Local field potentials were not globally synchronized across HVC; instead, their phase varied over the spatial extent of HVC, suggesting that the phasic coordination of cell firing was local rather than global. Here, we describe a general spiking model of neural sequence generation inspired by the observations of Markowitz et al. [13] that shows a similar local alternation of excitatory and inhibitory activity. Like the standard synfire chain, the model is based on feedforward excitatory chains that define an ordered sequence of cell firing. However, in contrast to the synfire chain, the separate strands of the chain do not coordinate their simultaneous activity through crossing excitatory connections. Rather, the strands interact and synchronize through common feedback inhibition (Fig 1B), which produces local inhibitory cycles that act as spatiotemporal “scaffolding” for the feedforward excitatory activity of the chain. We demonstrate in simulation that this locally patterned feedback inhibition synchronizes pools of cells like a synfire chain, and we present analysis that quantitatively describes this effect in terms of the decay rate of inhibition and other system parameters. Our simulations also show that our proposed network and its local inhibitory dynamics help to control the drift of spike timing from one trial to the next. Unlike many previous HVC modeling efforts, [14–16], our model is not intended to describe HVC in biological detail; instead, we use it to illustrate and investigate the possible contribution of local feedback inhibition to sequence generation. We do, however, discuss intriguing correspondences between the model’s behavior and observations in HVC.
In this work, a model of sequence generation is presented in which a spiraling excitatory chain conducts a pulse of excitatory activity repeatedly through multiple “zones” of inhibition (Fig 2). In each zone, the arrival of the pulse causes a pool of principal cells to fire; these cells then excite both a pool of principal cells in the next zone and a local source of feedback inhibition. The inhibition then decays until the pulse returns to that inhibitory zone. We show that the presence of this decaying inhibition acts to synchronize the firing of other local excitatory cells when the pulse returns and helps to establish spike timing consistency from one trial to the next. In order to demonstrate that synchronization in our model is independent of the synchronizing effect of synfire connectivity, we intentionally structure our excitatory chain without any fan-in or fan-out connectivity between consecutive pools of excitatory cells. Instead, each cell in a pool sends an excitatory projection to exactly one cell in the next pool. This connectivity pattern creates multiple parallel excitatory strands that do not interact through excitation—the only interaction between these strands is moderated by the local feedback inhibition activated when the pulse passes through each inhibitory zone (Figs 1B and 2). The conceptual model presented here can also be implemented with excitatory pools connected in a synfire chain, but such an implementation would not serve our purpose of demonstrating that synchronization in our model is independent of the synfire mechanism. The model described here was implemented in MATLAB. All code is available in a figshare digital repository at http: //dx. doi. org/10. 6084/m9. figshare. 1570957. All excitatory and inhibitory cells are modeled by quadratic integrate-and-fire (QIF) neurons with white noise [17]. The voltage V of a QIF neuron evolves according to the stochastic differential equation C d V = (V 2 R + I (t) ) d t + D d W (t) (1) where C is the neuron’s membrane capacitance, R is the resistance associated with the leak current, W (t) is a white noise process with variance 1, D is the amplitude of voltage noise, and I (t) is a source of time-varying external drive to the neuron. (All quantities are without units.) In our model, I (t) is a sum of excitatory and inhibitory post-synaptic currents (EPSCs and IPSCs, respectively) and a constant level of tonic drive. When V reaches a specific spiking voltage VS, it resets to a reset voltage VR < VS. In our model, VS = 1. For the inhibitory cells, VR = −1. We are interested in the synchronization of a single pulse that activates each excitatory cell only once (emulating the sparse firing of RA-projecting cells in HVC), so once the voltage of an excitatory cell reaches VS, it is no longer recorded. All cells are divided between N inhibitory zones. Each zone contains P pools of Me principal cells. Pools are ordered and numbered 0, …, NP − 1 in a chain that spirals through the zones P times so that pool p belongs to zone (p mod N). The principal cells in pool p are numbered m = 0, …, Me − 1. Cell m in pool p projects one-to-one to cell m in pool p + 1, forming a spiraling chain composed of Me parallel strands. When the system is initialized, spike times are chosen for cells in pool zero. For p > 0, cell m in pool p is modeled by a QIF neuron with voltage V p m. We let t p m denote the firing time of excitatory cell m in pool p. At this time, an EPSC is initialized in cell m in pool p + 1. The temporal profile of an EPSC in an excitatory cell is gee E (t), where gee is the strength of excitatory-to-excitatory connections and E (t) is the evolution of a gating variable over time. We require that E (t) be a positive, continuous function with E (t) = 0 for t ≤ 0 and E (t) differentiable for t > 0. Since the EPSC in cell m in pool p is initialized at time t p m, its height at time t is g e e E (t - t p m). An additional tonic drive of magnitude IE is applied to each principal cell. Every zone n contains a collection of Mi inhibitory QIF neurons with voltages U n m for m = 0, …, Mi − 1. These neurons are excited by the firing of any excitatory cell in any pool in zone n: when an excitatory neuron fires and initializes an EPSC in its downstream excitatory cell, it also delivers an EPSC to all inhibitory cells in its zone. This EPSC is described by the function g e i M e E (t - t p m), where gei is the strength of excitatory-to-inhibitory connections. The excitatory drive to each inhibitory cell is g e i M e ∑ p in zone n ∑ m = 0 M e - 1 E (t - t p m), the sum of the EPSCs it has received from all excitatory cells in its zone. When an inhibitory cell fires in zone n, a sustained IPSC is delivered to all excitatory and inhibitory cells in that zone. A single inhibitory synaptic gating variable ϕn is incremented by k M i (for some k > 0) each time a local inhibitory cell spikes, and decays exponentially with time constant Ti between spikes. Inhibition affecting excitatory and inhibitory cells in zone n is ϕn scaled by conductances gie and gii, respectively. Substituting a sum of excitation and inhibition for I (t) in Eq (1), we have the following equations for excitatory and inhibitory neuron membrane potentials (V p m and U n m, respectively): CedVpm= ( (Vpm) 2Re+geeE (t−tp−1m) −gieϕ (p mod N) +IE) dt+DedXpm (t) CidUnm= ( (Unm) 2Ri+geiMe∑p in zone n∑m=0Me−1E (t−tpm) −giiϕn) dt+DidWnm (t) dϕn= (−ϕnTi+kMi∑sδ (t−tns) ) dt (2) where d X p m (t) and d W n m (t) are white noise processes with variance 1; { t n s } is the set of local inhibitory spike times, i. e. , times that U n m = 1 for any m, indexed by s; and δ (t - t n s) is a Dirac delta function that integrates to 1 at any local inhibitory spike time. This system must be initialized in simulation from a set of initial voltages V p m and U n m, a set of Me initial excitatory spike times t 0 m, and a set of N gating variables ϕn that determine the initial level of inhibition in each zone at time t = 0. All voltages were initialized from zero at t = 0. Initial excitatory spike times were set by drawing t 0 m from a Gaussian distribution with mean 0ms and variance 2ms2. Inhibitory gating variables ϕn were initialized at a constant ϕ0. Parameters were chosen for this model in order to produce the desired dynamics when local feedback was activated. Specifically, the model was built and tuned with the following objectives in mind: Most or all of the pool had to fire before most or all of the local inhibitory response. Thus, the firing of a pool of principal cells had to evoke local feedback inhibition with a sufficiently large delay. In order to implement this delay, we chose inhibitory cell membrane capacitance and resistance relatively large, slowing the response (and, in particular, the membrane potential rise time) of the inhibitory cells. A swifter inhibitory response, as might have been produced by cell with shorter membrane time constants or, e. g. , leaky integrate-and-fire neurons, would have produced competition between principal cells within the pool (see, e. g. , [18] or [19]), which could play an important role in a sequence generating circuit of this type but was outside the scope of our study. At each spike volley, the decay of the inhibition produced by the previous local volley had to still be in progress. Thus, we had to choose an inhibitory decay time constant Ti that agreed roughly with the amount of time it took for an excitatory pulse to circle the loop once. If Ti was too large, inhibitory decay was too slow to produce noticeable synchronizing effects; if it was too small, the inhibition would be almost entirely gone by the time the pulse returned, with similar results. Synaptic conductances had to be tuned such that excitatory volleys consistently evoked responses in downstream excitatory and inhibitory cells, even when those cells were partially inhibited. As we note in the Discussion, propagation failure due to inhibition could help control for relaxed architectural constraints; however, pulse propagation failure was also outside the scope of our study. For feedback inhibition to improve the consistency of spike volley timing across trials, the response of the inhibitory populations to local spike volleys had to be consistent across trials. Running the simulation with a large number of inhibitory cells helped average out the effects of noise on the inhibitory population: when Mi was set to 1, we did not observe improved timing across trials. As long as these four conditions were met, the effects of local feedback inhibition on spike volley synchronization and timing described below were robust to variation in model parameters. We simulated this system with two different sets of parameters. In simulation 1, we set Me = 20, Mi = 50 and N = 5, and simulated the system with and without feedback inhibition. As we discuss below, this simulation run with feedback inhibition produced short periodic volleys of inhibitory spikes in each zone, an activity pattern considerably tidier than that of inhibitory cells observed in HVC. These dynamics obeyed conditions that made the system analytically tractable, allowing us to provide a quantitatively accurate theory explaining our simulation results. However, we also wanted to show that a more complex pattern of inhibitory activity could produce qualitatively similar results. For this purpose, we performed simulation 2, for which we set Me = 50 and adjusted various parameters related to the inhibitory cells. All parameter values for both simulations are listed in Table 1. For our simulations, we chose a simple but biologically-motivated function E (t): E (t) = { 0 for t < 0 (1 - e - t τ r) for 0 ≤ t < r (1 - e - r τ r) e - t - r τ d for r ≤ t (3) where τr is the time constant for the rise of the EPSC, r is the duration of its rise, and τd is the time constant of its decay (Fig 3). We set τr = 9ms, τd = 5ms, and r = 8ms. We chose long rise times to mimic the ≈ 10ms duration of principal cell bursts in HVC [1] and the ≈ 10ms depolarizations observed in these cells and attributed to principal-to-principal cell excitatory potentials [2]. When we ran simulation 1 with no feedback inhibition, we set gie = 0 and IE = −0. 3 in Eq (2) such that the level of drive to the excitatory cells was only the sum of a constant background and any incoming EPSC. We ran this simulation from the initial conditions described above. When we ran simulation 1 with feedback inhibition and simulation 2, we set gie = 0. 3. This change increased the average level of inhibition, so we offset its effect by raising IE to −0. 15.
Our model produced a spatiotemporal pattern of coordinated excitation and inhibition. In each region, the periodic arrival of the excitatory pulse triggered a periodic local inhibitory feedback response; thus, a wave of blanket inhibition circulated among the regions following the excitatory pulse. This pattern created a local alternation between excitatory and inhibitory firing (Fig 4), reminiscent of the observation of cell-type specific phase preferences in the 30Hz component of the local field potential in HVC [13]. In simulation 1, sharp volleys of principal cell spikes alternated with sharp volleys of inhibitory cell spikes (Fig 4B and 4C). In simulation 2, more inhibitory cells were included in each zone, inhibition between inhibitory cells was eliminated, and additional noise was added to inhibitory cell membrane potentials. In this simulation, inhibitory cells fired at all phases of the local cycle, but their firing rates increased after each local excitatory pool spiked and decreased again before the pulse returned to the same zone (Fig 4D). Instead of excitatory and inhibitory spikes occurring in short, discrete, alternating volleys, excitatory spikes occurred during phases of reduced inhibitory spiking, resembling the excitatory spiking during pauses in inhibition observed by Kosche et al. [12]. Our simulations also agreed with the observation of Markowitz et al. [13] that the phasic coordination of principal cells and inhibitory cells was not global: locally, excitatory spiking was locked to an inhibitory cycle, but globally, excitatory spiking continued throughout that cycle (Fig 5A). Upon examining individual excitatory spike rasters from our simulations (Fig 5), it was clear that local feedback inhibition promoted synchrony within pools of principal cells. Without feedback, there was no interaction between the m parallel strands of the chain, so the independent sources of noise caused the spike times within pools to drift apart; with feedback, the distribution of spike times instead remained tight as spiking propagated along the chain and around the ring of inhibitory zones. As a measure of within-pool synchrony and its evolution over time, we calculated the mean μp and variance vp of the spike times t p m in each pool p for each of 100 trials of simulation 1 (Fig 6). Without feedback, the trial-averaged variance vp of within-pool spike times increased without apparent bound. (This is to be expected, since the spike timing along each strand of the chain is effectively a random walk independent of the other strands.) When we introduced feedback inhibition, the trial-averaged vp instead decreased slightly and appeared to stabilize. Thus, feedback prevented the progressive desynchronization of pools and instead stabilized a tight distribution of spikes about the mean. To quantify the dependence of the synchronizing effect of local feedback on the model topology, we gradually introduced non-local E-to-I and I-to-E connections into the network in simulation 2. For each trial, we instantiated a fraction F of the possible global E-to-I and I-to-E connections and then normalized connection strengths to ensure that the excitatory pulse still reached the last pool. We normalized connection strengths by modifying Eq (2) to read C i d U n m = ( (U n m) 2 R i + g e i M e + F P M e ∑ p in zone n ∑ m = 0 M e - 1 E (t - t p m) - g i i ϕ n) d t + D i d W n m (t) d ϕ n = (- ϕ n T i + k M i + F M i ∑ sδ (t - t n s) ) d t The synchronizing effect of local feedback inhibition persisted until the number of added global connections reached 50% of the number of local E-to-I and I-to-E connections (Fig 7). The synchronizing effect of local feedback inhibition on chained pools of cells can be understood as a specific instance of the more general phenomenon of synchronization by a slow-decaying pulse of shared inhibition described by Börgers and Kopell in [20]. A cell in pool p that receives its excitatory pulse earlier than the others in its pool also receives its pulse under a heavier blanket of inhibition, so its latency to spike is greater, whereas a cell that receives its pulse late can fire with reduced latency. Thus, decaying inhibition reigns in outlier spike times and forces spike times within a volley towards a shared mean. This intuition is explored more thoroughly in the Analysis section below. Observations of spike rasters across 100 trials of simulation 1 suggested that in addition to synchronizing local spike volleys, local feedback inhibition also made volley timing more consistent across trials. For each simulation trial i and each pool p, we calculated the mean spike time μ p i, and then took the variance v p t r i a l s of these means across trials and plotted it against p (Fig 8). Both with and without feedback, v p t r i a l s increased roughly linearly. However, we found that when pools were given local feedback inhibition, the rate of increase of v p t r i a l s was reduced. This finding is similar to the observation in [21] that, as a pulse in a synfire chain reaches a state of steady near-synchronous propagation, its propagation velocity shows less inter-trial variability. However, there are important differences between our result and theirs. In particular, they found that as the pulse approached its steady state, the time between successive spike volleys became more regular. In our data, feedback inhibition did not strongly affect the regularity of the time between the firing of pool p and pool p + 1, but had a much more noticeable effect on the regularity of the time between the firing of pool p and the next pool in the same zone (pool p + N). (In simulation 1, feedback decreased the cross-trial variance of the interval between mean spike times in pool 99 and pool 100 by 6. 5%, as compared to a 28% decrease in variance of the interval between pools 95 and 100.) Thus, the reduction in inter-trial variability created by feedback inhibition was due to the stabilizing effect of lingering local feedback inhibition described above, which most directly influenced not the time of pulse propagation along excitatory connections, but rather the time for the pulse to circle the network and return. In order to more fully understand the cause of progressive synchronization in our model with feedback, we introduced additional assumptions and approximations to make the model analytically tractable. These assumptions and approximations made it possible to linearize the dynamics around a set of excitatory spike times and allowed us to express the relationship between model parameters and the stabilization of synchrony in terms of the solution to a first passage time problem. Combining this analysis with a computational investigation of the first passage problem, we found that we could quantitatively describe the effects of IPSC decay rate, EPSC rise rate, and noise on pool synchronization. Simulation 1 met our additional assumptions, and we found that the synchronizing behavior of simulation 1 indeed agreed with our analytical predictions. Our analysis demonstrates that progressive synchronization by feedback inhibition is not a special property of a finely tuned computational model but a generic property of spatially recurrent feedforward chains with local feedback inhibition.
We have put forward a model of sequence generation based on recent experimental findings in the songbird [12,13]. In this model, a feedforward chain of excitatory neurons passes repeatedly through multiple zones of inhibition, triggering local feedback inhibition in each. We have shown that this model can generate stereotyped neural sequences, creating synchrony among pools of cells through shared inhibition and stabilizing inter-trial spike timing. These effects can operate in place of (or, presumably, in cooperation with) the similar effects of the redundant feedforward excitatory connectivity that characterizes the synfire chain. Though previous models of neural sequence generation have used inhibition in a variety of ways [14,22–25], they are all fundamentally distinct in structure and dynamics from our model. In “winnerless competition” models inspired by the dynamics of insect olfaction, Rabinovich et al. [22] generate sequences through competitive inhibitory interactions in a randomly connected network. Verduzco-Flores et al. [24] and Assisi et al. [23] use a network of excitatory and inhibitory units to learn and generate sequences that propagate using a combination of disynaptic inhibition and adaptation currents. A series of modeling papers have proposed that sequences are generated using strong global (not local) inhibition to select between multiple possible synfire chains [9,10,14,15,26]. Some of these have incorporated precise spatial constraints on otherwise global inhibitory connectivity in order to disinhibit principal cells at the appropriate times [14,15]. Like us, Gibb et al. [14] and Bertram et al. [25] explore models of feedforward chains of excitatory cells with local inhibition, but they give their excitatory chains no manner of spatial recurrence, so the local inhibition evoked by a pool of excitatory cells cannot affect the spiking of cells at a later point along the chain. Our model is unique in the use of spatially recurrent excitatory chains, and in the use of local feedback inhibition to stabilize synchrony (rather than, e. g. , to propagate spiking by inducing rebounds as in [25]). We have shown in simulation that our model of an excitatory chain spiraling through inhibitory zones creates local alternation between excitatory and inhibitory cells, consistent with the observation of cell-type specific phase preferences in the 30Hz component of the local field potential in HVC [13]. Moreover, it reproduces the observation that spiking is not globally phase-coordinated, but occurs continuously throughout song. None of the models discussed above produce such a firing pattern—it is a natural consequence of localized inhibition and spatially recurrent excitatory activity, the same factors that differentiate our model from previous work and produce its synchronizing and temporally stabilizing dynamics. Our model is also consistent with paired recordings in slice, which have shown that excitatory neurons in HVC contact each other primarily through disynaptic inhibition [12,27] as would be expected in a network dominated by local inhibitory feedback and with only sparse, specific monosynaptic connections between principal cells. Finally, there is small but growing evidence that HVC activity is correlated over space [28,29] and that HVC connectivity is spatially structured [12,30–32], consistent with a model in which spatial regions of HVC act as inhibitory zones. However, our model deviates from what is known experimentally in two important respects. First, interneurons in our model fire with strong periodicity, yet HVC interneurons have dense firing patterns with intermittent periodicity during singing [13,33] (see S2 Fig). Additionally, the stereotyped ≈ 30 Hz LFP, which is correlated with interneuron firing, is not a perfectly periodic signal [13]. The periodicity in the model is a result of its highly simplified structure. If the topological structure of the chain were more complex than a simple spiral, inhibitory activity might more closely resemble what has been observed experimentally; however, this is beyond the scope of the current study. Second, our model implies that inhibitory interactions between HVCRA neurons should be primarily localized to a subregion of HVC, but recent evidence suggests that HVCRA pairs inhibit each other over relatively large distances (hundreds of μm) [12]. Our simulations with added global connectivity (S2 Fig) show that our model is robust to between-zone disynaptic inhibition up to a 2: 1 local-to-global connection ratio. Moreover, future experiments will be needed to directly observe whether disynaptic inhibition between HVCRA neurons is in fact local or global. As constructed for this study, our model has the capacity to play back only one sequence. In the case of the zebra finch, which learns only one song, this is an appropriate constraint, but this limitation would have to be addressed for broader applications. Storage of and selection between multiple sequences has been explored by other authors, both in HVC [9,14,15] and more generally [10,26,34,35]. We note that the spatial recurrence which is central to our model could be exploited for this purpose: multiple disconnected chains passing through the same sequence of regions could activate the same cycle of local feedback inhibition and benefit from the same stabilization of timing. We have demonstrated in simulation and through proof that the presence of shared decaying inhibition progressively synchronizes the firing of pools of excitatory cells. We have also derived a specific asymptotic upper bound for the expected variance that decreases with increasing bmin, where bmin represents an upper bound on the magnitude of the decay rate of inhibition during local excitatory spiking. The more sharply the local inhibition is decaying during the spiking of a pool, the larger a value we can choose for bmin. Consequently, the more sharply local feedback inhibition is decaying when a pool of cells spikes, the tighter the resulting synchrony guaranteed by our analysis. (We note that there is a non-trivial relationship between the exponential time constant Ti of inhibitory decay and the instantaneous rate of inhibitory decay—since inhibitory decay is exponential, the latter also depends on the level of inhibition and thus on the recent inhibitory spiking history.) We have also shown in simulation that local feedback inhibition creates sequences with timing that is more stereotyped across trials. One possible intuitive explanation for this effect is that the inhibitory state of each zone stores information about the timing of the most recent local volley; thus, the drift in volley timing due to noise can be partially corrected as the excitatory pulse reaches each zone. In other words, the information about the timing of the previous volley delivered by E-to-E connections and the information about the timing of the most recent local volley delivered by I-to-E connections are both incorporated to determine the timing of each spike volley. Our model is closely related to the mechanism of “communication through resonance” developed by Hahn et al. [36]. In their model, pools of cells are synchronized by cycles of inhibition evoked by the arrival of external periodic excitatory pulses, whereas in our model pools of cells are synchronized by cycles of inhibition evoked by a single excitatory pulse as it returns periodically to each inhibitory zone. A similar model developed by Jahnke et al. [37] supports synchronous propagation of pulses through a network by imposing global oscillations resonant with transmission delays. Their model requires net-excitatory oscillating input or nonlinear coupling in order to keep the pulse from dying while the network is inhibited. In our model, these global oscillations are replaced by multiple local oscillations at different phases. Although the oscillations involve periods of inhibition, our network is never globally inhibited, circumventing this possible cause of propagation failure. It is important to note the relationship between our model and the ideas discussed by Long et al. in [2]. They show that principal cells in HVC routinely receive strong depolarizations immediately before spiking. They use this observation to support an excitatory chain model and reject a model in which cells fire as a ramp of excitatory drive pushes them sequentially past their firing thresholds. Our model effectively combines these two mechanisms: cells receive strong depolarizations due to the excitatory chain structure embedded in the network, but the timing of spikes is also influenced by more gradual downward ramps of inhibition that affect (but do not fully determine) the time that the drive to each cell crosses threshold. Since the timing of sequential activity is influenced by the local network state as well as the arrival of an excitatory pulse, a model of this type would be better suited than a synfire chain to produce sequential activity that is non-uniform in time [38]. It could be argued that a chain of excitatory connections with periodic spatial recurrence is biophysically implausible. However, our model only requires that excitatory activity pass through inhibitory zones sequentially and return to them regularly; preliminary simulations suggest that such a pattern of activity may be achievable on a random excitatory network grouped into zones with localized inhibitory feedback. As an excitatory pulse propagates through the network, it is followed by a wave of local inhibition. This inhibition prevents excitation from returning to a zone until it has decayed sufficiently. Once it has decayed, random percolation ensures that activity does return. The result is a pulse that passes through the zones in an order determined by connectivity and initial levels of inhibition, and that meets the decaying inhibition from its previous pass as it reaches each zone. This pulse may activate different cells on each pass, generating a sequence significantly longer than a single pass through the network. The extraneous excitatory connections in such a random network would trigger EPSCs in some cells while they remained under strong inhibition, potentially explaining the observation of multiple stereotyped depolarizations in HVCRA cells during zebra finch song [12]. Furthermore, as regions are repeatedly activated in the same order, the network might use spike-timing-dependent plasticity to learn the excitatory connections necessary to reliably reproduce this pattern, ultimately creating the circulating chain architecture assumed in our model. In Fig 7, we show that synchronization through local feedback is somewhat robust to connection noise—once network connectivity became sufficiently localized, feedback inhibition would begin to contribute to pulse synchronization. For this mechanism to function, excitatory activity returning to a region of HVC must arrive during the decaying slope of the inhibition, and must therefore circulate through the inhibitory zones on a time scale matching the decay of inhibition. In our model, this is achieved through manual tuning. However, a learning process in HVC like the one described above might help to match these timescales by ensuring that excitatory activity returns to a zone as soon as inhibition decays sufficiently to permit it. Alternatively, the timescale of recurrence may relate to the cortical-thalamic loop cycle time, which does appear to match the time-constant of inhibitory decay [12]. In this view, the spiral does not exist entirely in HVC, but instead passes through the cortical-thalamic loop. Our model also may throw a new light on certain dynamics in the mammalian brain. Two brain regions in which precisely-timed sequential activity is thought to be essential are the motor cortex [39] and hippocampus [40]. Both of these regions have been shown to support rhythmic traveling waves, at beta frequencies (15–30Hz) [41] and theta frequencies (4–10Hz) [42] respectively. We suggest that these waves may be a manifestation of the locally-coordinated, globally out-of-phase inhibitory cycles that characterize our model and help synchronize neuronal pools and stabilize timing within a firing sequence.
Sequences of stereotyped actions are central to the everyday lives of humans and animals. It was hypothesized over half a century ago that these behaviors were enabled by linking together groups of neurons (or “cell assemblies”) into a feedforward chain using correlation-based learning rules. These chains could then be activated to generate particular behavioral sequences. However, recent data from HVC (the songbird analogue of premotor cortex) paint a more complicated picture: inhibitory and excitatory cells lock to different phases of a rhythm, with inhibitory cells providing windows of opportunity for the excitatory cells to fire. This study puts forward a mathematical model that uses both a feedforward chain geometry and local feedback inhibition to generate stereotyped neural sequences. The chain conducts an excitatory pulse through multiple spatial regions, arriving at each as local inhibition dips. Our simulations and analysis demonstrate that such patterned local inhibition can synchronize the firing of pools of neurons and stabilize spike timing along the chain. Our model provides a new way of thinking about sequence generation in the songbird and in neural circuits more generally.
Neural Sequence Generation Using Spatiotemporal Patterns of Inhibition