How the insect central complex could coordinate multimodal navigation
Abstract
The central complex of the insect midbrain is thought to coordinate insect guidance strategies. Computational models can account for specific behaviours, but their applicability across sensory and task domains remains untested. Here, we assess the capacity of our previous model (Sun et al. 2020) of visual navigation to generalise to olfactory navigation and its coordination with other guidance in flies and ants. We show that fundamental to this capacity is the use of a biologically plausible neural copy-and-shift mechanism that ensures sensory information is presented in a format compatible with the insect steering circuit regardless of its source. Moreover, the same mechanism is shown to allow the transfer cues from unstable/egocentric to stable/geocentric frames of reference, providing a first account of the mechanism by which foraging insects robustly recover from environmental disturbances. We propose that these circuits can be flexibly repurposed by different insect navigators to address their unique ecological needs.
Editor's evaluation
This eLife Advance by Sun et al. expands on a previous publication in 2020 which developed and outlined a model for biologically inspired visual navigation circuit. Here they include odour and wind input and successfully recreate complex multimodal behavioural observations in ants, illustrating that the model is suited to generate viable hypotheses about circuit-level implementation of navigational control networks in insects in response to varied sensory inputs.
https://doi.org/10.7554/eLife.73077.sa0Introduction
Recently, it has been proposed that the repertoire of robust navigation behaviours displayed by insects (Webb and Wystrach, 2016; Wehner, 2019) can be traced to the well-conserved brain region known as the central complex (CX) (Honkanen et al., 2019; Hulse et al., 2021). The evidence to support this hypothesis includes the discovery of the insect head-direction system in the CX that tracks the animal’s current heading relative to external (Heinze, 2014; Seelig and Jayaraman, 2015; Kim et al., 2019; Hardcastle et al., 2021) or self-motion (Green et al., 2017; Turner-Evans et al., 2017) cues; the innervation of the fan-shaped body (FB) region of the CX with sensory information relevant to different orientation strategies (Hu et al., 2018; Franconville et al., 2018; Hulse et al., 2021; Shiozaki et al., 2020); the well-preserved columnar structure that is well suited to computing desired headings for vector navigation tasks (Stone et al., 2017; Honkanen et al., 2019; Le Moël et al., 2019; Lyu et al., 2020); and the identification of a neural steering circuit in the FB capable of computing motor commands that reduce the offset between the current heading and a desired heading (Stone et al., 2017; Honkanen et al., 2019; Rayshubskiy, 2020). Computational models of this architecture have produced realistic path integration (PI) (Stone et al., 2017; Gkanias et al., 2019) and trap-lining behaviours (Le Moël et al., 2019), and simple conceptual extensions have been outlined that could account for long-distance migratory behaviour (Honkanen et al., 2019). Yet, for the CX to be considered a general navigation centre, it must additionally be capable of (i) generating gradient ascent/descent behaviours that rely on spatially varying but rotationally invariant sensory cues (e.g. odour gradients), (ii) coordinating competing guidance systems into a single meaningful motor command, and (iii) generalise across sensory modalities and task spaces.
We recently demonstrated how the steering circuit could be adapted to ascent gradients of visual familiarity when augmented by a neural ‘copy-and-shift’ mechanism that converts temporal changes in spatially sampled sensory information into an orientation signal (Sun et al., 2020). Specifically, the mechanism firstly copies the animal’s current heading from the head-direction cells in the protocerebral bridge (PB) to desired heading networks in the FB. At the same time, the signal undergoes a lateral shift in proportion to any undesired change in sensory valence as measured by the mushroom body (MB) output neurons (Aso et al., 2014; Li et al., 2020; Hulse et al., 2021). Thus, the animal will continue on its current heading until an undesirable change in sensory valence is experienced at which point the shift mechanism will create an offset between the current and desired headings, causing the steering circuit to initiate a change of direction. The architecture of the CX already possesses neural substrates ideally suited for both the ‘copy’ and ‘shift’ functions: head-direction cells are known to transmit their output into the ring structures of the central body (Stone et al., 2017; Honkanen et al., 2019) as needed for copy stage; and neural mechanisms that laterally shift the head-direction cells in response to sensory feedback (e.g. the self-motion cues [Turner-Evans et al., 2017; Green et al., 2017], the visual cues [Kim et al., 2019; Fisher et al., 2019]) are well established as required for the shift stage. Crucially, the complete ‘copy-and-shift’ mechanism explains how the CX steering circuit (see Figure 1) could exploit sensory gradients that provide no instantaneous orientation information for navigation.
We also demonstrated neural mechanisms that coordinate between different guidance strategies (Sun et al., 2020). Specifically we added a contextual-switching mechanism (see Figure 1) that triggers specific guidance strategies depending on the context, for example, switching from PI unfamiliar surroundings to visual route following in familiar terrain. As a final stage, we revealed how ring attractor (RA) circuits (Touretzky, 2005; Sun et al., 2018; see Figure 1) that we hypothesise exist in the FB provide an ideal substrate for optimally integrating cues that exist within a shared context (e.g. PI and visual homing [VH] in unfamiliar contexts). The ‘copy-and-shift’ mechanism again plays a crucial role in this capacity as it ‘transfers’ orientation outputs into a shared frame of reference. For example, when ascending gradients, temporal changes in visual familiarity are translated into heading commands relative to the head-direction system which then share a frame of reference with the PI system.
This biologically constrained model of the insect midbrain was shown to be capable of generating realistic visual navigation behaviours of desert ants through the coordinated action of visual route following (RF), VH, and PI modules partially addressing two of the requirements listed above (Sun et al., 2020). In this study, we extend our analysis of the model, and in particular the ‘copy-and-shift’ mechanism, to assess if it can address the latter issue of generalisation across and between sensory and task domains. The following sections first assess whether the model can be easily reapplied to the olfactory tasks of chemotaxis and odour-gated anemotaxis (plume following) in laboratory-like settings. We then probe whether the same integration mechanisms can generalise to odour-gated switching in both flies and desert ants. Finally, we provide the first account of how the CX could transfer orientation cues from an egocentric to a geocentric frame of reference which we propose can enhance the robustness of navigation.
Results
Core odour navigation behaviours using copy-and-shift
Here we assess the ease with which our visual navigation model generalises olfactory navigation tasks.
Chemotaxis of odour gradients
Adult and larvae fruit flies readily climb rewarding odour gradients by modulating their heading direction in direct response to the temporal change in odour concentration (Gomez-Marin et al., 2010; Nagel and Wilson, 2011; Kim et al., 2011; Schulze et al., 2015; Jung et al., 2015) mirroring our model’s approach to VH. Moreover, the neural pathways of olfactory processing are well established and only differ from our model in their sensory origins (antennal lobe [AL] to the lateral horn [LH] [Gupta and Stopfer, 2012; Roussel et al., 2014] and MBs [Aso et al., 2014; Hulse et al., 2021]) before connecting to the CX through direct or indirect (hypothetically via superior medial protocerebrum [SMP]; Plath et al., 2017; Hulse et al., 2021; Li et al., 2020) neural pathways. Thus by simply changing the input from optic to ALs and the processing region from the MB to the LH and MB (see Figure 2A, left panel) our model is able to adapt its heading to align with the positive odour gradient over successive steps (see Figure 2B, left panel). Note that here we simply take the valence output of the MB as the odour concentration, buy any other equivalent measurement (such as the degree of attraction) could work along with the ‘copy-and-shift’ mechanism. Figure 2C (left panel) demonstrates the realistic chemotaxis behaviour generated by the model in a classic ‘volcano’ environment (Jung et al., 2015; Schulze et al., 2015). Figure 2—figure supplement 1 provides similarly realistic paths in other odour landscapes. It should be noted that there are neural pathways not included in the model that directly link odour input to motor outputs that may play a role in chemotactic guidance (Green et al., 2019; Rayshubskiy, 2020; Scaplen et al., 2021). Indeed while larvae possess MB and LH assemblies, they do not have a fully developed CX as modelled here (Gowda et al., 2021). Analysis of behavioural deficiencies in animals with CX knockouts would offer crucial insights into the role of the CX for chemotactic behaviours.
Anemotaxis in odour plumes
In moving airflows, adult fruit flies pinpoint olfactory sources by anemotaxis whereby individuals align with the upwind direction, allowing them to approach the hidden odour source (Kennedy and Marsh, 1974; Rutkowski et al., 2009; van Breugel and Dickinson, 2014). Insects sense wind direction through deflections of their antennae (Yorozu et al., 2009; Patella and Wilson, 2018; Okubo et al., 2020) with the wedge projection neurons (WPNs) converting their inputs (via antennal mechanosensory and motor centre [AMMC] pathway in Figure 2B, right panel) into a direction relative to the animal’s current heading (Suver et al., 2019; see Figure 2—figure supplement 2). The WPN output is then transmitted to the FB of the CX via the lateral accessory lobe (LAL) -> noduli (NO) pathway (Hulse et al., 2021; Matheson et al., 2021; Figure 2B, right panel). The ‘copy-and-shift’ mechanism again provides the ideal bridge between input signal and steering circuit. By simply driving the direction and magnitude of the ‘shift’ by the WPN response when a rewarding odour is detected (Figure 2A, right panel), the model turns the agent upwind (see Figure 2B, right panel). Figure 2C (right panel) shows an example path of a simulated fly navigating a classic laboratory environment with an odour plume into which rewarding odour is toggled ON and OFF (for a simulation of a group agents, see Figure 2—figure supplement 3), which demonstrates realistic odour-driven anemotaxis behaviour.
Taken together the above data demonstrate the capacity of the model to generalise from visual to olfactory navigation without significant alteration.
Coordination of guidance behaviours by linking frames of reference
With the model shown to generalise from visual to olfactory navigation tasks, we now assess its ability to coordinate guidance strategies across sensory domains.
Contextual switching between olfactory guidance behaviours
In reality insects utilise both the chemotaxis and anemotaxis strategies outlined above. Across species and environments (laminar odour gradient or turbulent odour plume), a distinct behavioural trigger is reported at the onset (ON response) or loss (OFF response) of sensory valence (moths [Kennedy and Marsh, 1974; Rutkowski et al., 2009], flying fruit flies [van Breugel and Dickinson, 2014], walking flies [Steck et al., 2012; Bell and Wilson, 2016; Álvarez-Salvado et al., 2018]). Specifically, in the presence of the attractive odour animals apply anemotaxis and surge upwind, but when the attractive odour is lost they engage in a chemotactic-like search to recover the plume. This problem is analogous with the contextual switching used in our previous model to select between ON- and OFF route navigation strategies (Wystrach et al., 2012). Figure 3A (left panel) depicts how the CX switching circuit can be easily reconfigured to be triggered by the instantaneous change of odour concentration fitting with the reported ON and OFF responses (Álvarez-Salvado et al., 2018). Note that we here assume that the ON and OFF responses are driven by the output neurons of the odour processing brain regions (i.e. MBON or LHON) that could compute the temporal changes of odour concentration (Dolan et al., 2018; Hulse et al., 2021; Matheson et al., 2021). Figure 3B (left panel) illustrates simulated ON and OFF responses that are supplied to the model and their behavioural consequence. Figure 3 (left panel) demonstrates realistic olfactory navigation behaviour similar to the behavioural data in Álvarez-Salvado et al., 2018. See also the simulation results of a 20-agent group demonstrating similar performance in Figure 3—figure supplement 1.
Optimally integrating navigation behaviours across sensory domains
In barren salt pans, homing desert ants follow their path integrator to their nest area before relying on nest odour plumes for their final approach (Buehlmann et al., 2012). Ants bypass the nests of conspecifics that diffuse similar odours () until reaching the nest locale (Buehlmann et al., 2012), indicating use of a sophisticated integration strategy beyond simple switching outlined above. Rather, ants instead appear to weigh their PI output relative to the home vector length in a similar fashion to their integration of PI and visual cues (Wystrach et al., 2015; Legge et al., 2014) as was realised in our previous model using ring attractor networks (Touretzky, 2005; Sun et al., 2018; Sun et al., 2020). Figure 3A (right panel) depicts the augmentation of our odour-gated anemotaxis model with a ring attractor circuit to optimally integrate PI and olfactory navigation outputs. These adaptations are in accordance with the olfactory navigation mechanisms (chemotaxis and anemotaxis) proposed to be used by ants by Wolf and Wehner, 2000; Wolf and Wehner, 2005. Note that the desired headings recommended by odour homing (OH, or chemotaxis) and upwind direction (UW, or odour-gated anemotaxis) are gated by the OFF and ON responses and weighted by the odour concentration signal prior to being injected into the ring attractor to be combined with PI. Figure 3B (right panel) illustrates how the various desired heading signals are optimally integrated by the ring attractor network before being sent as input to the steering circuit. Figure 3C shows homing paths generated by the model following simulated displacements left or right of the regular feeder which closely match those of real ants (Buehlmann et al., 2012). Note that there is an additional odour plume diffused by a simulated conspecific nest positioned near the release points which causes some distraction before the simulated ants continue to the real nest site. In the absence of the distractor, nest paths are much more direct (see Figure 3—figure supplement 1).
Taken together these data demonstrate that the CX possess the neural mechanisms to flexibly coordinate the various guidance behaviours observed in insects across sensory domains, supporting its role as the navigation centre (Honkanen et al., 2019; Hulse et al., 2021).
A mechanism for transferring between orientation frames of reference
The optimal integration model detailed above is reliant on the copy-and-shift mechanism firstly ensuring that all orientation cues are presented in a shared frame of reference. Recall that the desired headings for PI, chemotaxis and anemotaxis are all defined in relation to the animal’s global head direction. In the following analysis, we assess whether this frame-changing capacity can also provide benefits for navigational robustness.
From egocentric wind direction to geocentric celestial compass
Desert ants travel to and from familiar feeder locations via visually guided routes (Kohler and Wehner, 2005; Mangan and Webb, 2012), but wind gusts can blow them off course. Wystrach and Schwarz, 2013 reported that in the instant prior to displacement ants assume a stereotypical ‘clutching’ pose during which they transfer their egocentric measure of wind direction (indicating the direction in which they are about to be blown) into a geocentric frame of reference given by their celestial compass. Displaced ants then utilise this celestial compass memory to guide their path directly towards their familiar route (Figure 4A, left panel). Such a strategy is easily accounted for by the ‘copy-and-shift’ mechanism as seen in Figure 4B (left panel). That is, during the clutch pose the celestial compass heading is copied and shifted by the activation of the WPN encoding the upwind direction relative to the animal’s heading to create a desired heading that points back along the direction of travel. This desired heading is maintained in a working memory during displacement before activation to guide the agent back to the familiar route region (see simulated navigating paths in Figure 4C, left panel).
From visual context to geocentric celestial compass
Similarly, homing desert ants captured just before entering their nest and released in unfamiliar visual surroundings initially dash back along the celestial compass heading in which they were travelling (Wystrach et al., 2013; Figure 4A, right panel). Note that this differs from the behaviour of ants lacking PI cues and displaced from other locations along the route. Those ants have no preferred direction of travel following displacement according to the observation (Wystrach et al., 2013). This indicates that the sight of the nest surroundings could be considered a ‘special circumstance’ in a similar way to the ‘clutching’ pose mentioned above. Figure 4B (right panel) depicts how this behaviour could also arise from the ‘copy-and-shift’ mechanism. That is, when there is a significant drop of visual novelty (as might only be experienced after a displacement from the nest), the compass direction is again copied and shifted by a predetermined amount, this case 180°. This creates a new desired heading that can be stored in working memory that will cause the initial search to be focused in the direction from which the animals just travelled (Figure 4C , right panel).
In summary, the data above demonstrate the flexibility of the ‘copy-and-shift’ mechanism to transfer directional cues from an unstable frame of reference such as the wind direction to a stable frame of reference such as the global celestial compass which can be used at a later time. We proposed that this transfer is triggered by special sensory experience and motivational state of the animal that could be driven by some of the numerous tangential inputs from multiple upstream brain regions to the FB (Franconville et al., 2018; Hulse et al., 2021) forming a contextually dependent guidance network. This again extends the repertoire of guidance behaviour that the mechanism can account for and further supports the role of the CX as a navigation centre.
Discussion
To summarise, we have shown how the CX-based steering circuit augmented with a copy-and-shift functionality can generate realistic odour-based chemotaxis and anemotaxis behaviours adding to the PI, VH, visual RF, and long-range migrations explained previously (Stone et al., 2017; Honkanen et al., 2019; Sun et al., 2020). We have also outlined CX-based mechanisms that can coordinate guidance cues across sensory domains using biologically realistic context-dependent switches and ring attractor networks. Finally, we demonstrated how the copy-and-shift mechanism can facilitate the transfer of orientation cues between unstable to stable frames of references. By triggering such a transfer under specific environmental conditions, insects can increase the robustness of their guidance repertoire. The model presented can thus be considered as a general navigation model extending across multiple behavioural tasks (alignment with rotationally varying compass, visual route, or wind cues; and gradient ascent of spatially varying but rotationally invariant cues such as odour and visual memories) experienced in multiple contexts. Taken together the results add further validation to the claim that the CX acts as the seat of navigation coordination in insects.
The CX is as ancient as insects themselves (Homberg, 2008; Strausfeld, 2009) and is highly conserved across different species solving different navigational tasks (Honkanen et al., 2019; Hulse et al., 2021). This fixed circuitry thus appears optimised to receive input from a variety of sensory sources and return a similar variety of navigational behaviours applicable across contexts. Indeed, Doyle and Csete, 2011 posits that such ‘bowtie’ (or hourglass) architecture is also observed in the decision-making circuits of the mammalian brain (Redgrave et al., 1999; Humphries and Prescott, 2010) and function by providing ‘constraints that deconstrain’ (see Figure 5A). That is, the fixed circuitry of the CX constrains the format of the sensory input but decontrains the application domains of the output behaviours. Through interpreting various navigation behaviours through the lens of the ‘copy-and-shift’ mechanism, our model can be considered an example of such bowtie structure within the CX (Figure 5B).
This study has explored the behavioural consequences of the mechanisms using abstracted neural implementations, raising the question as to whether they can be realised in insect brains. Regarding the copy-and-shift mechanism, lateralised neural connections and synapse plasticity that shift the head-direction output relative to sensory input (i.e. nudge the activation ‘bump’ within a population of neurons) have already been mapped (Seelig and Jayaraman, 2015; Green et al., 2017; Kim et al., 2019; Fisher et al., 2019) and modelled (Cope et al., 2017), demonstrating the feasibility of such computation. More recently, Goulard et al., 2021 presented a CX-based navigation model that includes a biologically realistic neural pathway that is functionally similar to the copy-and-shift mechanism proposed here. The same study also outlined how a short-term memory of a desired heading could be maintained in the FB of the CX via synapse-weight modulation after the original guidance cue is removed that could support the wind compensation and backtracking behaviours described above. Our model hypothesises the existence of a ring attractor network to optimally integrate the desired heading cues which we suggest could be realised in the complex intra-connections within the FB and the NO (Hulse et al., 2021; Sayre et al., 2021). We also hypothesise that different populations of Protocerebral bridge - Fan-shaped body - Nodulus (PFN) neurons in the CX simultaneously store the distinct desired headings computed by the independent navigation systems (e.g. PI-based home vector is stored in CPU4 neurons [a subset of PFNs]; Stone et al., 2017; Hulse et al., 2021; Sayre et al., 2021). Further, the hypothetical context switching introduced could be achieved by the recently mapped FB-NOc neurons found in the bees (Sayre et al., 2021).
It is also worth noting that the simulated odour perception utilised here is very simplistic. For example, we assume that the odour stimulus (with or without a laminar airflow) forms a stable gradient, which while reflecting the laboratory settings in behavioural studies (Gomez-Marin et al., 2010; Gomez-Marin and Louis, 2012; Álvarez-Salvado et al., 2018) simplifies the spatiotemporally complex plumes in naturalistic settings where odour encounters are intermittent, occurring randomly as brief bursts (Murlis et al., 2000; Webster and Weissburg, 2001). We do note, however, that more stable odour gradients have been mapped to the desert surfaces upon which desert ants forage (Buehlmann et al., 2015). Regardless, insect olfactory receptor neurons (ORNs) and projection neurons (PNs) posses adaption (Kaissling et al., 1987; Nagel and Wilson, 2011) and divisive gain control (Luo et al., 2010; Olsen et al., 2010; Gorur-Shandilya et al., 2017) mechanisms that normalise and smooth noisy olfactory inputs. It is interesting to note that the visual gradients can often present data in a similar noisy fashion (personal observation) and thus raises the question as to whether similar processing steps are applied across modalities. Indeed, this hypothesis is supported by identification of shared early sensory processing principles across sensory modalities (Wilson, 2013), especially the vision and olfactory in insects (Mu et al., 2012) and mammals (Cleland, 2010). Another interesting point is the temporal presentation of information (e.g. continual or discrete) and how this might affect aspects such as optimal integration of cues. We suggest that optimal integration would not be unduly affected as sampling over longer time scales would simply reduce the strength of the more sparse samples cues to the ring attractor. Moreover, there may be benefits in sampling less as it could smooth out local noise in sensory gradients. Investigation of these questions through modelling studies that add more realistic sensory processing in more realistic sensory settings (odour [Demir et al., 2020], vision [Millward et al., 2021]) is vital to answering these questions.
Despite growing agreement on the functional role of the CX in insect navigation (Honkanen et al., 2019; Hulse et al., 2021), a number of issues remain. Firstly, as well as innervating the CX, both visual and olfactory cues are also transferred directly to motor centres (Rayshubskiy, 2020; Scaplen et al., 2021; Green et al., 2019) providing redundant information streams. One possibility is that the direct pathways are used for fast reflex-like movements, whereas the CX pathway is responsible for higher-level guidance that requires learning and integration of multiple elemental guidance systems (Currier et al., 2020; Matheson et al., 2021). This view is consistent with Steinbeck et al., 2020, who demonstrate that the LALs, downstream of the CX, possess neural structures well suited to integrating outputs of the fast and the slow pathways. For Drosophila larvae, there should be equivalent neural circuitry functioning similarly as the CX involved pathway (probably with the olfactory descending neurons PDM-DN; ; Gowda et al., 2021) and direct pathway (probably with odd neurons; Slater et al., 2015; Gowda et al., 2021). Future work is needed to merge these concepts into a single computational framework. Secondly, there is the question as to whether insects maintain a single or multiple head-direction signals in the PB. In our previous model (Sun et al., 2020), we introduced a global celestial compass used by VH and PI behaviours, and a local visual compass for RF. In this study, we relied solely on the global celestial compass, but wind direction sensing from the WPNs is known to feed into the head-direction cells (Okubo et al., 2020; Hulse et al., 2021), which could facilitate a local compass similar to our previous terrestrial compass. The utility and biological realism of the multi-compass hypothesis deserve further investigation. Thirdly, insects possess an MB in each brain hemisphere, posing the question as to their combined role. Le Möel and Wystrach, 2020 and Wystrach et al., 2020 offer the hypothesis that MBs form an opponent memory system that can drive visual RF by balancing the difference in their outputs. This approach can be easily extended to incorporate both attractive and repulsive MB output neurons extending the application space and robustness of navigation. Integration of dual MB inputs represents an obvious next extension of the model presented here. Finally, the model presented here is unique in the format of the sensory data input to the MBs and the behavioural strategies that the MBs generate. Specifically, we propose that the MBs process rotationally invariant but spatially varying cues (e.g. odour and visual familiarity gradients) and are thus responsible for generating gradient ascent/descent behaviours such as VH and chemotaxis via operant connections to the CX. In contrast, all rotationally varying cues (e.g. wind direction, visual route memories, and celestial compass) innervate the CX directly via alternate pathways (e.g. LAL). This separation of sensory information is fundamental to the flexibility of the model presented to create the array of behaviours presented and offers a testable hypothesis for future work. Such insights will be invaluable for refinement of our understanding of the robust navigation behaviours facilitated by the insect minibrain.
Materials and methods
All simulations and network models were implemented by Python 3.5 and external libraries numpy, matplotlib, scipy, opencv, etc. The source code of the simulation and plotting figures is available via GitHub.
Odour field
As the basic sensory input, the spatial concentration distribution of the odour field is simulated simply and based on the scaled exponential functions, with required changes according to the wind dynamics.
Odour field without wind
Request a detailed protocolFor the simulations in the laminar odour environment (i.e. no wind) as that in Figure 3 (left panel), the landscape of the odour concentration is modelled for ‘volcano’ shape:
and for ‘linear’ shape:
where is the distance from the position to the odour source . Thus, is the scale factor, is the radius of the odour source, and is the decay factor.
Odour field with wind
Request a detailed protocolTo simplify the simulation of the odour plume dynamics, all the simulations in this study were conducted under the condition of constant wind speed and wind direction , and we assume that the odour plume will ideally flow to the downwind area, that is, the odour concentration in the upwind area will always be zero. The source of the odour constantly emits at the rate . Then the odour concentration at position can be calculated by
where is the projected distance from the odour source. And is calculated by , where is the tuning factor determined by the stability of the odour. And is the angle between the vector pointing from the position to the source and the wind direction, so can be computed by
Neural model
We use the simple firing rate to model the neurons in the proposed networks, where the output firing rate is a sigmoid function of the input if there is no special note. In the following descriptions and formulas, a subscript is used to represent the layers or name of the neuron while the superscript is used to represent the value at a specific time or with a specific index.
Current heading
Request a detailed protocolIn our previous model, there are two compass references derived from different sensory information (Sun et al., 2020), but in this paper, only the global compass (i.e. the activation of I-TB1/ neuron) is used here because navigation behaviours reproduced in this study are all assumed using the global compass as the external direction reference. For the details of the modelling of global current heading (), see our previous paper (Sun et al., 2020).
Steering circuit
Request a detailed protocolThe steering neurons (the same as previous paper [Sun et al., 2020] but presented here for convenience), that is, CPU1 neurons () receive excitatory inputs from the desired heading () and inhibitory inputs from the current heading () to generate the turning signal:
The turning angle is determined by the difference of the activation summations between left () and right () set of CPU1 neurons:
Upwind direction encoding
Request a detailed protocolThe upwind direction is decoded as the activation of UW neurons copied and shifted from heading neurons (I-TB1), and the value of this shifting is determined by the angular difference between the current heading () and wind direction () encoded by the firing rate of WPN. And the value of WPN is defined as the difference of the antennal deflection encoded by B1 and APNs as
Then population activation of upwind direction neurons (UW) can be calculated by
Fly: ON and OFF responses-based switching circuit
Request a detailed protocolDifferent navigation strategies will dominate the motor system according to the sensory inputs, that is, in this study, the change of perceived odour concentration. This coordination is modelled as a contextual switching that is very similar to the mechanism with SN1 and SN2 neuron involved in our previous model (Sun et al., 2020) to define the final output of odour navigation ():
And how the sensory information determines the response is shown in Table 1, where random means no reliable sensory input is available, and the agent will move forward to a random direction.
OFF response: Chemotaxis
Request a detailed protocolThe chemotaxis model is adapted from the previous VH model (Sun et al., 2020) by changing the change of visual familiarity signal from the MBON () to the change of the odour concentration to determine the shifting value, thus the desired heading of chemotaxis is
Note that in our previous visual navigation model (Sun et al., 2020) both were integers for the ease of computing, thus, the shifting resolution is 45°, but here to more accurately model the desired heading and to achieve better performance, the shifting resolution was set to be 4.5° by interpolating neuron activation of I-TB1 from 8 to 80, then down-sampling to 8 to generate the shifted desired heading.
The relationship between and is shown as follows:
(11)
Then the desired heading of OH will be fed into the steering circuit to compare with the current heading to generate the motor command.
ON response: Odour-gated anemotaxis
As shown in Table 1, when the ON response is determined, the agent will follow the upwind direction, thus the desired heading input to steering circuit should be the upwind direction encoded by UM neuron (Equation 8):
Ants: Integration with PI
Request a detailed protocolThe modelling of ants’ odour navigation integrated with PI can be regarded as the extension of the fly’s odour navigation and an application of the unified model. Specifically, the final output of olfactory navigation is determined by the ON and OFF responses (see Table 1), and then is integrated with PI via RA like that in the optimal integration of PI and VH:
where is the recurrent connections from neuron to neuron, is the activation function that provides the non-linear property of the neuron:
where denotes the offset of the function. Thus should be
and in Equation 12 should be
Then the output of optimal integration (OI) of the RA acts as the only desired heading input to the steering circuit:
Only the global compass is needed in this study’s modelling. Thus the input of current heading will always be the excitation of the I-TB1 neuron:
The output of the steering circuit (i.e. the summed activation of the left and right CPU1 neurons) is used to generate the turning command in the way that is same as Equation 6.
Simulations
In all simulations, at each time step, the simulated agent (walking fly or ant) will sense the odour sensory based on its current location and then update neural activation to generate the desired moving direction and finally move one step to that direction. Equation 6 gives the turning angle of the agent, thus the instantaneous ‘velocity’ () at every step can be computed by
where is the step length in centimetres. Note that we have not defined the time accuracy for every step of the simulations, thus the unit of the velocity in this implementation is rather than . Then the position of agent in the Cartesian coordinates for the next time step is updated by
The positions of odour sources in all simulations are all set to , that is, . Other main parameters are listed in Table 2. Note that in each simulation the speed of agent is set constant.
Fly: Chemotaxis
Request a detailed protocolTo test the performances of the chemotaxis behaviour, five simulated agents with randomly generated heading direction start from five randomly generated locations in the zone of , and are then driven by the model for 1500 steps. Then we ran this simulation for four times in two different odour landscapes (‘volcano’ and ‘linear’) to get the results shown in Figure 3 (right panel) and Figure 4.
Fly: Anemotaxis
Request a detailed protocolTo reproduce the behavioural data in Álvarez-Salvado et al., 2018, the odour was only set ON during the second a quarter of total time (e.g. if the agent is set to run 200 steps, then the odour ON time will be in 50–100 steps). Four agents with randomly generated heading start from randomly generated locations in the zone of , and are then guided by the model to run 200 steps. The simulation was conducted for five times.
Fly: Integrated ON and OFF response
Request a detailed protocolThe whole simulation settings are the same as that in the last section except for some model parameters listed in Table 2 as this simulation is conducted to verify the integrated model.
Ants: Odour navigation integrated with PI
Request a detailed protocolTo reproduce the behavioural data in Buehlmann et al., 2012, we first generated PI memory encoding the home vector with 10 m length and direction. Then at each release point ( and ), we released 10 simulated full-vector (10-m-long and pointing to ) ants with different initial headings sampled uniformly from (see also Table 2). Note that the simulation settings with/without additional odour plume diffused by conspecific nest are identical so the list as one column in Table 2.
Ants: Wind compensation and backtracking
Request a detailed protocolThe quick implementations of using ‘copy-and-shift’ mechanism to model the wind compensation and backtracking behaviour follow the same step: first, generate the desired headings by shifting the current heading by the WPN activation for the wind compensation and by 180° for backtracking, respectively; second, release the simulated ant at the same releasing point but with random headings (uniform distribution in ). Motion-related parameters are set identically as that of those mentioned in the section ‘Ants: odour navigation integrated with PI’.
Data availability
The current manuscript is a computational study, so no data have been generated for this manuscript. Modelling code is uploaded as Source Code File and is also available via Github (https://github.com/XuelongSun/insectNavigationCX, copy archived at https://archive.softwareheritage.org/swh:1:rev:ec0d6943e09df2a685f8b1382475c523375352c3).
-
GithubID insectNavigationCX. How the insect central complex could coordinate multimodal navigation.
References
-
Using an Insect Mushroom Body Circuit to Encode Route Memory in Complex Natural EnvironmentsPLOS Computational Biology 12:e1004683.https://doi.org/10.1371/journal.pcbi.1004683
-
Path integration controls nest-plume following in desert antsCurrent Biology 22:645–649.https://doi.org/10.1016/j.cub.2012.02.029
-
Desert ants use olfactory scenes for navigationAnimal Behaviour 106:99–105.https://doi.org/10.1016/j.anbehav.2015.04.029
-
Early transformations in odor representationTrends in Neurosciences 33:130–139.https://doi.org/10.1016/j.tins.2009.12.004
-
Architecture, constraints, and behaviorPNAS 108:15624–15630.https://doi.org/10.1073/pnas.1103557108
-
From skylight input to behavioural output: A computational model of the insect polarised light compassPLOS Computational Biology 15:e1007123.https://doi.org/10.1371/journal.pcbi.1007123
-
Mechanisms of odor-tracking: multiple sensors for enhanced perception and behaviorFrontiers in Cellular Neuroscience 4:6.https://doi.org/10.3389/fncel.2010.00006
-
Active sensation during orientation behavior in the Drosophila larva: more sense than luckCurrent Opinion in Neurobiology 22:208–215.https://doi.org/10.1016/j.conb.2011.11.008
-
A unified mechanism for innate and learned visual landmark guidance in the insect central complexPLOS Computational Biology 17:e1009383.https://doi.org/10.1371/journal.pcbi.1009383
-
Functional analysis of a higher olfactory center, the lateral hornThe Journal of Neuroscience 32:8138–8148.https://doi.org/10.1523/JNEUROSCI.1066-12.2012
-
BookPolarized-light processing in insect brains: recent insights from the desert locust, the monarch butterfly, the cricket, and the fruit flyIn: Horváth G, editors. In Polarized Light and Polarization Vision in Animal Sciences. Springer. pp. 61–111.https://doi.org/10.1007/978-3-642-54718-8_4
-
Evolution of the central complex in the arthropod brain with respect to the visual systemArthropod Structure & Development 37:347–362.https://doi.org/10.1016/j.asd.2008.01.008
-
The insect central complex and the neural basis of navigational strategiesThe Journal of Experimental Biology 222:Suppl.https://doi.org/10.1242/jeb.188854
-
Adaptation processes in insect olfactory receptors. Mechanisms and behavioral significanceAnnals of the New York Academy of Sciences 510:104–112.https://doi.org/10.1111/j.1749-6632.1987.tb43475.x
-
System identification of Drosophila olfactory sensory neuronsJournal of Computational Neuroscience 30:143–161.https://doi.org/10.1007/s10827-010-0265-0
-
Idiosyncratic route-based memories in desert ants, Melophorus bagoti: how do they interact with path-integration vectors?Neurobiology of Learning and Memory 83:1–12.https://doi.org/10.1016/j.nlm.2004.05.011
-
The Central Complex as a Potential Substrate for Vector Based NavigationFrontiers in Psychology 10:690.https://doi.org/10.3389/fpsyg.2019.00690
-
Combining sky and earth: desert ants (Melophorus bagoti) show weighted integration of celestial and terrestrial cuesThe Journal of Experimental Biology 217:4159–4166.https://doi.org/10.1242/jeb.107862
-
Optic glomeruli and their inputs in Drosophila share an organizational ground pattern with the antennal lobesThe Journal of Neuroscience 32:6061–6071.https://doi.org/10.1523/JNEUROSCI.0221-12.2012
-
Spatial and temporal structures of pheromone plumes in fields and forestsPhysiological Entomology 25:211–222.https://doi.org/10.1046/j.1365-3032.2000.00176.x
-
Biophysical mechanisms underlying olfactory receptor neuron dynamicsNature Neuroscience 14:208–216.https://doi.org/10.1038/nn.2725
-
Functional Maps of Mechanosensory Features in the Drosophila BrainCurrent Biology 28:1189–1203.https://doi.org/10.1016/j.cub.2018.02.074
-
ThesisPhD thesis: Neural control of steering in walking DrosophilaHarvard University.
-
Olfactory coding in the honeybee lateral hornCurrent Biology 24:561–567.https://doi.org/10.1016/j.cub.2014.01.063
-
Three-dimensional characterization of the wind-borne pheromone tracking behavior of male hawkmoths, Manduca sextaJournal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology 195:39–54.https://doi.org/10.1007/s00359-008-0380-9
-
A central neural pathway controlling odor tracking in DrosophilaThe Journal of Neuroscience 35:1831–1848.https://doi.org/10.1523/JNEUROSCI.2331-14.2015
-
Connecting brain to behaviour: a role for general purpose steering circuits in insect orientation?The Journal of Experimental Biology 223:jeb212332.https://doi.org/10.1242/jeb.212332
-
An Anatomically Constrained Model for Path Integration in the Bee BrainCurrent Biology 27:3069–3085.https://doi.org/10.1016/j.cub.2017.08.052
-
Brain organization and the origin of insects: an assessmentProceedings. Biological Sciences 276:1929–1937.https://doi.org/10.1098/rspb.2008.1471
-
ConferenceIn Conference on Biomimetic and Biohybrid SystemsAn analysis of a ring attractor model for cue integration.https://doi.org/10.1007/978-3-319-95972-6
-
BookHead direction cells and the neural mechanisms of spatial orientationIn: Wiener SI, editors. Attractor Network Models of Head Direction Cells. MIT Press. pp. 1–6.
-
Neural mechanisms of insect navigationCurrent Opinion in Insect Science 15:27–39.https://doi.org/10.1016/j.cois.2016.02.011
-
Chemosensory guidance cues in a turbulent chemical odor plumeLimnology and Oceanography 46:1034–1047.https://doi.org/10.4319/lo.2001.46.5.1034
-
The Cataglyphis Mahrèsienne: 50 years of Cataglyphis research at MahrèsJournal of Comparative Physiology A 205:641–659.https://doi.org/10.1007/s00359-019-01333-5
-
A model of non-elemental olfactory learning in DrosophilaJournal of Computational Neuroscience 32:197–212.https://doi.org/10.1007/s10827-011-0348-6
-
Early olfactory processing in Drosophila: mechanisms and principlesAnnual Review of Neuroscience 36:217–241.https://doi.org/10.1146/annurev-neuro-062111-150533
-
Pinpointing food sources: olfactory and anemotactic orientation in desert ants, Cataglyphis fortisJournal of Experimental Biology 203:857–868.https://doi.org/10.1242/jeb.203.5.857
-
Desert ants compensate for navigation uncertaintyThe Journal of Experimental Biology 208:4223–4230.https://doi.org/10.1242/jeb.01905
-
Ants might use different view-matching strategies on and off the routeThe Journal of Experimental Biology 215:44–55.https://doi.org/10.1242/jeb.059584
-
Ants use a predictive mechanism to compensate for passive displacements by windCurrent Biology 23:R1083–R1085.https://doi.org/10.1016/j.cub.2013.10.072
-
Backtracking behaviour in lost ants: an additional strategy in their navigational toolkitProceedings. Biological Sciences 280:20131677.https://doi.org/10.1098/rspb.2013.1677
-
Optimal cue integration in antsProceedings. Biological Sciences 282:20151484.https://doi.org/10.1098/rspb.2015.1484
Article and author information
Author details
Funding
EU Horizon 2020 Framework Program (ULTRACEPT 778062)
- Xuelong Sun
- Shigang Yue
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
This research has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement no. 778062, ULTRACEPT, and no. 691154, STEP2DYNA.
Copyright
© 2021, Sun et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,137
- views
-
- 235
- downloads
-
- 20
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Cancer Biology
- Computational and Systems Biology
Effects from aging in single cells are heterogenous, whereas at the organ- and tissue-levels aging phenotypes tend to appear as stereotypical changes. The mammary epithelium is a bilayer of two major phenotypically and functionally distinct cell lineages: luminal epithelial and myoepithelial cells. Mammary luminal epithelia exhibit substantial stereotypical changes with age that merit attention because these cells are the putative cells-of-origin for breast cancers. We hypothesize that effects from aging that impinge upon maintenance of lineage fidelity increase susceptibility to cancer initiation. We generated and analyzed transcriptomes from primary luminal epithelial and myoepithelial cells from younger <30 (y)ears old and older >55y women. In addition to age-dependent directional changes in gene expression, we observed increased transcriptional variance with age that contributed to genome-wide loss of lineage fidelity. Age-dependent variant responses were common to both lineages, whereas directional changes were almost exclusively detected in luminal epithelia and involved altered regulation of chromatin and genome organizers such as SATB1. Epithelial expression of gap junction protein GJB6 increased with age, and modulation of GJB6 expression in heterochronous co-cultures revealed that it provided a communication conduit from myoepithelial cells that drove directional change in luminal cells. Age-dependent luminal transcriptomes comprised a prominent signal that could be detected in bulk tissue during aging and transition into cancers. A machine learning classifier based on luminal-specific aging distinguished normal from cancer tissue and was highly predictive of breast cancer subtype. We speculate that luminal epithelia are the ultimate site of integration of the variant responses to aging in their surrounding tissue, and that their emergent phenotype both endows cells with the ability to become cancer-cells-of-origin and represents a biosensor that presages cancer susceptibility.
-
- Computational and Systems Biology
- Microbiology and Infectious Disease
Timely and effective use of antimicrobial drugs can improve patient outcomes, as well as help safeguard against resistance development. Matrix-assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF MS) is currently routinely used in clinical diagnostics for rapid species identification. Mining additional data from said spectra in the form of antimicrobial resistance (AMR) profiles is, therefore, highly promising. Such AMR profiles could serve as a drop-in solution for drastically improving treatment efficiency, effectiveness, and costs. This study endeavors to develop the first machine learning models capable of predicting AMR profiles for the whole repertoire of species and drugs encountered in clinical microbiology. The resulting models can be interpreted as drug recommender systems for infectious diseases. We find that our dual-branch method delivers considerably higher performance compared to previous approaches. In addition, experiments show that the models can be efficiently fine-tuned to data from other clinical laboratories. MALDI-TOF-based AMR recommender systems can, hence, greatly extend the value of MALDI-TOF MS for clinical diagnostics. All code supporting this study is distributed on PyPI and is packaged at https://github.com/gdewael/maldi-nn.