Evidence that higher cognitive processes are coupled in agraded and time-continuous way to sensory-motor processescomes, in part, from mouse-tracking studies. In these, curvedmouse trajectories toward one of two fixed response locationsreveal the evolution of certainty about a cognitive task that par-ticipants solve. We present a paradigm in which selection ofthe response location is itself the cognitive task. From amongitems in a visual scene, participants select a target that is de-scribed by a spatial relation (e.g.,“the red to the left of thegreen”), where one target item (here, “red”) matches the de-scription better than alternative same-colored targets. In themouse trajectories, we find clear evidence for attraction tothe alternative targets, attraction to the reference item (here“green”), and an early biasing influence of the spatial term.

Parsing actions entails that relations between objects are dis-covered. A pervasively neural account of this process requiresthat fundamental problems are solved: the neural pointer prob-lem, the binding problem, and the problem of generating dis-crete processing steps from time-continuous neural processes.We present a prototypical solution to these problems in a neuraldynamic model that comprises dynamic neural fields holdingrepresentations close to sensorimotor surfaces as well as dy-namic nodes holding discrete, language-like representations.Making the connection between these two types of represen-tations enables the model to parse actions as well as groundmovement phrases—all based on real visual input. We demon-strate how the dynamic neural processes autonomously gen-erate the processing steps required to parse or ground object-oriented action.

The productivity and compositionality of language and thought have often been taken as evidence that higher cognitionis a form of information processing on systems of symbols with combinatorial syntax and semantics. We present anon-symbolic neural dynamic architecture that can ground combinatorial concepts in perception, i.e., establish a linkbetween a combinatorial concept and an object in the perceptual array. The components of a combinatorial concept treeare sequentially grounded from the leaves to the root, while the output of each grounding step is passed on to the nextgrounding step by means of a mental map. This way, compositionality is an emergent property of the neural dynamics anddoes not require any form of symbolic information processing. We discuss how this process account contrasts with otherneural accounts of compositionality and conclude with implications for the modeling of higher cognition.

We present a neural dynamic architecture that grounds sen-tences in perception which combine multiple concepts throughnested spatial relations. Grounding entails that the model getsfeatures and relations as categorical inputs and matches themto objects in space-continuous neural maps which represent vi-sual input. The architecture is based on the neural principlesof dynamic field theory. It autonomously generates sequencesof processing steps in continuous time, based solely on highlyrecurrent connectivity. Simulations of the architecture showthat it can ground sentences of varying complexity. We thusaddress two major challenges in dealing with nested relations:how concepts may appear in multiple different relational roleswithin the same sentence, and how in such a scenario variousgrounding outcomes may be “tried out” in a form of hypothesistesting. We close by discussing empirical evidence for crucialassumptions and choices made when developing the architec-ture.