Sequence learning is fundamental to a wide range of cognitive functions. Explaining how sequences—and the relations between the elements they comprise—are learned is a fundamental challenge to cognitive science. However, although hundreds of articles addressing this question are published each year, the actual learning mechanisms involved in the learning of sequences are rarely investigated. We present three experiments that seek to examine these mechanisms during a typing task. Experiments 1 and 2 tested learning during typing single letters on each trial. (...) Experiment 3 tested for “chunking” of these letters into “words.” The results of these experiments were used to examine the mechanisms that could best account for them, with a focus on two particular proposals: statistical transitional probability learning and discriminative error-driven learning. Experiments 1 and 2 showed that error-driven learning was a better predictor of response latencies than either n-gram frequencies or transitional probabilities. No evidence for chunking was found in Experiment 3, probably due to interspersing visual cues with the motor response. In addition, learning occurred across a greater distance in Experiment 1 than Experiment 2, suggesting that the greater predictability that comes with increased structure leads to greater learnability. These results shed new light on the mechanism responsible for sequence learning. Despite the widely held assumption that transitional probability learning is essential to this process, the present results suggest instead that the sequences are learned through a process of discriminative learning, involving prediction and feedback from prediction error. (shrink)

When the stored representation of the meaning of a stimulus is accessed through the processing of a sensory input it is maintained in an activated state for a certain amount of time that allows for further processing. This semantic activation is generally accompanied by conscious identification, which can be demonstrated by the ability of a person to perform discriminations on the basis of the meaning of the stimulus. The idea that a sensory input can give rise to semantic activation without (...) concomitant conscious identification was the central thesis of the controversial research in subliminal perception. Recently, new claims for the existence of such phenomena have arisen from studies in dichotic listening, parafoveal vision, and visual pattern masking. Because of the fundamental role played by these types of experiments in cognitive psychology, the new assertions have raised widespread interest. (shrink)

Whether pattern-parsing mechanisms are specific to language or apply across multiple cognitive domains remains unresolved. Formal language theory provides a mathematical framework for classifying pattern-generating rule sets (or “grammars”) according to complexity. This framework applies to patterns at any level of complexity, stretching from simple sequences, to highly complex tree-like or net-like structures, to any Turing-computable set of strings. Here, we explored human pattern-processing capabilities in the visual domain by generating abstract visual sequences made up (...) of abstract tiles differing in form and color. We constructed different sets of sequences, using artificial “grammars” (rule sets) at three key complexity levels. Because human linguistic syntax is classed as “mildly context-sensitive,” we specifically included a visual grammar at this complexity level. Acquisition of these three grammars was tested in an artificial grammar-learning paradigm: after exposure to a set of well-formed strings, participants were asked to discriminate novel grammatical patterns from non-grammatical patterns. Participants successfully acquired all three grammars after only minutes of exposure, correctly generalizing to novel stimuli and to novel stimulus lengths. A Bayesian analysis excluded multiple alternative hypotheses and shows that the success in rule acquisition applies both at the group level and for most participants analyzed individually. These experimental results demonstrate rapid pattern learning for abstract visual patterns, extending to the mildly context-sensitive level characterizing language. We suggest that a formal equivalence of processing at the mildly context sensitive level in the visual and linguistic domains implies that cognitive mechanisms with the computational power to process linguistic syntax are not specific to the domain of language, but extend to abstract visual patterns with no meaning. (shrink)

The threat-advantage hypothesis that threatening or negative faces can be discriminated preattentively has often been tested in the visual search paradigm with schematic stimuli. The results have been heterogeneous, suggesting that the choice of particular stimuli have profound effects on search efficiency. Because this conclusion is hampered by differences in experimental procedure, I selected examples from past literature and presented replicas of stimulus pairs (schematic positive and negative faces) in a within-participants design. Although there was a consistent advantage for (...) angry-face targets, search efficiency varied between 8 and 35 ms/item, yielding no clear evidence for the threat-advantage hypothesis. Furthermore, search efficiency for negative- and positive-face targets was highly correlated over stimulus pairs, which implies that whatever complicates the search for the negative face of a pair also complicates the search for the positive face. This results pattern argues against the hypothesised preattentive detector. (shrink)

Some patients with damaged striate cortex have blindsight-the ability to discriminate unseen stimuli in their clinically blind visual field defects when forced-choice procedures are used. Blindsight implies a sharp dissociation between visual performance and visual awareness, but signal detection theory indicates that it might be indistinguishable from the behavior of normal subjects near the lower limit of conscious vision, where the dissociations could arise trivially from using different response criteria during clinical and forced-choice tests. We tested the (...) latter possibility with a hemianopic subject during yes-no and forced-choice detection of static and moving targets. His response criterion differed significantly between yes-no and forced-choice responding, and the difference was sufficient to produce a blindsight-like dissociation with bias-sensitive measures of performance. When measured independently of bias, his sensitivity to static targets was greater in the forced-choice than in the yes-no task (unlike normal control subjects), but his sensitivity to moving targets did not differ. Differences in response criterion could therefore account for dissociations between yes-no and forced-choice detection of motion, but not of static pattern. The results explain why patients with blindsight are apparently more often ''aware'' of moving stimuli than of static stimuli. However, they also imply that blindsight is unlike normal vision near threshold, and that pattern- and motion-detection in blindsight may depend on different sets of neural mechanisms during yes-no and forced-choice tests. (shrink)

Music can act as a mnemonic device that can elicit multiple memories. How musical and non-musical information integrate into complex cross-modal memory representations has however rarely been investigated. Here, we studied the ability of human subjects to associate visual objects with melodies. Musical laypersons and professional musicians performed an associative inference task that tested the ability to form and memorize paired associations between objects and melodies and to integrate these pairs into more complex representations where melodies are linked with (...) two objects across trials. We further investigated whether and how musical expertise modulates these two processes. We analyzed accuracy and reaction times of direct and indirect trials in both groups. We reasoned that the musical and cross-modal memory demands of musicianship might modulate performance in the task and might thus reveal mechanisms that underlie the association and integration of visual information with musical information. Although musicians showed a higher overall memory accuracy, non-musicians’ accuracy was well above chance level in both trial types, thus indicating a significant ability to associate and integrate musical with visual information even in musically untrained subjects. However, non-musicians showed shorter RTs in indirect compared to direct trials, whereas the reverse pattern was found in musicians. Moreover, accuracy of direct and indirect trials correlated significantly in musicians but not in non-musicians. Consistent with previous accounts of visual associative memory, we interpret these findings as suggestive of at least two complimentary mechanisms that contribute to visual-melodic memory integration. A default mechanism that mainly operates at encoding of complex visual-melodic associations and that works with surprising efficacy even in musically untrained subjects. A retrieval-based mechanism that critically depends on an expert ability to maintain and discriminate visual-melodic associations across extended memory delays. Future studies may investigate how these mechanisms contribute to the everyday experience of music-evoked memories. (shrink)

Insect vision is nothing if not active. The regular head movements, called saccades, enable the fly Drosophila to keep a straight path in flight despite inequalities in the thrust of the wings. Using their own motion, bees in flight measure the ranges of nearby objects. A long history of research shows that bees discriminate visually in ways that depend on their activity or task, so we must distinguish between vision during flying, fixating or hovering and landing.Bees return again and again (...) for a reward of sugar solution and use their eyes to find their way. In an apparatus that makes them discriminate between two simulataneously visible but regularly interchanged targets, seen at a distance of 27 cm, bees are able to distinguish a remarkable number of simple patterns, but they fail in certain critical cases. The results can be explained with the hypothesis that bees have several broadly tuned overlapping filters with large fields that respond to the predominant orientation in a region of the image, and others for radial and circular patterns. Together with colour, these filters are independent of range. Bees prefer to use landmarks where they can, then global pattern at the largest scale, and lastly the detail around the goal. The way that discrimination of one visual feature is independent of other variables can be explained by models analogous to the colour triangle in colour discrimination. (shrink)

The quantization error in a fixed-size Self-Organizing Map (SOM) with unsupervised winner-take-all learning has previously been used successfully to detect, in minimal computation time, highly meaningful changes across images in medical time series and in time series of satellite images. Here, the functional properties of the quantization error in SOM are explored further to show that the metric is capable of reliably discriminating between the finest differences in local contrast intensities and contrast signs. While this capability of the QE is (...) akin to functional characteristics of a specific class of retinal ganglion cells (the so-called Y-cells) in the visual systems of the primate and the cat, the sensitivity of the QE surpasses the capacity limits of human visual detection. Here, the quantization error in the SOM is found to reliably signal changes in contrast or colour when contrast information is removed from or added to the image, but not when the amount and relative weight of contrast information is constant and only the local spatial position of contrast elements in the pattern changes. While the RGB Mean reflects coarser changes in colour or contrast well enough, the SOM-QE is shown to outperform the RGB Mean in the detection of single-pixel changes in images with up to five million pixels. This could have important implications in the context of unsupervised image learning and computational building block approaches to large sets of image data (big data). (shrink)

Japanese eels ( Anguilla japonica ) were trained on a spatial-learning paradigm in a pool placed in an experimental room where several extra-maze cues were present. Four tubes were placed in the pool, of which one was open and could be entered by the eels. The open tube was placed at a fixed position in the pool and contained a triangular block that served as an intra-maze cue. The eels learned to identify the open tube, and their performance was maintained (...) when the pool was rotated. However, they were unable to maintain their performance in a dark room, which suggests that spatial learning is based on visual cues. To determine the influence of the extra- and intra-maze cues, the tube with the triangle was moved to a new position and another open tube was kept in its place. The eels chose either the tube at the original position or the tube with the triangle at its new position, suggesting that spatial discrimination may be based on either extra- or intra-maze cues. We thus conclude that the eels employed an adjunctive strategy of multiple cues. In the next experiment, the eels were trained to visually discriminate the position of the stimulus (triangle), which changed in every trial. After the training, the eels were submitted to a test in which, in addition to the triangular pattern, a rectangular pattern was introduced. The eels discriminated between the tubes with the triangular and rectangular patterns, suggesting that they had the ability to discriminate visual patterns. (shrink)

Performance in perceptual tasks often improves with practice. This effect is known as ‘perceptual learning,’ and it has been the source of a great deal of interest and debate over the course of the last century. Here, we consider the effects of perceptual learning within the context of signal detection theory. According to signal detection theory, the improvements that take place with perceptual learning can be due to increases in internal signal strength or decreases in internal noise. We used a (...) combination of psychophysical techniques (external noise masking and double‐pass response consistency) that involve corrupting stimuli with externally added noise to discriminate between the effects of changes in signal and noise as observers learned to identify sets of unfamiliar visual patterns. Although practice reduced thresholds by as much as a factor of 14, internal noise remained virtually fixed throughout training, indicating learning served to predominantly increase the strength of the internal signal. We further examined the specific nature of the changes that took place in signal strength by correlating the externally added noise with observer's decisions across trials (response classification). This technique allowed us to visualize some of the changes that took place in the linear templates used by the observers as learning occurred, as well as test the predictions of a linear template‐matching model. Taken together, the results of our experiments offer important new theoretical constraints on models of perceptual learning. (shrink)

Multivariate pattern analysis can reveal new information from neuroimaging data to illuminate human cognition and its disturbances. Here, we develop a methodological approach, based on multivariate statistical/machine learning and time series analysis, to discern cognitive processing stages from functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) time series. We apply this method to data recorded from a group of healthy adults whilst performing a virtual reality version of the delayed win-shift radial arm maze (RAM) task. This task (...) has been frequently used to study working memory and decision making in rodents. Using linear classifiers and multivariate test statistics in conjunction with time series bootstraps, we show that different cognitive stages of the task, as defined by the experimenter, namely, the encoding/retrieval, choice, reward and delay stages, can be statistically discriminated from the BOLD time series in brain areas relevant for decision making and working memory. Discrimination of these task stages was significantly reduced during poor behavioral performance in dorsolateral prefrontal cortex (DLPFC), but not in the primary visual cortex (V1). Experimenter-defined dissection of time series into class labels based on task structure was confirmed by an unsupervised, bottom-up approach based on Hidden Markov Models. Furthermore, we show that different groupings of recorded time points into cognitive event classes can be used to test hypotheses about the specific cognitive role of a given brain region during task execution. We found that whilst the DLPFC strongly differentiated between task stages associated with different memory loads, but not between different visual-spatial aspects, the reverse was true for V1. Our methodology illustrates how different aspects of cognitive information processing during one and the same task can be separated and attributed to specific brain regions based on information contained in multivariate patterns of voxel activity. (shrink)

Abstract“Sign stimuli” elicit specific patterns of behavior when an organism's motivation is appropriate. In the toad, visually released prey-catching involves orienting toward the prey, approaching, fixating, and snapping. For these action patterns to be selected and released, the prey must be recognized and localized in space. Toads discriminate prey from nonprey by certain spatiotemporal stimulus features. The stimulus-response relations are mediated by innate releasing mechanisms (RMs) with recognition properties partly modifiable by experience. Striato-pretecto-tectal connectivity determines the RM's recognition and localization (...) properties, whereas medialpallio-thalamo-tectal circuitry makes the system sensitive to changes in internal state and to prior history of exposure to stimuli. RMs encode the diverse stimulus conditions referring to the same prey object through different combinations of “specialized” tectal neurons, involving cells selectively tuned to prey features. The prey-selective neurons express the outcome of information processing in functional units consisting of interconnected cells. Excitatory and inhibitory interactions among feature-sensitive tectal and pretectal neurons specify the perceptual operations involved in distinguishing the prey from its background, selecting its features, and discriminating it from predators. Other connections indicate stimulus location. The results of these analyses are transmitted by specialized neurons projecting from the tectum to bulbar/spinal motor systems, providing a sensorimotor interface. Specific combinations of such projective neurons – mediating feature- and space-related messages – form “command releasing systems” that activate corresponding motor pattern generators for appropriate prey-catching action patterns. (shrink)

Training can influence behavioral performance and lead to brain reorganization. In particular, training in one modality, for example, auditory, can improve performance in another modality, for example, visual. Previous research suggests that one of the mechanisms behind this phenomenon could be the cross-modal recruitment of the sensory areas, for example, the auditory cortex. Studying expert musicians offers a chance to explore this process. Rhythm is an aspect of music that can be presented in various modalities. We designed an fMRI (...) experiment in which professional pianists and non-musicians discriminated between two sequences of rhythms presented auditorily or visually. Behavioral results showed that musicians performed in both visual and auditory rhythmic tasks better than non-musicians. We found no significant between-group differences in fMRI activations within the auditory cortex. However, we observed that musicians had increased activation in the right Inferior Parietal Lobe when compared to non-musicians. We conclude that the musicians’ superior visual rhythm discrimination is not related to cross-modal recruitment of the auditory cortex; instead, it could be related to activation in higher-level, multimodal areas in the cortex. (shrink)

Discriminating behavior depends on neural representations in which the sensory activity patterns guiding different responses are decorrelated from one another. Visual information can often be parsimoniously transformed into these behavioral bridge-locus representations within neuro-computational visuo-spatial maps. Isomorphic inverse-optical world representation is not the goal. Nevertheless, such useful transformations can involve neural filling-in. Such a subpersonal representation of information is consistent with personal-level vision theory.

Self–other discrimination was investigated with point-light displays in which actions were presented with or without additional auditory information. Participants first executed different actions in time with music. In two subsequent experiments, they watched point-light displays of their own or another participant’s recorded actions, and were asked to identify the agent . Manipulations were applied to the visual information and to the auditory information . Results indicate that self-recognition was better than chance in all conditions and was highest when (...) observing relatively unconstrained patterns of movement. Auditory information did not increase accuracy even with the most ambiguous visual displays, suggesting that judgments of agent identity depend much more on motor cues than on auditory or audiovisual information. (shrink)

The relationship between perceptual categorization and organization processes in 3‐ to 4‐month‐old infants was explored. The question was whether an invariant part abstracted during category learning could interfere with Gestalt organizational processes. Experiment 1 showed that the infants could parse a circle in accord with good continuation from visual patterns consisting of a circle and a complex polygon. In Experiments 2 and 3, however, this parsing was interfered with by a prior category familiarization experience in which infants were presented (...) with visual patterns consisting of a pacman shape and a complex polygon. Part 1 of Experiments 2 and 3 showed that the infants recognized the pacman as familiar, and Part 2 demonstrated that the representation of the pacman blocked the subsequent parsing of the circle. The results suggest that a cognitive system of flexible feature creation can override organizational principles with which a perceptual system may come pre‐equipped. (shrink)

Saccadic chronostasis refers to the subjective temporal lengthening of the first visual stimulus perceived after an eye movement. It has been quantified using a duration discrimination task. Most models of human duration discrimination hypothesise an internal clock. These models could explain chronostasis as a transient increase in internal clock speed due to arousal following a saccade, leading to temporal overestimation. Two experiments are described which addressed this hypothesis by parametrically varying the duration of the stimuli that are (...) being judged. Changes in internal clock speed predict chronostasis effects proportional to stimulus duration. No evidence for proportionality was found. Two further experiments assessed the appropriateness of the control conditions employed. Results indicated that the chronostasis effect is constant across a wide range of stimulus durations and does not reflect the pattern of visual stimulation experienced during a saccade, suggesting that arousal is not critical. Instead, alternative processes, such as one affecting the onset of timing are implicated. Further research is required to select between these alternatives. (shrink)