The human conceptual system comprises simulated information of sensorimotor experience and linguistic distributional information of how words are used in language. Moreover, the linguistic shortcut hypothesis predicts that people will use computationally cheaper linguistic distributional information where it is sufficient to inform a task response. In a pre‐registered category production study, we asked participants to verbally name members of concrete and abstract categories and tested whether performance could be predicted by a novel (...) measure of sensorimotor similarity (based on an 11‐dimensional representation of sensorimotor strength) and linguistic proximity (based on word co‐occurrence derived from a large corpus). As predicted, both measures predicted the order and frequency of category production but, critically, linguistic proximity had an effect above and beyond sensorimotor similarity. A follow‐up study using typicality ratings as an additional predictor found that typicality was often the strongest predictor of category production variables, but it did not subsume sensorimotor and linguistic effects. Finally, we created a novel, fully grounded computational model of conceptual activation during category production, which best approximated typical human performance when conceptual activation was allowed to spread indirectly between concepts, and when candidate category members came from both sensorimotor and linguistic distributional representations. Critically, model performance was indistinguishable from typical human performance. Results support the linguistic shortcut hypothesis in semantic processing and provide strong evidence that both linguistic and grounded representations are inherent to the functioning of the conceptual system. All materials, data, and code are available at https://osf.io/vaq56/. (shrink)

Phonological rules create alternations in the phonetic realizations of related words. These rules must be learned by infants in order to identify the phonological inventory, the morphological structure, and the lexicon of a language. Recent work proposes a computational model for the learning of one kind of phonological alternation, allophony . This paper extends the model to account for learning of a broader set of phonological alternations and the formalization of these alternations as general rules. In Experiment 1, we apply (...) the original model to new data in Dutch and demonstrate its limitations in learning nonallophonic rules. In Experiment 2, we extend the model to allow it to learn general rules for alternations that apply to a class of segments. In Experiment 3, the model is further extended to allow for generalization by context; we argue that this generalization must be constrained by linguistic principles. (shrink)

People are generally more accurate at categorizing objects at the basic level (e.g., dog) than at more general, superordinate categories (e.g., animal). Recent research has suggested that this basic‐level advantage emerges from the linguistic‐distributional and sensorimotor relationship between a category concept and object concept, but the proposed mechanisms have not been subject to a formal computational test. In this paper, we present a computational model of category verification that allows linguistic distributional information and sensorimotor experience (...) to interact in a grounded implementation of a full‐size adult conceptual system. In simulations across multiple datasets, we demonstrate that the model performs the task of category verification at a level comparable to human participants, and—critically—that its operation naturally gives rise to the basic‐level‐advantage phenomenon. That is, concepts are easier to categorize when there is a high degree of overlap in sensorimotor experience and/or linguistic distributional knowledge between category and member concepts, and the basic‐level advantage emerges as an overall behavioral artifact of this linguistic and sensorimotor overlap. Findings support the linguistic–sensorimotor preparation account of the basic‐level advantage and, more broadly, linguistic–sensorimotor theories of the conceptual system. (shrink)

Examples of successful linguistic communication give rise to two important insights: (1) it should be understood most fundamentally in terms of the pragmatic success of each individual utterance, and (2) linguistic conventions need to be understood as on a par with the non-linguistic regularities that competent language users rely upon to refer. Syntax and semantics are part of what Barwise and Perry call the context of the utterance, contributing to the pragmatics of the utterance. This full and (...) distributed multichannel context determines meaning if anything does. On the standard account of context, context disambiguates the meaning of language, but it is at least as apt in many situations to say that language disambiguates context. In practice, the two work together, sometimes with more emphasis on one than the other. Reference should be understood in pragmatic terms (it is an act) and, since success is often achieved in non-standard, creative ways, any formalisation of pragmatics can only be partial. The need for such an inventive approach to referring traces back to the need for language to be highly efficient, with expressions underdetermining their interpretation. Next, the shared semantic and syntactic regularities, which might seem to be independent of the context of an utterance, should be understood as also being part of that context. Past usage underdetermines how terms can be used since it allows for multiple projections. Successful reference with novel uses that are disambiguated by context can become the ground for new conventions. (shrink)

We present a series of three analyses of young children's linguistic input to determine the distributional information it could plausibly offer to the process of grammatical category learning. Each analysis was conducted on four separate corpora from the CHILDES database (MacWhinney, 2000) of speech directed to children under 2;5. We showthat, in accord with other findings, a distributional analysis which categorizeswords based on their co‐occurrence patterns with surroundingwords successfully categorizes the majority of nouns and verbs. In (...) Analyses 2 and 3, we attempt to make our analyses more closely relevant to natural language acquisition by adopting more realistic assumptions about howyoung children represent their input. In Analysis 2, we limit the distributional context by imposing phrase structure boundaries, and find that categorization improves even beyond that obtained from less limited contexts. In Analysis 3, we reduce the representation of input elements which young children might not fully process and we find that categorization is not adversely affected: Although noun categorization is worse than in Analyses 1 and 2, it is still good; and verb categorization actually improves. Overall, successful categorization of nouns and verbs is maintained across all analyses. These results provide promising support for theories of grammatical category formation involving distributional analysis, as long as these analyses are combined with appropriate assumptions about the child learner's computational biases and capabilities. (shrink)

Abstract Since their inception, distributional models of semantics have been criticized as inadequate cognitive theories of human semantic learning and representation. A principal challenge is that the representations derived by distributional models are purely symbolic and are not grounded in perception and action; this challenge has led many to favor feature-based models of semantic representation. We argue that the amount of perceptual and other semantic information that can be learned from purely distributional statistics has been underappreciated. (...) We compare the representations of three feature-based and nine distributional models using a semantic clustering task. Several distributional models demonstrated semantic clustering comparable with clustering-based on feature-based representations. Furthermore, when trained on child-directed speech, the same distributional models perform as well as sensorimotor-based feature representations of children’s lexical semantic knowledge. These results suggest that, to a large extent, information relevant for extracting semantic categories is redundantly coded in perceptual and linguistic experience. Detailed analyses of the semantic clusters of the feature-based and distributional models also reveal that the models make use of complementary cues to semantic organization from the two data streams. Rather than conceptualizing feature-based and distributional models as competing theories, we argue that future focus should be on understanding the cognitive mechanisms humans use to integrate the two sources. (shrink)

Propositional attitude verbs, such as think and want, have long held interest for both theoretical linguists and language acquisitionists because their syntactic, semantic, and pragmatic properties display complex interactions that have proven difficult to fully capture from either perspective. This paper explores the granularity with which these verbs’ semantic and pragmatic properties are recoverable from their syntactic distributions, using three behavioral experiments aimed at explicitly quantifying the relationship between these two sets of properties. Experiment 1 gathers a measure of 30 (...) propositional attitude verbs’ syntactic distributions using an acceptability judgment task. Experiments 2a and 2b gather measures of semantic similarity between those same verbs using a generalized semantic discrimination task and an ordinal scale task, respectively. Two kinds of analyses are conducted on the data from these experiments. The first compares both the acceptability judgments and the semantic similarity judgments to previous classifications derived from the syntax and semantics literature. The second kind compares the acceptability judgments to the semantic similarity judgments directly. Through these comparisons, we show that there is quite fine-grained information about propositional attitude verbs’ semantics carried in their syntactic distributions—whether one considers the sorts of discrete qualitative classifications that linguists traditionally work with or the sorts of continuous quantitative classifications that can be derived experimentally. (shrink)

Models of collective deliberation often assume that the chief aim of a deliberative exchange is the sharing of information. In this paper, we argue that an equally important role of deliberation is to draw participants’ attention to pertinent questions, which can aid the assembly and processing of distributed information by drawing deliberators’ attention to new issues. The assumption of logical omniscience renders classical models of agents’ informational states unsuitable for modelling this role of deliberation. Building on recent insights (...) from psychology, linguistics and philosophy about the role of questions in speech and thought, we propose a different model in which beliefs are treated as answers directed at specific questions. Here, questions are formally represented as partitions of the space of possibilities and individuals’ information states as sets of questions and corresponding partial answers to them. The state of conversation is then characterised by individuals’ information together with the questions under discussion, which can be steered by various deliberative inputs. Using this model, deliberation is then shown to shape collective decisions in ways that classical models cannot capture, allowing for novel explanations of how group consensus is achieved. (shrink)

The need to study the concept of “politeness” from the point of view of its linguistic and cultural nature is caused by the desire to study the national identity of speech etiquette in different cultural spaces and conditions. The aim of the work was to form an idea about the specifics of the implementation and understanding of the concept of “politeness” in the Uzbek information field. In this study, the following methods were used: contextual, conceptual, communicative, linguocultural, analytical-synthetic, (...) and comparative. This study is focused on the study of key lexical meanings (stylistically neutral and marked, basic and additional) that are within the functional-semantic field of the concept “politeness.” With the help of contextual study of different variants of the use of the lexeme, the meanings were distributed in the conceptual structure (core, near and far periphery). Also, the key etiquette formulas representing the originality and national-specific features of the Uzbek linguocultural tradition were considered. The importance of politeness in the information space of Uzbekistan is assessed, including with the help of both positive and negative associations, that is, from an axiological point of view. Speech etiquette and linguistic formulas were considered from the point of view of the influence of social, cultural, and political values of the Uzbek people. In the process of analyzing the lexical layer, the boundaries of the functional-semantic field of the concept “politeness” were determined: from the principles of communication and a set of rules of etiquette to the strategy of obtaining benefits from communication and insincere attitude. In the future, this work can be used for comparative analysis of the conceptual structure of politeness with models presented in other close and distant languages, comparison of speech etiquette and linguistic formulas in different national cultures. (shrink)

Sophisticated senator and legislative onion. Whether or not you have ever heard of these things, we all have some intuition that one of them makes much less sense than the other. In this paper, we introduce a large dataset of human judgments about novel adjective-noun phrases. We use these data to test an approach to semantic deviance based on phrase representations derived with compositional distributional semantic methods, that is, methods that derive word meanings from contextual information, and approximate (...) phrase meanings by combining word meanings. We present several simple measures extracted from distributional representations of words and phrases, and we show that they have a significant impact on predicting the acceptability of novel adjective-noun phrases even when a number of alternative measures classically employed in studies of compound processing and bigram plausibility are taken into account. Our results show that the extent to which an attributive adjective alters the distributional representation of the noun is the most significant factor in modeling the distinction between acceptable and deviant phrases. Our study extends current applications of compositional distributional semantic methods to linguistically and cognitively interesting problems, and it offers a new, quantitatively precise approach to the challenge of predicting when humans will find novel linguistic expressions acceptable and when they will not. (shrink)

The notion of kontrast, or the ability of certain linguistic expressions to generate a set of alternatives, originally proposed by Vallduví and Vilkuna (1998) as a clause-level concept, is re-analyzed here as connecting the level of information packaging in the clause and the level of discourse structure in the following way: kontrast is encoded at the clausal level but has repercussions for discourse structure. This claim is supported by evidence from the distribution properties of three colloquial Russian particles (...) -to, e, andved' which are analyzed as unambiguous markers of kontrast. Both the placement of these particles at the clausal level and their role in discourse are viewed as consequences of the type of the kontrast set and the cognitive status of information marked by each particle. (shrink)

Affective information can be retrieved simply by measuring words co‐occurrences in linguistic contexts. Lenci and colleagues demonstrate that the affective measures retrieved from linguistic occurrences predict words’ concreteness: abstract words are more heavily loaded with affective information than concrete ones. These results challenge the Affective grounding hypothesis, suggesting that abstract concepts may be ungrounded and coded only linguistically, and that their affective load may be a linguistic factor.

Speakers frequently produce elaborate hand movements during talk that have been shown to serve a communicative function. Nevertheless, two-thirds of the semantic content of these hand movements is encoded linguistically elsewhere in the discourse . The present experiment demonstrated that while 62.9% of semantic information in gesture was elsewhere, most gestures retained at least one semantic feature that was never represented linguistically. Semantic features were more explicit when they occurred in gesture than when represented linguistically. Even in cases where (...) the imagistic gesture appeared somewhat redundant, gesture at the narrative level preserves a discernable communicative function. (shrink)

The present article proposes an Informational-Theoretic interpretation of logical analysis applied to natural language in Tractatus Logico-Philosophicus. Natural language is characterized by descriptive definitions in order to compress information according to empirical regularities. However, notations fitted to empirical patterns do not explicitly reflect the logical structure of language that enables it to represent those very patterns. I argue that logical analysis is the process of obtaining incompressible and uniformly distributed codes, best fitted to express the possible combinations of facts (...) instead of eventual empirical regularities. That implies mutual translatability between different representations of the same facts, which justifies the possibility to decompose natural language and to rebuild it in mathematized ideographical languages, such as physics. Logical analysis decomposition process, then, results in a reductionism that sets the basis for conceptions of logic and language not only in Tractatus, but also in Some Remarks on Logical Form, which, in turn, is shown to be unattainable in Philosophical Remarks. That posterior book introduces a fragmentation of linguistic systems and analytical methods that can no longer be interpreted under computation theory alone. (shrink)

We investigate many paradigms of identifications for classes of languages in a measure-theoretic context, and we relate such paradigms to their analogues in learning on informants. Roughly speaking, the results say that most paradigms in measure-theoretic learning wrt some classes of distributions are equivalent to the corresponding paradigms for identification on informants.

This article provides the first comprehensive reconstruction and analysis of Hintikka’s attempt to obtain a measure of the information yield of deductive inferences. The reconstruction is detailed by necessity due to the originality of Hintikka’s contribution. The analysis will turn out to be destructive. It dismisses Hintikka’s distinction between surface information and depth information as being of any utility towards obtaining a measure of the information yield of deductive inferences. Hintikka is right to identify the failure (...) of canonical information theory to give an account of the information yield of deductions as a scandal, however this article demonstrates that his attempt to provide such an account fails. It fails primarily because it applies to only a restricted set of deductions in the polyadic predicate calculus, and fails to apply at all to the deductions in the monadic predicate calculus and the propositional calculus. Some corollaries of these facts are a number of undesirable and counterintuitive results concerning the proposed relation of linguistic meaning (and hence synonymy) with surface information. Some of these results will be seen to contradict Hintikka’s stated aims, whilst others are seen to be false. The consequence is that the problem of obtaining a measure of the information yield of deductive inferences remains an open one. The failure of Hintikka’s proposal will suggest that a purely syntactic approach to the problem be abandoned in favour of an intrinsically semantic one. (shrink)

Information about the environment is captured in human biological systems on a variety of interacting levels – in distributions of genes, linguistic particulars, concepts, methods, theories, preferences, and overt behaviors. I investigate some of the basic principles which govern such a hierarchy by constructing a comparatively simple three-level selection model of bee foraging preferences and behaviors. The information-theoretic notion of ''''mutual information'''' is employed as a measure of efficiency in tracking a changing environment, and its appropriateness (...) in epistemological applications is discussed at some length. In particular, information accumulated in mid-level preference distributions exhibits suggestive properties for the purposes of naturalistic epistemology. It also appears that the novelty of scientific objects and representations and the rapidity of scientific change relative to genetic change need present no obstacle to the use of such models in explanations of scientific progress and the reliability of scientific judgement. (shrink)

Recent years have seen a surge in accounts motivated by information theory that consider language production to be partially driven by a preference for communicative efficiency. Evidence from discourse production (i.e., production beyond the sentence level) has been argued to suggest that speakers distribute information across discourse so as to hold the conditional per-word entropy associated with each word constant, which would facilitate efficient information transfer (Genzel & Charniak, 2002). This hypothesis implies that the conditional (contextualized) probabilities (...) of linguistic units affect speakers’ preferences during production. Here, we extend this work in two ways. First, we explore how preceding cues are integrated into contextualized probabilities, a question which so far has received little to no attention. Specifically, we investigate how a cue's maximal informativity about upcoming words (the cue's effectiveness) decays as a function of the cue's recency. Based on properties of linguistic discourses as well as properties of human memory, we analytically derive a model of cue effectiveness decay and evaluate it against cross-linguistic data from 12 languages. Second, we relate the information theoretic accounts of discourse production to well-established mechanistic (activation-based) accounts: We relate contextualized probability distributions over words to their relative activation in a lexical network given preceding discourse. (shrink)

Neural network models have recently made striking progress in natural language processing, but they are typically trained on orders of magnitude more language input than children receive. What can these neural networks, which are primarily distributional learners, learn from a naturalistic subset of a single child's experience? We examine this question using a recent longitudinal dataset collected from a single child, consisting of egocentric visual data paired with text transcripts. We train both language-only and vision-and-language neural networks and analyze (...) the linguistic knowledge they acquire. In parallel with findings from Jeffrey Elman's seminal work, the neural networks form emergent clusters of words corresponding to syntactic (nouns, transitive and intransitive verbs) and semantic categories (e.g., animals and clothing), based solely on one child's linguistic input. The networks also acquire sensitivity to acceptability contrasts from linguistic phenomena, such as determiner-noun agreement and argument structure. We find that incorporating visual information produces an incremental gain in predicting words in context, especially for syntactic categories that are comparatively more easily grounded, such as nouns and verbs, but the underlying linguistic representations are not fundamentally altered. Our findings demonstrate which kinds of linguistic knowledge are learnable from a snapshot of a single child's real developmental experience. (shrink)

Pseudo-clefts are the building blocks of coherent discourse progression and serve as a rhetorical toolkit to construct an authorial stance in the academic discourse. Despite an increasing interest in grammatical constructions in the academic discourse, researchers have not treated pseudo-clefts in much detail. This paper explores the features of pseudo-clefts in the corpus of academic discourse in the field of applied linguistics. Here, we take the textual and the interpersonal perspectives, focusing on the use of pseudo-clefts in terms of their (...) distribution in generic structure, discourse functions with reference to clefted constituents, and evaluative meaning. The results show that pseudo-clefts were more frequently used in “Results and Discussion” and Literature Review, performing the functions such as the specification of key terms, generalization of the literature, the description and explanation of findings, etc. They are facilitative in creating information gaps and establishing a logic-semantic expansive relationship between the clauses. The findings also suggest that the pseudo-clefts are evaluative devices and are involved in the construction of authorial identities. (shrink)

The theoretical notion of ‘construal’ captures the idea that the way in which we describe a scene reflects our conceptualization of it. Relying on the concept of ception – which conjoins conception and perception – we operationalized construal and employed a Visual World Paradigm to establish which aspects of linguistic scene description modulate visual scene perception, thereby affecting event conception. By analysing viewing behaviour after alternating ways of describing location (prepositions), agentivity (active/passive voice) and transfer (NP/pp datives), we found (...) that the linguistic construal of a scene affects its spontaneous visual perception in two ways: either by determining the order in which the components of a scene are accessed or by modulating the distribution of attention over the components, making them more or less salient than they naturally are. We also found evidence for the existence of a cline in the construal effect with stronger expressive differences, such as the prepositional manipulation, inducing more prominent changes in visual perception than the dative manipulation. We discuss the claims language can lay to affecting visual information uptake and hence conceptualization of a static scene in the light of these results. (shrink)

Naming common odors is a surprisingly difficult task: Odors are frequently misnamed. Little is known about the linguistic properties of odor misnamings. We test whether odor misnamings of old adults carry information about olfactory perception and its connection to lexical-semantic processing. We analyze the olfactory–semantic content of odor source naming failures in a large sample of older adults in Sweden (n = 2479; age 58–100 years). We investigate whether linguistic factors and semantic proximity to the target odor (...) name predict how odors are misnamed, and how these factors relate to overall odor identification performance. We also explore the primary semantic dimensions along which misnamings are distributed. We find that odor misnamings consist of surprisingly many vague and unspecific terms, such as category names (e.g., fruit) or abstract or evaluative terms (e.g., sweet). Odor misnamings are often strongly associated with the correct name, capturing properties such as its category or other abstract features. People are also biased toward misnaming odors with high-frequency terms that are associated with olfaction or gustation. Linguistic properties of odor misnamings and their semantic proximity to the target odor name predict odor identification performance, suggesting that linguistic processing facilitates odor identification. Further, odor misnamings constitute an olfactory–semantic space that is similar to the olfactory vocabulary of English. This space is primarily differentiated along pleasantness, edibility, and concreteness dimensions. Odor naming failures thus contain plenty of information about semantic odor knowledge. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Journal of the History of Ideas 67.4 (2006) 713-734 MuseSearchJournalsThis JournalContents[Access article in PDF]India and the Identity of Europe: The Case of Friedrich Schlegel 1Chen Tzoref-Ashkenazi University of HeidelbergAbstractThis paper examines Friedrich Schlegel's conception of an Oriental Renaissance through the study of ancient India. In his book Über die Sprache und Weisheit der Indier Schlegel compared his project of Sanskrit studies to the Humanistic Renaissance, but in practice hoped (...) the study of India would reverse the modernizing effects of the original Renaissance. His study of India was aimed at a redefinition of European and German cultural and national identities rather than broadening the horizons of Europe to a global perspective."If only Indian studies could find such cultivators and patrons as in the fifteenth and sixteenth centuries suddenly kindled in Italy and Germany an ardent appreciation of Greek studies, and in so short a time achieved so much that the reawakened knowledge of antiquity changed and rejuvenated wisdom and science, indeed one could even say the world itself. Not less grand and universal, I dare to assert, would be the effect of Indian studies even now, if it were seized with similar force and introduced into the circle of European learning." 2 [End Page 713]These enthusiastic words were used by Friedrich Schlegel (1772–1829) to recommend the study of Indian literature to the readers of his 1808 Über die Sprache und Weisheit der Indier. 3 In this book, Schlegel offered the fruits of his studies of Sanskrit and Indian literature, which began in Paris in 1803. Here he introduced to the educated public of Continental Europe the theory about the affinity of Sanskrit to Greek, Latin and German, twenty-two years after this theory, which is now called "the Indo-European relationship," was presented by Sir William Jones to the members of the Asiatick Society in Calcutta. The presentation of this linguistic relationship, together with a call to study languages by a historical-comparative method, comprised the first part of the book. The second part dealt with Indian philosophy, which according to Schlegel, belonged to the tradition of all Oriental philosophy. The third part suggested how the study of Indian literature might benefit the study of history in general. Central to this view was the speculation that Indian civilization had emigrated to Europe, supported by the linguistic affinity between Sanskrit and European languages.The recommendation in the quotation above was well received. The publication of Schlegel's book excited the intellectual community of continental Europe, and, by 1809, large parts of the book had appeared in French translation. 4 The most important outcome of this excitement was the arrival of Franz Bopp and August Wilhelm Schlegel, Friedrich's elder brother, in Paris to study Sanskrit. The excitement stirred by Schlegel's book reflected the growing interest in India and the East among European intellectuals. This was a very complex process that was a product of Europe's growing colonial power in Asia but was also a part of the modernization of European thought. Interest in India swelled during the last third of the eighteenth century, as the British were becoming the dominant power in the subcontinent and began collecting, analyzing, and distributing information on Indian civilization, mainly through the Asiatic Society in Calcutta, which was established by William Jones in 1783 under the patronage of the Governor-General Warren Hastings. 5 [End Page 714]What interested European intellectuals most about the ancient cultures of India and other oriental countries, was what they could learn about the ancient religions of these countries. The region from Egypt to India was thought to be the "cradle of humanity," with various thinkers believing the "Urheimat" to be in another center of oriental civilization, be it Egypt, Mesopotamia or Persia. India became popular with the publication of John Holwell's Interesting Historical Events Relating to Bengal in 1765, 6 which was the main source for Voltaire's ideas on India. 7 Statements concerning the nature of Hinduism became important... (shrink)

The poverty of stimulus argument is one of the most controversial arguments in the study of language acquisition. Here we follow previous approaches challenging the assumption of impoverished primary linguistic data, focusing on the specific problem of auxiliary (AUX) fronting in complex polar interrogatives. We develop a series of corpus analyses of child‐directed speech showing that there is indirect statistical information useful for correct auxiliary fronting in polar interrogatives and that such information is sufficient for distinguishing between (...) grammatical and ungrammatical generalizations, even in the absence of direct evidence. We further show that there are simple learning devices, such as neural networks, capable of exploiting such statistical cues, producing a bias toward correct AUX questions when compared to their ungrammatical counterparts. The results suggest that the basic assumptions of the poverty of stimulus argument may need to be reappraised. (shrink)

Many theorists have dismissed a priori the idea that distributional information could play a significant role in syntactic category acquisition. We demonstrate empirically that such information provides a powerful cue to syntactic category membership, which can be exploited by a variety of simple, psychologically plausible mechanisms. We present a range of results using a large corpus of child‐directed speech and explore their psychological implications. While our results show that a considerable amount of information concerning the syntactic (...) categories can be obtained from distributional information alone, we stress that many other sources of information may also be potential contributors to the identification of syntactic classes. (shrink)

Compared to existing classical approaches to semiotics which are dyadic (signifier/signified, F. de Saussure) and triadic (symbol/concept/object, Ch. S. Peirce), this theory can be characterized as tetradic ([sign/semion]//[object/noema]) and is the result of either doubling the dyadic approach along the semiotic/ordinary dimension or splitting the ‘concept’ of the triadic one into two (semiotic/ordinary). Other important features of this approach are (a) the distinction made between concepts (only functional pairs of extent and intent) and categories (as representations of expressions) and (b) (...) the indication of the need for providing the mathematical passage from the duality between two sets (where one is a singleton) within systems of sets to category-theoretical monoids within systems of categories while waiting for the solution of this problem in the field of logic. Last but not least, human language expressions are the most representative physical instances of semiotic objects. Moreover, as computational experiments which are possible with linguistic objects present a high degree of systematicity (of oppositions), in general, it is relatively easy to elucidate their dependence on the concepts underlying signs. This new semiotic theory or rather this new research program emerged as the fruit of experimentation and reflection on the application of data science tools elaborated within the frameworks of Rough Set Theory (RST), Formal Context Analysis (FCA) and, though only theoretically, Distributed Information Logic (DIL). The semiotic objects (s-objects) of this theory can be described in tabular datasets. Nevertheless, at this stage of formalisation of the theory, lattices (not trees) can be used as working representation structures for characterizing the components of concept systems and graphs for categories of each layer. (shrink)

Purpose Interdisciplinary linkage of information is an emerging topic to create knowledge by collaboration of experts in diverse domains. New insights can be found by using the combined techniques and information when people have the chance to discuss and communicate on a common basis. Design/methodology/approach This paper describes RMS Cloud, an information management system which allows distributed data sources to be searched using dynamic joins of results from heterogeneous data formats. It is based on the well-known Mediator (...) architecture, but reverses the connection of the data sources to grant data owners full control over the data. Findings Data owners and learners are enabled to retrieve information and to cross-connect domain-extrinsic knowledge and enhances collaborative learning with a search interface that is intuitive and easy to operate. Originality/value This novel architecture is able to connect to differently shaped data sources from interdisciplinary domains into one common retrieval interface. (shrink)

This study concerns the distribution of metaphorical lexis in discrete syntactic constructions. Source and target seed language from established conceptual metaphors in economic discourse is used to catalogue the specific patterns of how metaphorical pairs align in five syntactic constructions: A-NP, N-N, NP-of-NP, V-NP, and X is Y. Utilizing the Corpus of Contemporary American English, the examination includes 12 frequent metaphorical target triggers combined with 84 source triggers to produce 2,016 ordered collocations, i.e. investment freeze and turbulent market. Through detailed (...) type and token counts, results confirm that source domains function as conceptual material used to structure the target domain and disproportionally fill syntactic positions associated with predication, Studies in cognitive corpus linguistics. Frankfurt: Peter Lang Publishers; Sullivan, Karen. 2013. Frames and constructions in metaphoric language. Amsterdam: John Benjamins Publishing). Given a lexeme’s origin – source or target – when used in source-target metaphors, syntactic alignment can be predicted, market climate is metaphorical, climate market is not. Exceptions to these strong tendencies are explained through genre-specific lexicalization processes in which predicate denoting terms like bubble establish themselves as domain modifiers in economic jargon. Through quantitative techniques to gage metaphorical conventionality and lexical versatility, corpus methodology is used to define and inform the value of frequency effects in cataloguing and understanding metaphorical lexicalization. (shrink)

Information‐theoretic complexity metrics, such as Surprisal (Hale, 2001; Levy, 2008) and Entropy Reduction (Hale, 2003), are linking hypotheses that bridge theorized expectations about sentences and observed processing difficulty in comprehension. These expectations can be viewed as syntactic derivations constrained by a grammar. However, this expectation‐based view is not limited to syntactic information alone. The present study combines structural and non‐structural information in unified models of word‐by‐word sentence processing difficulty. Using probabilistic minimalist grammars (Stabler, 1997), we extend expectation‐based (...) models to include frequency information about noun phrase animacy. Entropy reductions derived from these grammars faithfully reflect the asymmetry between subject and object relatives (Staub, 2010; Staub, Dillon, & Clifton, 2017), as well as the effect of animacy on the measured difficulty profile (Lowder & Gordon, 2012; Traxler, Morris, & Seely, 2002). Visualizing probability distributions on the remaining alternatives at particular parser states allows us to explore new, linguistically plausible interpretations for the observed processing asymmetries, including the way that expectations about the relativized argument influence the processing of particular types of relative clauses (Wagers & Pendleton, 2016). (shrink)

Recent investigations on how people derive meaning from language have focused on task‐dependent shifts between two cognitive systems. The symbolic (amodal) system represents meaning as the statistical relationships between words. The embodied (modal) system represents meaning through neurocognitive simulation of perceptual or sensorimotor systems associated with a word's referent. A primary finding of literature in this field is that the embodied system is only dominant when a task necessitates it, but in certain paradigms, this has only been demonstrated using nouns (...) and adjectives. The purpose of this paper is to study whether similar effects hold with verbs. Experiment 1 evaluated a novel task in which participants rated a selection of verbs on their implied vertical movement. Ratings correlated well with distributional semantic models, establishing convergent validity, though some variance was unexplained by language statistics alone. Experiment 2 replicated previous noun‐based location‐cue congruency experimental paradigms with verbs and showed that the ratings obtained in Experiment 1 predicted reaction times more strongly than language statistics. Experiment 3 modified the location‐cue paradigm by adding movement to create an animated, temporally decoupled, movement‐verb judgment task designed to examine the relative influence of symbolic and embodied processing for verbs. Results were generally consistent with linguistic shortcut hypotheses of symbolic‐embodied integrated language processing; location‐cue congruence elicited processing facilitation in some conditions, and perceptual information accounted for reaction times and accuracy better than language statistics alone. These studies demonstrate novel ways in which embodied and linguistic information can be examined while using verbs as stimuli. (shrink)

One of the main limitations of natural language‐based approaches to meaning is that they do not incorporate multimodal representations the way humans do. In this study, we evaluate how well different kinds of models account for people's representations of both concrete and abstract concepts. The models we compare include unimodal distributional linguistic models as well as multimodal models which combine linguistic with perceptual or affective information. There are two types of linguistic models: those based on (...) text corpora and those derived from word association data. We present two new studies and a reanalysis of a series of previous studies. The studies demonstrate that both visual and affective multimodal models better capture behavior that reflects human representations than unimodal linguistic models. The size of the multimodal advantage depends on the nature of semantic representations involved, and it is especially pronounced for basic‐level concepts that belong to the same superordinate category. Additional visual and affective features improve the accuracy of linguistic models based on text corpora more than those based on word associations; this suggests systematic qualitative differences between what information is encoded in natural language versus what information is reflected in word associations. Altogether, our work presents new evidence that multimodal information is important for capturing both abstract and concrete words and that fully representing word meaning requires more than purely linguistic information. Implications for both embodied and distributional views of semantic representation are discussed. (shrink)

We propose the “grammatical profile” as a means of probing the aspectual behavior of verbs. A grammatical profile is the relative frequency distribution of the inflected forms of a word in a corpus. The grammatical profiles of Russian verbs provide data on two crucial issues: a) the overall relationship between perfective and imperfective verbs and b) the identification of verbs that characterize various intersections of aspect, tense and mood (TAM) with lexical classes. There is a long-standing debate over whether Russian (...) aspectual “pairs” are formed only via suffixation (the Isacenko hypothesis) or whether they are formed via both suffixation and prefixation (the traditional view). We test the Isacenko hypothesis using data on the corpus frequency of inflected forms of verbs. We find that the behavior of perfective and imperfective verbs is the same regardless of whether the aspectual relationship is marked by prefixes or suffixes; our finding thus supports the traditional view. Introspective descriptions of Russian aspect have often connected the use of particular inflectional forms with certain uses of aspect; for example, the use of imperative forms with the imperfective aspect to produce expressions that are very polite. Grammatical profiles make it possible to identify verbs that behave as outliers, presenting unusually large proportions of usage in parts of the paradigm. This analysis both gives substance to and extends previous introspective descriptions by identifying the verbs most involved in certain TAM-category interactions. On a methodological level, this study contributes to current discussions on the use of inflected forms vs. lemmas in corpus studies. Newman (Aiming low in linguistics: Low-level generalizations in corpus-based research: National Chiao Tung University, 2008) finds valuable information at the level of the inflectional form, and Gries (forthcoming) argues that inflectional forms do not necessarily provide a better basis for analysis than lemmas. We agree with them that the appropriate level of granularity is determined by both the language and the linguistic phenomenon under analysis. (shrink)

Word Order Universals is a detailed account of word order universals and their role in theories of historical change. The starting point is the Greenberg data set, which is comprised of a sample of 142 languages for certain limited co-occurrences of basic word orders, and a 30-language sample for more detailed information. In the Language Index, the 142 have been expanded to some 350 languages. Using the original Greenberg samples and the Expanded Sample, an alternative set of descriptive word (...) order statements is provided. Comprised of eight chapters, this book begins with an introduction to the theory of word order universals, encompassing topics such as word order variation across languages and theories of universal grammar. The reader is then introduced to the work of Joseph Greenberg and Theo Vennemann on word order universals; implicational universals in Greenberg's data and the Expanded Sample; and the predictions made by implicational and distributional universals for word order change. Reformulated universals for historical reconstruction are also discussed, along with some laws of reconstruction derived from synchronic universals. The final chapter is devoted to the Expanded Sample, with particular reference to its quantities as well as its typological and genetic classification. This monograph will be a useful resource for specialists in grammar and linguistics. (shrink)

Categorization of sensory stimuli is a vital process in understanding the world. In this paper we show that distributional learning plays a role in learning novel object categories in school-aged children. An 11-step continuum was constructed based on two novel animate objects by morphing one object into the other in 11 equal steps. Forty-nine children were subjected to one of two familiarization conditions during which they saw tokens from the continuum. The conditions differed in the position of the (...) class='Hi'>distributional peaks along the continuum. After familiarization it was tested how the children categorized the stimuli. Results show that, in line with our expectations, familiarization condition influenced categorization during the test phase, indicating that the frequency distribution of tokens in the input had induced novel object category formation. These results suggest that distributional learning could play an important role in categorizing sensory stimuli throughout life. (shrink)

This paper explores how organizational members use documents to share their knowledge within and across work settings. I suggest that organizational studies of distributed knowledge sharing and information systems would greatly benefit from the linguistic analysis of communicative practices. Specifically, the paper highlights the notion of indexical centering as formulated by the linguistic anthropologist William Hanks and demonstrates its analytical power in studying documenting as a communicative practice. Drawing on a 15-month, multi-sited ethnographic study in several pediatric (...) healthcare settings, the paper focuses on how two doctors compose and use two medical histories found in two distinct medical information systems. The analysis suggests that the doctors use documents to index the temporal, spatial, and participatory dimensions of their knowledge sharing. They do so by indexing, on the one hand, the participants, times and places for their communicative practices and, on the other hand, the participants, times and places of their general care practices. The indexical analysis allows us to perceive documents, as more than mere vessels for knowledge transfer among organizational members, but as an integrated part of how people structure their work practices and situate their knowledge sharing in complex distributed organizational settings. (shrink)

The papers collected in this volume exemplify some of the trends in current approaches to logic, language and computation. Written by authors with varied academic backgrounds, the contributions are intended for an interdisciplinary audience. The first part of this volume addresses issues relevant for multi-agent systems: reasoning with incomplete information, reasoning about knowledge and beliefs, and reasoning about games. Proofs as formal objects form the subject of Part II. Topics covered include: contributions on logical frameworks, linear logic, and different (...) approaches to formalized reasoning. Part III focuses on representations and formal methods in linguistic theory, addressing the areas of comparative and temporal expressions, modal subordination, and compositionality. (shrink)

The subject matter of this book is the mental lexicon, that is, the way in which the form and meaning of words is stored by speakers of specific languages. This book attempts to narrow the gap between the results of experimental neurology and the concerns of theoretical linguistics in the area of lexical semantics. The prime goal as regards linguistic theory is to show how matters of lexical organization can be analysed and discussed within a neurologically informed framework that (...) is both adaptable and constrained. It combines the perspectives of distributed network modelling and linguistic semantics, and draws upon the accruing evidence from neuroimaging studies as regards the cortical regions involved. It engages with a number of controversial current issues in both disciplines. The book is intended as a tool for linguists interested in psychological adequacy and the latest advances in cognitive science. It provides a principled means of distinguishing those semantic features required by a mental lexicon that have a direct bearing on grammar from those that do not. It will appeal to researchers in neurolinguistics and lexical semantics."--p. 4 of cover. (shrink)

This chapter discusses some of the causal forces that enable young children to acquire language. It demonstrates that these causal forces are not readily apparent in the input that children experience. This discussion of the causal forces of language and the poverty of the stimulus focuses on just a fragment of human language. The chapter discusses four kinds of expressions. In English, these expressions are the words some, any, and or, and question words such as who and what. Although these (...) expressions appear to be unrelated, the chapter shows that they are all cut from the same cloth – they are governed by the same linguistic principles, which determine both their distributional properties and their meanings. Like any and or, linguists have proposed principles that amalgamate information‐seeking questions and their statement counterparts. The chapter describes the important role played by cross‐linguistic facts as a source of information about the deep forces that shape language. (shrink)

Selectional preferences have a long history in both generative and computational linguistics. However, since the publication of Resnik's dissertation in 1993, a new approach has surfaced in the computational linguistics community. This new line of research combines knowledge represented in a pre‐defined semantic class hierarchy with statistical tools including information theory, statistical modeling, and Bayesian inference. These tools are used to learn selectional preferences from examples in a corpus. Instead of simple sets of semantic classes, selectional preferences are viewed (...) as probability distributions over various entities. We survey research that extends Resnik's initial work, discuss the strengths and weaknesses of each approach, and show how they together form a cohesive line of research. (shrink)

Social and linguistic perceptions are linked. On one hand, talker identity affects speech perception. On the other hand, speech itself provides information about a talker's identity. Here, we propose that the same probabilistic knowledge might underlie both socially conditioned linguistic inferences and linguistically conditioned social inferences. Our computational–level approach—the ideal adapter—starts from the idea that listeners use probabilistic knowledge of covariation between social, linguistic, and acoustic cues in order to infer the most likely explanation of the (...) speech signals they hear. As a first step toward understanding social inferences in this framework, we use a simple ideal observer model to show that it would be possible to infer aspects of a talker's identity using cue distributions based on actual speech production data. This suggests the possibility of a single formal framework for social and linguistic inferences and the interactions between them. (shrink)

Understanding a sentence and integrating it into the discourse depends upon the identification of its focus, which, in spoken German, is marked by accentuation. In the case of written language, which lacks explicit cues to accent, readers have to draw on other kinds of information to determine the focus. We study the joint or interactive effects of two kinds of information that have no direct representation in print but have each been shown to be influential in the reader’s (...) text comprehension: i. the (low-level) rhythmic-prosodic structure that is based on the distribution of lexically stressed syllables, and ii. the (high-level) discourse context that is grounded in the memory of previous linguistic content. Systematically manipulating these factors, we examine the way readers resolve a syntactic ambiguity involving the scopally ambiguous focus operator auch (engl. `too') in both oral (Experiment 1) and silent reading (Experiment 2). The results of both experiments attest that discourse context and local linguistic rhythm conspire to guide the syntactic and, concomitantly, the focus-structural analysis of ambiguous sentences. We argue that reading comprehension requires the (implicit) assignment of accents according to the focus structure and that, by establishing a prominence profile, the implicit prosodic rhythm directly affects accent assignment. (shrink)

ERPs (event-related potentials) correlates are largely used in cognitive psychology and specifically for analysis of semantic information processing. Previous research has underlined a strong correlation between a negative-ongoing wave (N400), more frontally distributed, and semantic linguistic or extra-linguistic anomalies. With reference to the extra-linguistic domain, our experiment analyzed ERP variation in a semantic task of comprehension of emotional facial expressions. The experiment explored the effect of expectancy violation when subjects observed congruous or incongruous emotional facial patterns. (...) Four prototypical (anger, sadness, happiness and surprise) and four morphed faces were presented. Moreover, two distinct cognitive tasks (an implicit vs an explicit elaboration) were analyzed in order to evaluate the influence of spontaneous decoding in N400-like effects. An automatic, high-order cognitive process was found, elicited by a negative ERP variation similar to the linguistic N400 effect, which allows us to explain the congruous/incongruous decoding in semantic extra-linguistic comprehension. (shrink)

Humans are equipped with the remarkable ability to comprehend an infinite number of utterances. Relations between grammatical categories restrict the way words combine into phrases and sentences. How the brain recognizes different word combinations remains largely unknown, although this is a necessary condition for combinatorial unboundedness in language. Here, we used functional magnetic resonance imaging and multivariate pattern analysis to explore whether distinct neural populations of a known language network hub—Broca’s area—are specialized for recognizing distinct simple word combinations. The phrases (...) consisted of a noun (flag) occurring either with a content word, an adjective (green flag), or with a function word, a determiner (that flag). The key result is that the distribution of neural populations classifying word combination in Broca’s area seems sensitive to neuroanatomical subdivisions within this area, irrespective of task. The information patterns for adjective + noun were localized in its anterior part (BA45) whereas those for determiner + noun were localized in its posterior part (BA44). Our findings provide preliminary answers to the fundamental question of how lexical and grammatical category information interact during simple word combination, with the observation that Broca’s area is sensitive to the recognition of categorical relationships during combinatory processing, based on different demands placed on syntactic and semantic information. This supports the hypothesis that the combinatorial power of language consists of some neural computation capturing phrasal differences when processing linguistic input. (shrink)

The use of information technology in linguistic research gave rise in the 1950s to what is known as Natural Language Processing, but that framework was created without paying due attention to the need for logical reconstruction of linguistic concepts which were borrowed directly from barely formalised structural linguistics. The Computer-aided Acquisition of Semantic Knowledge project based on the Knowledge Discovery in Databases technology enabled us to interact with computers while gathering and improving our knowledge about languages. Thus, (...) with the help of data mining tools, as a result of revisiting two sorts of generally admitted linguistic theories, we succeeded in improving these local linguistic approaches by proposing to unify the Associative Semantics theory with the Meta-Informative Centering theory. The resulting Distributed Grammar program treats, in addition to the above types of information, the third one, para-information which – despite many studies – had no uniform theoretical background in general linguistics. This DG program aims to lay the foundations for creating the theoretical background of Conceptual Linguistics. (shrink)