The major global challenges of our time, like climate and environmental crises, rising inequality, the emergence of disruptive technologies, etc., demand interdisciplinary research for effective solutions. A clear understanding of value is essential for guiding socio-cultural and economic transitions to address these issues. Despite numerous attempts to define value, existing approaches remain inconsistent across disciplines and lack a comprehensive framework. This paper introduces a novel perspective on value through the lens of granular interaction thinking theory, proposing an informational entropy-based (...) notion of value. Grounded on quantum mechanics, Shannon’s information theory, and the mindsponge theory, this framework integrates both subjective and objective considerations and is highly compatible with interdisciplinary research. The informational entropy-based notion of value effectively bridges diverse concepts of value, including use and exchange value in economics, personal values in psychology, and cultural, moral, ethical, and aesthetic values in society. By offering a unifying perspective, granular interaction thinking theory provides a valuable framework for translating insights from quantum mechanics into socio-cultural, economic, and psychological contexts, enriching theoretical discourse and enhancing analytical effectiveness. (shrink)

Entropy is ubiquitous in physics, and it plays important roles in numerous other disciplines ranging from logic and statistics to biology and economics. However, a closer look reveals a complicated picture: entropy is defined differently in different contexts, and even within the same domain different notions of entropy are at work. Some of these are defined in terms of probabilities, others are not. The aim of this chapter is to arrive at an understanding of some of the (...) most important notions of entropy and to clarify the relations between them, After setting the stage by introducing the thermodynamic entropy, we discuss notions of entropy in information theory, statistical mechanics, dynamical systems theory and fractal geometry. (shrink)

Daniel R. Brooks and E. O. Wiley have proposed a theory of evolution in which fitness is merely a rate determining factor. Evolution is driven by non-equilibrium processes which increase the entropy and information content of species together. Evolution can occur without environmental selection, since increased complexity and organization result from the likely capture at the species level of random variations produced at the chemical level. Speciation can occur as the result of variation within the species which decreases the (...) probability of sharing genetic information. Critics of the Brooks-Wiley theory argue that they have abused terminology from information theory and t thermodynamics. In this paper I review the essentials of the theory, and give an account of hierarchical physical information systems within which the theory can be interpreted. I then show how the major conceptual objections can be answered. (shrink)

This essay is an attempt to reconcile the disturbing contradiction between the striving for order in nature and in man and the principle of entropy implicit in the second law of thermodynamics - between the tendency toward greater organization and the general trend of the material universe toward death and disorder.

This book is about an important issue which has arisen within two of the branches of physical science - namely thermodynamics and statistical mechanics - where the notion of entropy plays an essential role. A number of scientists and information theorists have maintained that entropy is a subjective concept and is a measure of human ignorance. Such a view, if it is valid, would create some profound philosophical problems and would tend to undermine the objectivity of the scientific (...) enterprise. Whilst the present volume is not a treatise on thermodynamics or statistical mechanics, all relevant steps in the building up of these disciplines are carefully scrutinised and it is concluded that the charge of subjectivity cannot be upheld. The widely adopted view that entropy is a measure of disorder, or of lack of information, is shown to be ambiguous, although it may be of use in certain contexts. (shrink)

Although the laws of thermodynamics are well established for black hole horizons, much less has been said in the literature to support the extension of these laws to more general settings such as an asymptotic de Sitter horizon or a Rindler horizon (the event horizon of an asymptotic uniformly accelerated observer). In the present paper we review the results that have been previously established and argue that the laws of black hole thermodynamics, as well as their underlying statistical mechanical content, (...) extend quite generally to what we call here “causal horizons.” The root of this generalization is the local notion of horizon entropy density. (shrink)

The Anthropocene crisis is frequently described as the rarefaction of resources or resources per capita. However, both energy and minerals correspond to fundamentally conserved quantities from the perspective of physics. A specific concept is required to understand the rarefaction of available resources. This concept, entropy, pertains to energy and matter configurations and not just to their sheer amount. However, the physics concept of entropy is insufficient to understand biological and social organizations. Biological phenomena display both historicity and systemic (...) properties. A biological organization, the ability of a specific living being to last over time, results from history, expresses itself by systemic properties, and may require generating novelties The concept of anti-entropy stems from the combination of these features. We propose that Anthropocene changes disrupt biological organizations by randomizing them, that is, decreasing anti-entropy. Moreover, second-order disruptions correspond to the decline of the ability to produce functional novelties, that is, to produce anti-entropy. (shrink)

Two open questions of inductive reasoning are solved: (1) does the principle of maximum entropy (pme) give a solution to the obverse Majerník problem; and (2) is Wagner correct when he claims that Jeffrey’s updating principle (jup) contradicts pme? Majerník shows that pme provides unique and plausible marginal probabilities, given conditional probabilities. The obverse problem posed here is whether pme also provides such conditional probabilities, given certain marginal probabilities. The theorem developed to solve the obverse Majerník problem demonstrates that (...) in the special case introduced by Wagner pme does not contradict jup, but elegantly generalizes it and offers a more integrated approach to probability updating. (shrink)

Michel Serres’s philosophy of entropy takes what he famously calls the ‘Northwest Passage’ between the sciences and the humanities. By contextualizing his approach to entropy and affirming the role of a philosophy of difference, this paper explores Serres’s approach by means of ‘entropic differences’. It claims that entropy – or rather, entropies – provide Serres with a paradigmatic case for critical translations between different domains of knowledge. From his early Hermès series, through to The Birth of Physics (...) and later writings on social and ethical themes, he keeps thermodynamical and informational – or ‘hard’ and ‘soft’ – understandings of entropy apart, while simultaneously exploring their relation. By focusing on the systematic significance of Serres’s ‘entropic difference’, this paper shows how it unfolds not necessarily as an ontological difference but as an operative function between the history and philosophy of science, epistemology, and a theory of negentropic (inter)subjectivity. (shrink)

It is a fundamental cornerstone of thermodynamics that entropy (SU,V\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$S_{U,V}$$\end{document}) increases in spontaneous processes in isolated systems (often called closed or thermally closed systems when the transfer of energy as work is considered to be negligible) and achieves a maximum when the system reaches equilibrium. But with a different sign convention entropy could just as well be said to decrease to a minimum in spontaneous constant U, V processes. It (...) would then change in the same direction as the thermodynamic potentials in spontaneous processes. This article discusses but does not advocate such a change. (shrink)

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences and distinguishability and is formalized using the distinctions of a partition. All the definitions of simple, joint, conditional and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this (...) paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates that are distinguished by the measurement. Both the classical and quantum versions of logical entropy have simple interpretations as “two-draw” probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states. (shrink)

This essay is an attempt to reconcile the disturbing contradiction between the striving for order in nature and in man and the principle of entropy implicit in the second law of thermodynamics - between the tendency toward greater organization and the general trend of the material universe toward death and disorder.

The paper tries to demonstrate that the process of the increase of entropy does not explain the asymmetry of time itself because it is unable to account for its fundamental asymmetries, that is, the asymmetry of traces (we have traces of the past and no traces of the future), the asymmetry of causation (we have an impact on future events with no possibility of having an impact on the past), and the asymmetry between the fixed past and the open (...) future, To this end, the approaches of Boltzmann, Reichenbach (and his followers), and Albert are analysed. It is argued that we should look for alternative approaches instead of this, namely we should consider a temporally asymmetrical physical theory or seek a source of the asymmetry of time in metaphysics. This second approach may even turn out to be complementary if only we accept that metaphysics can complement scientific research programmes. (shrink)

One well-known objection to the principle of maximum entropy is the so-called Judy Benjamin problem, first introduced by van Fraassen. The problem turns on the apparently puzzling fact that, on the basis of information relating an event’s conditional probability, the maximum entropy distribution will almost always assign to the event conditionalized on a probability strictly less than that assigned to it by the uniform distribution. In this article, I present an analysis of the Judy Benjamin problem that can (...) help to make sense of this seemingly odd feature of maximum entropy inference. My analysis is based on the claim that, in applying the principle of maximum entropy, Judy Benjamin is not acting out of a concern to maximize uncertainty in the face of new evidence, but is rather exercising a certain brand of epistemic charity towards her informant. This epistemic charity takes the form of an assumption on the part of Judy Benjamin that her informant’s evidential report leaves out no relevant information. Such a reconceptualization of the motives underlying Judy Benjamin’s appeal to the principle of maximum entropy can help to further our understanding of the true epistemological grounds of this principle and correct a common misapprehension regarding its relationship to the principle of insufficient reason. 1Introduction2The Principle of Maximum Entropy3An Apologia for Judy Benjamin4Conclusion: Entropy and Insufficient Reason. (shrink)

A recent study suggests that value and quantum states seem to be governed by the same underlying mechanisms. In our recent book titled "Better economics for the Earth: A lesson from quantum and information theories," specifically Chapter 5, we have proposed an informational entropy-based notion of value, grounded in Granular Interaction Thinking Theory (GITT), which integrates granular worldview and primary features of quantum mechanics, Shannon’s information theory, and the mindsponge theory. Specifically, the notion suggests that values are created through (...) the interactions of information. But how do information and its interactions lead to values? This research note aims to contribute to the answer to this question. (shrink)

Both a method of therapy and an exploration of psychic reality, free association is a fundamental element of psychoanalytical practices that refers to the way a patient is asked to describe what comes spontaneously to mind in the therapeutic setting. This paper examines the role of free association from the point of view of psychoanalysis and neuroscience in order to improve our understanding of therapeutic effects induced by psychoanalytic therapies and psychoanalysis. In this regard, we first propose a global overview (...) of the historical origins of the concept of free association in psychoanalysis and examine how Freud established its principles. Then, from Freud’s distinction between primary and secondary processes, we proceed to compare the psychoanalytic model with research originating from cognitive psychology and neuroscience. The notions of entropy and free energy appear particularly relevant at the intersection of these different domains. Finally, we propose the notion of symbolizing transmodality to describe certain specificities of symbolization processes within free association and we summarize the main functions of free association in psychoanalytic practices. (shrink)

Integrating concepts of maintenance and of origins is essential to explaining biological diversity. The unified theory of evolution attempts to find a common theme linking production rules inherent in biological systems, explaining the origin of biological order as a manifestation of the flow of energy and the flow of information on various spatial and temporal scales, with the recognition that natural selection is an evolutionarily relevant process. Biological systems persist in space and time by transfor ming energy from one state (...) to another in a manner that generates structures which allows the system to continue to persist. Two classes of energetic transformations allow this; heat-generating transformations, resulting in a net loss of energy from the system, and conservative transformations, changing unusable energy into states that can be stored and used subsequently. All conservative transformations in biological systems are coupled with heat-generating transformations; hence, inherent biological production, or genealogical proesses, is positively entropic. There is a self-organizing phenomenology common to genealogical phenomena, which imparts an arrow of time to biological systems. Natural selection, which by itself is time-reversible, contributes to the organization of the self-organized genealogical trajectories. The interplay of genealogical (diversity-promoting) and selective (diversity-limiting) processes produces biological order to which the primary contribution is genealogical history. Dynamic changes occuring on times scales shorter than speciation rates are microevolutionary; those occuring on time scales longer than speciation rates are macroevolutionary. Macroevolutionary processes are neither redicible to, nor autonomous from, microevolutionary processes. (shrink)

For the first time Entropy has been completely revised and updated to include a new subtitle which reflects the expanded focus on the greenhouse effect--the largest crisis ever to face mankind.

The language of entropy is examined for consistency with its mathematics and physics, and for its efficacy as a guide to what entropy means. Do common descriptors such as disorder, missing information, and multiplicity help or hinder understanding? Can the language of entropy be helpful in cases where entropy is not well defined? We argue in favor of the descriptor spreading, which entails space, time, and energy in a fundamental way. This includes spreading of energy spatially (...) during processes and temporal spreading over accessible microstates states in thermodynamic equilibrium. Various examples illustrate the value of the spreading metaphor. To provide further support for this metaphor’s utility, it is shown how a set of reasonable spreading properties can be used to derive the entropy function. A main conclusion is that it is appropriate to view entropy’s symbol S as shorthand for spreading. (shrink)

In a previous paper a theory of program size formally identical to information theory was developed. The entropy of an individual finite object was defined to be the size in bits of the smallest program for calculating it. It was shown that this is − log2 of the probability that the object is obtained by means of a program whose successive bits are chosen by flipping an unbiased coin. Here a theory of the entropy of recursively enumerable sets (...) of objects is proposed which includes the previous theory as the special case of sets having a single element. The primary concept in the generalized theory is the probability that a computing machine enumerates a given set when its program is manufactured by coin flipping. The entropy of a set is defined to be − log2 of this probability. (shrink)

A new way of understanding entropy as a macroscopic property is presented. This is based on the fact that heat flows from a hot body to a cold one even when the hot one is smaller and has less energy. A quantity that determines the direction of flow is shown to be the increment of heat gained divided by the absolute temperature. The same quantity is shown to determine the direction of other processes taking place in isolated systems provided (...) that q is determined by the state of the system. Entropy emerges as the potent energy of a system [Σ], the potency being determined by 1/T. This is shown to tie in with the statistical mechanical interpretation of entropy. The treatment is shorter than the traditional one based on heat engines. (shrink)

Neural complexity and brain entropy have gained greater interest in recent years. The dynamics of neural signals and their relations with information processing continue to be investigated through different measures in a variety of noteworthy studies. The BEN of spontaneous neural activity decreases during states of reduced consciousness. This evidence has been showed in primary consciousness states, such as psychedelic states, under the name of “the entropic brain hypothesis.” In this manuscript we propose an extension of this hypothesis to (...) physiological and pathological aging. We review this particular facet of the complexity of the brain, mentioning studies that have investigated BEN in primary consciousness states, and extending this view to the field of neuroaging with a focus on resting-state functional Magnetic Resonance Imaging. We first introduce historic and conceptual ideas about entropy and neural complexity, treating the mindbrain as a complex nonlinear dynamic adaptive system, in light of the free energy principle. Then, we review the studies in this field, analyzing the idea that the aim of the neurocognitive system is to maintain a dynamic state of balance between order and chaos, both in terms of dynamics of neural signals and functional connectivity. In our exploration we will review studies both on acute psychedelic states and more chronic psychotic states and traits, such as those in schizophrenia, in order to show the increase of entropy in those states. Then we extend our exploration to physiological and pathological aging, where BEN is reduced. Finally, we propose an interpretation of these results, defining a general trend of BEN in primary states and cognitive aging. (shrink)

The idea that the changing entropy of a system is relevant to explaining why we know more about the system's past than about its future has been criticized on several fronts. This paper assesses the criticisms and clarifies the epistemology of the inference problem. It deploys a Markov process model to investigate the relationship between entropy and temporally asymmetric inference.

Pour étendre la notion d'entropie, l'auteur tente de dégager la signification de la “probabilité relative” w de Boltzmann dans sa formule S = k.log.w. Celui-ci introduit implicitement une partition d'un ensemble E de molécules en classes d'équivalence, les divers états macroscopiques du gaz; w est le rapport de la probabilité de l'état dont on cherche à définir l'entropie à celle de l'état le plus improbable.L'auteur propose de généraliser le concept toutes les fois ob sur un ensemble probabilisable E il sera (...) possible de faire une partition.La “complexité d'une structure” peut être définie par le nombre d'aspects différents que peut prendre le graphe sous-jacent à celle-ci. Alors toute stricture a une probabilité d'occurrence, et l'on peut y définir une G-entropie.Appliquant ensuite ce concept à la théorie de l'information de Shannon, l'auteur montre que la quantité d'information apportée par un message est différente de la G-entropie, mais que les deux grandeurs y prennent fortuitement la même valeur. Le concept permet également d'introduire une information liée au message, une autre au “code”, et une information totale.Le concept d'émergence permet ensuite de comprendre la raison pour laquelle celle-ci s'accompagne d'une augmentation de G-neguentropie.L'entropie est considérée depuis Boltzmann comme une borne mesure du désordre d'un gaz, d'où son intérêt en morphogénèse, en théorie des systèmes, et de l'information. Cependant son application directe pose des problèmes, et il parait préférable de tenter auparavant de généraliser le concept en le randant plus abstrait. La première difficulté à laquelle on se heurte alors est l'interprétation du nombre w de la formule de Boltzmann. (shrink)

"By combining recent advances in the physical sciences with some of the novel ideas, techniques, and data of modern biology, this book attempts to achieve a new and different kind of evolutionary synthesis. I found it to be challenging, fascinating, infuriating, and provocative, but certainly not dull."--James H, Brown, University of New Mexico "This book is unquestionably mandatory reading not only for every living biologist but for generations of biologists to come."--Jack P. Hailman, Animal Behaviour , review of the first (...) edition "An important contribution to modern evolutionary thinking. It fortifies the place of Evolutionary Theory among the other well-established natural laws."--R.Gessink, TAXON. (shrink)

The conception of entropy came from the theoretical study of the steam-engine, and, neglecting refinements of mathematical treatment, can easily be illustrated. The motive power of the engine comes from the transformation of the heat generated by the combustion of the fuel. The mechanism transforms the kinetic energy of the molecules of heated steam into the kinetic energy of the parts of the engine. Consider a steamship under way: for a brief period of time this can be regarded as (...) an automatic physical system. Some of the heat conveyed by the steam transforms directly into mechanical energy and some passes out into the ocean in the condenser water. We take the latter fraction: in the boiler there is a certain quantity, Q 1 , at a temperature of, say, 200°C, that is, 473° absolute, and its entropy is simply Q 1 /473° ab. The same quantity passes out into the ocean where its temperature falls to, say, 10°C, or 283° ab., and its entropy is now Q 1 /283° ab. Plainly the former quantity of entropy is less than the latter, so that in the transformation of heat into mechanical energy entropy has increased . The conception has been generalized so as to include all forms of energy and all physical transformations, and it can be shown that in all physical events that occur of themselves entropy increases. The conception includes these notions: Available and unavailable energy; greater or lesser improbability of the elements of the systems contemplated; and the physical meanings of before and after. (shrink)

According to the universal entropy bound, the entropy (and hence information capacity) of a complete weakly self-gravitating physical system can be bounded exclusively in terms of its circumscribing radius and total gravitating energy. The bound’s correctness is supported by explicit statistical calculations of entropy, gedanken experiments involving the generalized second law, and Bousso’s covariant holographic bound. On the other hand, it is not always obvious in a particular example how the system avoids having too many states for (...) given energy, and hence violating the bound. We analyze in detail several purported counterexamples of this type, and exhibit in each case the mechanism behind the bound’s efficacy. (shrink)

Traditional eschatology clashes with the theory of entropy. Trying to bridge the gap, Robert John Russell assumes that theology and science are based on contradictory, yet equally valid, metaphysical assumptions, each one capable of questioning and impacting the other. The author doubts that Russell's proposal will convince empirically oriented scientists and attempts to provide a viable alternative. Historical‐critical analysis suggests that biblical future expectations were redemptive responses to changing human needs. Apocalyptic visions were occasioned by heavy suffering in postexilic (...) times. Interpreted in realistic terms, they have since proved to be untenable. The expectation of a new creation without evil, suffering, and death is not constitutive for the substantive content of the biblical message as such. Biblical future expectations must be reconceptualized in terms of best contemporary insight and in line with a dynamic reading of the biblical witness as God's vision of comprehensive optimal well‐being that operates like a shifting horizon and opens up ever new vistas, challenges, and opportunities. (shrink)

Numerous studies have focused on the understanding of rapid automatized naming, which can be applied to predict reading abilities and developmental dyslexia in children. Eye tracking technique, characterizing the essential ocular activities, might have the feasibility to reveal the visual and cognitive features of RAN. However, traditional measures of eye movements ignore many dynamical details about the visual and cognitive processing of RAN, and are usually associated with the duration of time spent on some particular areas of interest, fixation counts, (...) revisited fixation counts, saccadic velocities, or saccadic amplitudes. To cope with this drawback, we suggested an entropy-based method to measure eye movements for the first time, which first mapped eye movements during RAN in a time-series and then analyzed the time-series by a proper definition of entropy from the perspective of information theory. Our findings showed that the entropy was more sensitive to reflect small perturbation of eye movements, and thus gained better performance than traditional measures. We also verified that the entropy of eye movements significantly deceased with the age and the task complexity of RAN, and significantly correlated with traditional eye-movement measures [e.g., total time of naming ] and the RAN-related skills [e.g., selective attention, cognitive speed, and visual-motor integration]. Our findings may bring some new insights into the understanding of both RAN and eye tracking technique itself. (shrink)

We investigate uncertain reasoning with quantified sentences of the predicate calculus treated as the limiting case of maximum entropy inference applied to finite domains.

Cross entropy measure is one of the best way to calculate the divergence of any variable from the priori one variable. We define a new cross entropy measure under interval neutrosophic set environment.

I assess the thesis that counterfactual asymmetries are explained by an asymmetry of the global entropy at the temporal boundaries of the universe, by developing a method of evaluating counterfactuals that includes, as a background assumption, the low entropy of the early universe. The resulting theory attempts to vindicate the common practice of holding the past mostly fixed under counterfactual supposition while at the same time allowing the counterfactual's antecedent to obtain by a natural physical development. Although the (...) theory has some success in evaluating a wide variety of ordinary counterfactuals, it fails as an explanation of counterfactual asymmetry. (shrink)

Entropy is proposed as a concept which in its broader scope can contribute to the study of the General Information System. This paper attempts to identify a few fundamental subconcepts and LEMMAS which will serve to facilitate further study of system order. The paper discusses: partitioning order into logical and arbitrary kinds; the relationship of order to pattern; and suggested approaches to evaluating and improving the General Information System.

Ethics is an unconventional field of research for a surgeon, as ethics in surgery owns several specificities and surgery is considered an aggressive specialty. Therefore, the interest of research in medical ethics is sometimes unclear.In this short essay, we discussed the interest of research in medical ethics using a comparison to thermodynamics and mainly, entropy. During the transformation of a figure from one state to another, some energy is released or absorbed; yet, a part of this energy is wasted (...) because of “unordered” reactions: it is Entropy.This “wasted energy” exists in Medical practice and justifies research in Medical ethics. (shrink)

The Madelung equations map the non-relativistic time-dependent Schrödinger equation into hydrodynamic equations of a virtual fluid. While the von Neumann entropy remains constant, we demonstrate that an increase of the Shannon entropy, associated with this Madelung fluid, is proportional to the expectation value of its velocity divergence. Hence, the Shannon entropy may grow due to an expansion of the Madelung fluid. These effects result from the interference between solutions of the Schrödinger equation. Growth of the Shannon (...) class='Hi'>entropy due to expansion is common in diffusive processes. However, in the latter the process is irreversible while the processes in the Madelung fluid are always reversible. The relations between interference, compressibility and variation of the Shannon entropy are then examined in several simple examples. Furthermore, we demonstrate that for classical diffusive processes, the “force” accelerating diffusion has the form of the positive gradient of the quantum Bohm potential. Expressing then the diffusion coefficient in terms of the Planck constant reveals the lower bound given by the Heisenberg uncertainty principle in terms of the product between the gas mean free path and the Brownian momentum. (shrink)

A new axiomatic characterization with a minimum of conditions for entropy as a function on the set of states in quantum mechanics is presented. Traditionally unspoken assumptions are unveiled and replaced by proven consequences of the axioms. First the Boltzmann–Planck formula is derived. Building on this formula, using the Law of Large Numbers—a basic theorem of probability theory—the von Neumann formula is deduced. Axioms used in older theories on the foundations are now derived facts.

The notion of conditional entropy is extended to noncomposite systems. The \-deformed entropic inequalities, which usually are associated with correlations of the subsystem degrees of freedom in bipartite systems, are found for the noncomposite systems. New entropic inequalities for quantum tomograms of qudit states including the single qudit states are obtained. The Araki–Lieb inequality is found for systems without subsystems.

Information, entropy, probability: these three terms are closely interconnected in the prevalent understanding of statistical mechanics, both when this field is taught to students at an introductory level and in advanced research into the field’s foundations. This paper examines the interconnection between these three notions in light of recent research in the foundations of statistical mechanics. It disentangles these concepts and highlights their differences, at the same time explaining why they came to be so closely linked in the literature. (...) In the literature the term ‘information’ is often linked to entropy and probability in discussions of Maxwell’s Demon and its attempted exorcism by the Landauer-Bennett thesis, and in analyses of the spin echo experiments. The direction taken in the present paper is a different one. Here we discuss the statistical mechanical underpinning of the notions of probability and entropy, and this constructive approach shows that information plays no fundamental role in these concepts, although it can be conveniently used in a sense that we shall specify. (shrink)

Conventional wisdom holds that the von Neumann entropy corresponds to thermodynamic entropy, but Hemmo and Shenker (2006) have recently argued against this view by attacking von Neumann's (1955) argument. I argue that Hemmo and Shenker's arguments fail due to several misunderstandings: about statistical-mechanical and thermodynamic domains of applicability, about the nature of mixed states, and about the role of approximations in physics. As a result, their arguments fail in all cases: in the single-particle case, the finite particles case, (...) and the infinite particles case. (shrink)

We review some notions for general quantum entropies. The entropy of the compound systems is discussed and a numerical computation of the quantum dynamical systems is carried for the noisy optical channel.

Vacuum radiation causes a particle to make a random walk about its dynamical trajectory. In this random walk the root mean square change in spatial coordinate is proportional to t 1/2, and the fractional changes in momentum and energy are proportional to t −1/2, where t is time. Thus the exchange of energy and momentum between a particle and the vacuum tends to zero over time. At the end of a mean free path the fractional change in momentum of a (...) particle in a gas is very small. However, at the end of the mean free path each particle undergoes an interaction that magnifies the preceding change, and the net result is that the momentum distribution of the particles in a gas is randomized in a few collision times. In this way the random action of vacuum radiation and its subsequent magnification by molecular interaction produces entropy increase. This process justifies the assumption of molecular chaos used in the Boltzmann transport equation. (shrink)

The present paper is a survey of the economics of survival, a branch of ecological economics that stresses the preservation of the opportunities of future generations over an extended time horizon. It outlines the main analytical foundation of the branch – in which the concept of entropy is a major building block –, and its analysis of the interaction between the economic system and the environment. Regarding its outlook of the future, we see that the founders of the branch (...) were mainly concerned with the consequences of a serious depletion of natural resources – particularly the energetic capital of the earth. More recently, however, emphasis is being placed on problems that stem from the fragility of the global ecosystem in face of the disturbances caused by the entropic acceleration imposed by mankind. It is feared that the ongoing expansion of the scale of the economy may bring about irreversible damages to vital environmental functions, such as protection against undesirable consequences of solar radiation, maintenance of temperature within a range that will support life, and preservation of ecosystem resiliency. (shrink)

Entropy and information are both emerging as currencies of interdisciplinary dialogue, most recently in evolutionary theory. If this dialogue is to be fruitful, there must be general agreement about the meaning of these terms. That this is not presently the case owes principally to the supposition of many information theorists that information theory has succeeded in generalizing the entropy concept. The present paper will consider the merits of the generalization thesis, and make some suggestions for restricting both (...) class='Hi'>entropy and information to specific arenas of discourse. (shrink)

This essay is, primarily, a discussion of four results about the principle of maximizing entropy (MAXENT) and its connections with Bayesian theory. Result 1 provides a restricted equivalence between the two: where the Bayesian model for MAXENT inference uses an "a priori" probability that is uniform, and where all MAXENT constraints are limited to 0-1 expectations for simple indicator-variables. The other three results report on an inability to extend the equivalence beyond these specialized constraints. Result 2 established a sensitivity (...) of MAXENT inference to the choice of the algebra of possibilities even though all empirical constraints imposed on the MAXENT solution are satisfied in each measure space considered. The resulting MAXENT distribution is not invariant over the choice of measure space. Thus, old and familiar problems with the Laplacian principle of Insufficient Reason also plague MAXENT theory. Result 3 builds upon the findings of Friedman and Shimony (1971; 1973) and demonstrates the absence of an exchangeable, Bayesian model for predictive MAXENT distributions when the MAXENT constraints are interpreted according to Jaynes's (1978) prescription for his (1963) Brandeis Dice problem. Lastly, Result 4 generalizes the Friedman and Shimony objection to cross-entropy (Kullback-information) shifts subject to a constraint of a new odds-ratio for two disjoint events. (shrink)

Visual word recognition is facilitated by the presence of orthographic neighbors that mismatch the target word by a single letter substitution. However, researchers typically do not consider where neighbors mismatch the target. In light of evidence that some letter positions are more informative than others, we investigate whether the influence of orthographic neighbors differs across letter positions. To do so, we quantify the number of enemies at each letter position (how many neighbors mismatch the target word at that position). Analyses (...) of reaction time data from a visual word naming task indicate that the influence of enemies differs across letter positions, with the negative impacts of enemies being most pronounced at letter positions where readers have low prior uncertainty about which letters they will encounter (i.e., positions with low entropy). To understand the computational mechanisms that give rise to such positional entropy effects, we introduce a new computational model, VOISeR (Visual Orthographic Input Serial Reader), which receives orthographic inputs in parallel and produces an over‐time sequence of phonemes as output. VOISeR produces a similar pattern of results as in the human data, suggesting that positional entropy effects may emerge even when letters are not sampled serially. Finally, we demonstrate that these effects also emerge in human subjects' data from a lexical decision task, illustrating the generalizability of positional entropy effects across visual word recognition paradigms. Taken together, such work suggests that research into orthographic neighbor effects in visual word recognition should also consider differences between letter positions. (shrink)

I assess the thesis that counterfactual asymmetries are explained by an asymmetry of the global entropy at the temporal boundaries of the universe by developing a new semantic element for counterfactuals called objective assertibility and a method of evaluating counterfactuals that constrains consideration to possibilities where the early universe has low entropy. The resulting theory vindicates the common practice of holding the past mostly fixed under counterfactual supposition while at the same time allowing the counterfactual's antecedent to obtain (...) by a natural physical development. While excellent for evaluating a wide variety of ordinary counterfactuals, it does not fully succeed as an explanation of counterfactual asymmetry. (shrink)

The application of the maximum entropy principle to determine probabilities on finite domains is well-understood. Its application to infinite domains still lacks a well-studied comprehensive approach. There are two different strategies for applying the maximum entropy principle on first-order predicate languages: applying it to finite sublanguages and taking a limit; comparing finite entropies of probability functions defined on the language as a whole. The entropy-limit conjecture roughly says that these two strategies result in the same probabilities. While (...) the conjecture is known to hold for monadic languages as well as for premiss sentences containing only existential or only universal quantifiers, its status for premiss sentences of greater quantifier complexity is, in general, unknown. I here show that the first approach fails to provide a sensible answer for some \-premiss sentences. I discuss implications of this failure for the first strategy and consequences for the entropy-limit conjecture. (shrink)

I discuss the statistical mechanics of gravitating systems and in particular its cosmological implications, and argue that many conventional views on this subject in the foundations of statistical mechanics embody significant confusion; I attempt to provide a clearer and more accurate account. In particular, I observe that (i) the role of gravity in entropy calculations must be distinguished from the entropy of gravity, that (ii) although gravitational collapse is entropy-increasing, this is not usually because the collapsing matter (...) itself increases in entropy, and that (iii) the Second Law of thermodynamics does not owe its validity to the statistical mechanics of gravitational collapse. (shrink)