SearcharxivSearch

arXiv subjects

Hideyoshi Yanagisawa

Publications and source records attributed to Hideyoshi Yanagisawa.

14 recordsLinked to original sources

Bayesian Expected Uncertainty Reduction (B-EUR) Model: A Computational Account of What Makes Design Options Worth Trying

This paper proposes the Bayesian Expected Uncertainty Reduction (B-EUR) model, which formalizes the value of trying a candidate design action as its expected reduction of epistemic uncertainty about action--outcome relations. The model addresses one part of the Uncertainty Driven Action (UDA) model's open question concerning how changes in uncertainty perception determine action selection. We examine two environmental properties: generalizability, or how far knowledge from one trial extends to neighboring candidates, and outcome discriminability, or how clearly differences among outcomes can be distinguished. We tested the model through simulations and human experiments using a graph-shape guessing task that isolates learning about action--outcome relations under a limited trial budget. Epistemic value followed an inverted-U-shaped relationship with generalizability and increased with outcome discriminability in the simulations. In the human experiments, the subjective value of trying and enjoyment followed inverted-U-shaped relationships with generalizability, while choice behavior reflected both properties. The B-EUR model provides a computational account of candidate-action evaluation within uncertainty-driven design activity and offers implications for constructing prototype sets, framing design problems, and organizing feedback to support informative exploration.

cs.AI

A Bayesian framework for the uncanny valley in humanoid robot design

The uncanny valley is a long-standing empirical rule in humanoid robot design: making robots more human-like can reduce, rather than increase, affinity. Yet existing guidelines, such as adopting robot-like appearances, avoiding excessive realism, and reducing cross-modal mismatches, remain difficult to use for algorithmic design because they are not expressed as manipulable variables. Here, we propose a hierarchical Bayesian generative model that operationalizes these guidelines as mathematical design variables. The model represents affinity toward humanoid robots as posterior-weighted negative category-conditional surprise and explains category ambiguity and perceptual mismatch as increases in surprise. It maps uncanny-valley mechanisms onto four variables: deviation from the predicted robot-category mean, inconsistency in human likeness across modalities, prediction uncertainty, and observational uncertainty. Simulations showed that category ambiguity and appearance--motion mismatch can produce affinity reductions, and that uncertainty reshapes the valley. In a human-subject experiment with robot--human morphing images, we manipulated prediction uncertainty using blurred prior robot stimuli and observational uncertainty using blurred evaluation stimuli. Increased observational uncertainty attenuated the decrease in familiarity ratings at intermediate human likeness, whereas low prediction uncertainty increased ratings for robot-like appearances. This framework turns empirical uncanny-valley heuristics into a computational basis for algorithmically evaluating and optimizing humanoid robot appearance and behavior.

cs.RO

Free Energy-Based Modeling of Emotional Dynamics in Video Advertisements

Emotional responses during advertising video viewing are recognized as essential for understanding media effects because they have influenced attention, memory, and purchase intention. To establish a methodological basis for explainable emotion estimation without relying on external information such as physiological signals or subjective ratings, we have quantified "pleasantness," "surprise," and "habituation" solely from scene-level expression features of advertising videos, drawing on the free energy(FE) principle, which has provided a unified account of perception, learning, and behavior. In this framework, Kullback-Leibler divergence (KLD) has captured prediction error, Bayesian surprise (BS) has captured belief updates, and uncertainty (UN) has reflected prior ambiguity, and together they have formed the core components of FE. Using 1,059 15 s food video advertisements, the experiments have shown that KLD has reflected "pleasantness" associated with brand presentation, BS has captured "surprise" arising from informational complexity, and UN has reflected "surprise" driven by uncertainty in element types and spatial arrangements, as well as by the variability and quantity of presented elements. This study also identified three characteristic emotional patterns, namely uncertain stimulus, sustained high emotion, and momentary peak and decay, demonstrating the usefulness of the proposed method. Robustness across nine hyperparameter settings and generalization tests with six types of Japanese advertising videos (three genres and two durations) confirmed that these tendencies remained stable. This work can be extended by integrating a wider range of expression elements and validating the approach through subjective ratings, ultimately guiding the development of technologies that can support the creation of more engaging advertising videos.

cs.CV

Evaluation of "As-Intended" Vehicle Dynamics using the Active Inference Framework

We constructed a computational model of the driver's brain for steering tasks using the active inference framework, grounded in the free energy principle - a theory from computational neuroscience. This model enables quantitative estimation of how accurately the brain learns vehicle dynamics and performs appropriate steering, using a measure called variational free energy. Through driving simulator experiments, we observed strong correlations between variational free energy and both expert drivers' subjective "as-intended" scores and general participants' objective control performance. These results suggest that variational free energy provides a promising quantitative metric for evaluating whether a vehicle behaves "as-intended."

q-bio.NC

Modeling arousal potential of epistemic emotions using Bayesian information gain: Inquiry cycle driven by free energy fluctuations

Epistemic emotions, such as curiosity and interest, drive the inquiry process. This study proposes a novel formulation of epistemic emotions such as curiosity and interest using two types of information gain generated by the principle of free energy minimization: Kullback-Leibler divergence(KLD) from Bayesian posterior to prior, which represents free energy reduction in recognition, and Bayesian surprise (BS), which represents the expected information gain by Bayesian prior update. By applying a Gaussian generative model with an additional uniform likelihood, we found that KLD and BS form an upward-convex function of surprise (minimized free energy and prediction error), similar to Berlyne's arousal potential functions, or the Wundt curve. We consider that the alternate maximization of BS and KLD generates an ideal inquiry cycle to approach the optimal arousal level with fluctuations in surprise, and that curiosity and interest drive to facilitate the cyclic process. We exhaustively analyzed the effects of prediction uncertainty (prior variance) and observation uncertainty (likelihood variance) on the peaks of the information gain function as optimal surprises. The results show that greater prediction uncertainty, meaning an open-minded attitude, and less observational uncertainty, meaning precise observation with attention, are expected to provide greater information gains through a greater range of exploration. The proposed mathematical framework unifies the free energy principle of the brain and the arousal potential theory to explain the Wundt curve as an information gain function and suggests an ideal inquiry process driven by epistemic emotions.

cs.AI

Predictive Wand: a mathematical interface design for operations with delays

Action-feedback delay during operation reduces both task performance and sense of agency (SoA). In this study, using information-theoretic free energy, we formalized a novel mathematical model for explaining the influence of delay on both task performance and SoA in continuous operations. Based on the mathematical model, we propose a novel interface design called Predictive Wand for predicting future outcomes to prevent task performance and SoA degradation resulting from response delays. Model-based simulations and operational experiments with participants confirmed that operational delay considerably reduces both task performance and SoA. Furthermore, the proposed Predictive Wand mitigates these problems. Our findings support the model-based interface design for continuous operations with delay to prevent task performance and SoA degradation.

cs.HC

Modeling the sense of presence of remote participants in hybrid communication and its application to the design of avatar robot behavior

We formulated the sense of the presence of a remote participant in hybrid communication using a Bayesian framework. We also applied the knowledge gained from the simulation with the Bayesian model to the avatar robot's intervention behavior and encouraged the local participants to speak by intervening in the remote participant's behavior using an avatar robot. We then modeled the influence of the avatar robot's behavior on the local participants' statements using an active inference framework that included the presence of a remote participant as a latent variable. Based on the simulation results, we designed the gaze behavior of an avatar robot. Finally, we examined the effectiveness of the designed gaze behavior of the avatar robot. The gaze behavior expressed more of the remote participant's attention and interest in local participants, but local participants expressed fewer opinions in the meeting tasks. The results suggest that gaze behavior increased the presence of the remote participant and discouraged the local participant from speaking in the context of the experimental task. We believe that presence has a sufficiently large influence on whether participants want to express an opinion. It is worth investigating the influence of presence and its control methods using Bayesian models.

cs.HC

Free energy model of emotional valence in dual-process perceptions

An appropriate level of arousal induces positive emotions, and a high arousal potential may provoke negative emotions. To explain the effect of arousal on emotional valence, we propose a novel mathematical framework of arousal potential variations in the dual process of human cognition: automatic and controlled. A suitable mathematical formulation to explain the emotions in the dual process is still absent. Our model associates free energy with arousal potential and its variations to explain emotional valence. Decreasing and increasing free energy consequently induce positive and negative emotions, respectively. We formalize a transition from the automatic to the controlled process in the dual process as a change of Bayesian prior. Further, we model emotional valence using free energy increase (FI) when one tries changing one's Bayesian prior and its reduction (FR) when one succeeds in recognizing the same stimuli with a changed prior and define three emotions: "interest," "confusion," and "boredom" using the variations. The results of our mathematical analysis comparing various Gaussian model parameters reveals the following: 1) prediction error (PR) increases FR (representing "interest") when the first prior variance is greater than the second prior variance, 2) PR decreases FR when the first prior variance is less than the second prior variance, and 3) the distance between priors' means always increases FR. We also discuss the association of the outcomes with emotions in the controlled process. The proposed mathematical model provides a general framework for predicting and controlling emotional valence in the dual process that varies with viewpoint and stimuli, as well as for understanding the contradictions in the effects of arousal on the valence.

q-bio.NC

Intrinsic motivation in virtual assistant interaction for fostering spontaneous interactions

With the growing utility of today's conversational virtual assistants, the importance of user motivation in human-AI interaction is becoming more obvious. However, previous studies in this and related fields, such as human-computer interaction and human-robot interaction, scarcely discussed intrinsic motivation and its affecting factors. Those studies either treated motivation as an inseparable concept or focused on non-intrinsic motivation. The current study aims to cover intrinsic motivation by taking an affective-engineering approach. A novel motivation model is proposed, in which intrinsic motivation is affected by two factors that derive from user interactions with virtual assistants: expectation of capability and uncertainty. Experiments are conducted where these two factors are manipulated by making participants believe they are interacting with the smart speaker "Amazon Echo". Intrinsic motivation is measured both by using questionnaires and by covertly monitoring a five-minute free-choice period in the experimenter's absence, during which the participants could decide for themselves whether to interact with the virtual assistants. Results of the first experiment showed that high expectation engenders more intrinsically motivated interaction compared with low expectation. The results also suggested suppressive effects by uncertainty on intrinsic motivation, though we had not hypothesized before experiments. We then revised our hypothetical model of action selection accordingly and conducted a verification experiment of uncertainty's effects. Results of the verification experiment showed that reducing uncertainty encourages more interactions and causes the motivation behind these interactions to shift from non-intrinsic to intrinsic.

cs.HC

Information-Theoretic Free Energy as Emotion Potential: Emotional Valence as a Function of Complexity and Novelty

This study extends the mathematical model of emotion dimensions that we previously proposed (Yanagisawa, et al. 2019, Front Comput Neurosci) to consider perceived complexity as well as novelty, as a source of arousal potential. Berlyne's hedonic function of arousal potential (or the inverse U-shaped curve, the so-called Wundt curve) is assumed. We modeled the arousal potential as information contents to be processed in the brain after sensory stimuli are perceived (or recognized), which we termed sensory surprisal. We mathematically demonstrated that sensory surprisal represents free energy, and it is equivalent to a summation of information gain (or information from novelty) and perceived complexity (or information from complexity), which are the collative variables forming the arousal potential. We demonstrated empirical evidence with visual stimuli (profile shapes of butterfly) supporting the hypothesis that the summation of perceived novelty and complexity shapes the inverse U-shaped beauty function. We discussed the potential of free energy as a mathematical principle explaining emotion initiators.

q-bio.NC

Mathematical Model of Emotional Habituation to Novelty: Modeling with Bayesian Update and Information Theory

Novelty is an important factor of creativity in product design. Acceptance of novelty, however, depends on one's emotions. Yanagisawa, the last author, and his colleagues previously developed a mathematical model of emotional dimensions associated with novelty such as arousal (surprise) and valence. The model formalized arousal as Bayesian information gain and valence as a function of arousal based on Berlyne's arousal potential theory. One becomes accustomed to novelty by repeated exposure. This so-called habituation to novelty is important in the design of long-term product experience. We herein propose a mathematical model of habituation to novelty based on the emotional dimension model. We formalized the habituation as a decrement in information gain from a novel event through Bayesian update. We derived the information gained from the repeated exposure of a novel stimulus as a function of three parameters: initial prediction error, initial uncertainty, and noise of sensory stimulus. With the proposed model, we discovered an interaction effect of the initial prediction error and initial uncertainty on habituation. Furthermore, we demonstrate that a range of positive emotions on prediction errors shift toward becoming more novel by repeated exposure.

cs.IT

Effect of assistive method on the sense of fulfillment with agency: Modeling with flow and attribution theory

Several assistive technologies for users' operations have been recently developed. A user's sense of agency (SoA) decreases with increasing system assistance, possibly resulting in a decrease in the user's sense of fulfillment. This study aims to provide a design guideline for an assistive method to maintain and improve the sense of fulfillment with SoA. We propose a mathematical model describing the mechanisms by which the assistive method affects SoA and SoA induces a sense of fulfillment. The experience in the flow state is assumed to be a sense of fulfillment. The assistance effect on the skill-challenge plane in flow theory is defined as an increase in skill and decrease in challenge. The factor that separates the two effects from attribution theory is the locus of causality, which is matched to the judgement of agency (JoA) from the two-step account of agency. We hypothesized that the assistance increases the perception of skill and sense of fulfillment is greater when the locus of causality is internal, rather than external. To verify this hypothesis, a game task experiment was conducted with assistance that varied with the ease of recognition. We hypothesized that a player's JoA is internal for hard-to-recognize assistance, resulting in a high sense of fulfillment. Experimental results supported this hypothesis.

cs.HC

A methodology for multisensory product experience design using cross-modal effect: A case of SLR camera

Throughout the course of product experience, a user employs multiple senses, including vision, hearing, and touch. Previous cross-modal studies have shown that multiple senses interact with each other and change perceptions. In this paper, we propose a methodology for designing multisensory product experiences by applying cross-modal effect to simultaneous stimuli. In this methodology, we first obtain a model of the comprehensive cognitive structure of user's multisensory experience by applying Kansei modeling methodology and extract opportunities of cross-modal effect from the structure. Second, we conduct experiments on these cross-modal effects and formulate them by obtaining a regression curve through analysis. Finally, we find solutions to improve the product sensory experience from the regression model of the target cross-modal effects. We demonstrated the validity of the methodology with SLR cameras as a case study, which is a typical product with multisensory perceptions.

cs.HC

Quantitative evaluation of sense of discrepancy to operation response using event-related potential

This study aimed to develop a method to evaluate the sense of discrepancy to the operation response quantitatively. We examined the availability of event-related potential (P300), which is considered to reflect attention to stimulation, to evaluate the sense of discrepancy to the product response to the user's action. In the experiment using subjective evaluation and P300 to investigate the sense of discrepancy due to the lack of operation response (sound and vibration) to the shutter operation of the mirrorless single-lens camera, it was confirmed that P300 amplitude corresponds to the degree of the subjective sense of discrepancy. Our results showed that the P300 amplitude could evaluate the sense of discrepancy to the operation response.

q-bio.NC