SearcharxivSearch

arXiv subjects

Takuya Furusawa

Publications and source records attributed to Takuya Furusawa.

10 recordsLinked to original sources

MultiEmo-Bench: Multi-label Visual Emotion Analysis for Multi-modal Large Language Models

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an unintuitive finding: humans may prefer the predictions of MLLMs over the labels in existing datasets. We argue that this phenomenon stems from the suboptimal annotation scheme used in existing datasets, where each annotator is shown a single candidate emotion for each image and judges whether it is evoked or not. This approach is clearly limited because a single image can evoke multiple emotions with varying intensities. As a result, evaluations based on these datasets may underestimate the capabilities of MLLMs, yet an appropriate benchmark for evaluating such models remains lacking. To address this issue, we introduce a new multi-label benchmark dataset for visual emotion analysis toward MLLMs evaluation. We hire $20$ annotators per image and ask them to select all emotions they feel from an image. Then, we aggregate the votes across all annotators, providing a more reliable and representative dataset labeled with a distribution of emotions. The resulting dataset contains $10,344$ images with $236,998$ valid votes across eight emotions. Based on this benchmark dataset, we evaluate several recent models, including Qwen3-VL, OpenAI's GPT, Gemini, and Claude. We assess model performance on both dominant emotion prediction and emotion distribution prediction. Our results demonstrate the progress achieved by recent MLLMs while also indicating that substantial room for improvement remains. Furthermore, our experiments with LLM-as-a-judge show that the method does not consistently improve MLLMs' performance, indicating its limitations for the subjective task of visual emotion analysis.

cs.CV

Reference-Free Image Quality Assessment for Virtual Try-On via Human Feedback

As virtual try-on (VTON) systems become increasingly important in fashion e-commerce, there is a growing need for reliable reference-free evaluation methods, since ground-truth images of the same person wearing the target garment are typically unavailable in real-world scenarios. To address this challenge, we propose VTON-IQA, a reference-free framework for human-aligned image quality assessment without requiring ground-truth images. To model human perceptual judgments, we construct VTON-QBench, a large-scale human-annotated benchmark comprising 62,688 try-on images generated by 14 representative VTON models and 431,800 quality annotations collected from 13,838 qualified annotators. To the best of our knowledge, this is the largest dataset to date for human subjective evaluation in VTON. Extensive experiments show that VTON-IQA achieves reliable human-aligned image quality assessment. Moreover, we conduct a comprehensive benchmark evaluation of 14 representative VTON models using VTON-IQA.

cs.CV

Fashionability-Enhancing Outfit Image Editing with Conditional Diffusion Models

Image generation in the fashion domain has predominantly focused on preserving body characteristics or following input prompts, but little attention has been paid to improving the inherent fashionability of the output images. This paper presents a novel diffusion model-based approach that generates fashion images with improved fashionability while maintaining control over key attributes. Key components of our method include: 1) fashionability enhancement, which ensures that the generated images are more fashionable than the input; 2) preservation of body characteristics, encouraging the generated images to maintain the original shape and proportions of the input; and 3) automatic fashion optimization, which does not rely on manual input or external prompts. We also employ two methods to collect training data for guidance while generating and evaluating the images. In particular, we rate outfit images using fashionability scores annotated by multiple fashion experts through OpenSkill-based and five critical aspect-based pairwise comparisons. These methods provide complementary perspectives for assessing and improving the fashionability of the generated images. The experimental results show that our approach outperforms the baseline Fashion++ in generating images with superior fashionability, demonstrating its effectiveness in producing more stylish and appealing fashion images.

cs.CV

An Empirical Analysis of GPT-4V's Performance on Fashion Aesthetic Evaluation

Fashion aesthetic evaluation is the task of estimating how well the outfits worn by individuals in images suit them. In this work, we examine the zero-shot performance of GPT-4V on this task for the first time. We show that its predictions align fairly well with human judgments on our datasets, and also find that it struggles with ranking outfits in similar colors. The code is available at https://github.com/st-tech/gpt4v-fashion-aesthetic-evaluation.

cs.CV

Mean Field Theory in Deep Metric Learning

In this paper, we explore the application of mean field theory, a technique from statistical physics, to deep metric learning and address the high training complexity commonly associated with conventional metric learning loss functions. By adapting mean field theory for deep metric learning, we develop an approach to design classification-based loss functions from pair-based ones, which can be considered complementary to the proxy-based approach. Applying the mean field theory to two pair-based loss functions, we derive two new loss functions, MeanFieldContrastive and MeanFieldClassWiseMultiSimilarity losses, with reduced training complexity. We extensively evaluate these derived loss functions on three image-retrieval datasets and demonstrate that our loss functions outperform baseline methods in two out of the three datasets.

cs.LG

Anomaly-induced edge currents in hydrodynamics with parity anomaly

In this paper, we discuss relativistic hydrodynamics for a massless Dirac fermion in $(2+1)$ dimensions, which has the parity anomaly -- a global 't Hooft anomaly between $\mathrm{U}(1)$ and parity symmetries. We investigate how hydrodynamics implements the party anomaly, particularly focusing on the transport phenomena at the boundary. Based on the parity anomaly matching and the second law of local thermodynamics, we find $\mathrm{U}(1)$ and entropy currents localized at the boundary as well as the bulk anomalous current with vanishing divergence. These edge currents are similar to the $(1+1)$-dimensional chiral transports, but the coefficients are given by half of theirs. We also generalize our discussion to more general anomalies among multiple $\mathrm{U}(1)$ symmetries and single $\mathbb{Z}_2$ symmetry.

hep-th

Hall viscosity in the A-phase of superfluid $^3$He

We construct the effective field theory for the A-phase of superfluid $^3$He up to the next-to-leading order in the derivative expansion. To this end, we gauge the internal global symmetries of the theory on the curved space by introducing the background gauge fields and spatial metric so as to expose a hidden local symmetry known as the nonrelativistic diffeomorphism. The nonrelativistic diffeomorphism is particularly useful to yield an additional constraint on the effective field theory and reveal a universal expression for the Hall viscosity in the A-phase. We find it five orders of magnitude larger than that in the B-phase under a magnetic field so that its experimental observation is more feasible by measuring the induced elliptic polarization of sound waves.

cond-mat.supr-con

Finite-Density Massless Two-Color QCD at Isospin Roberge-Weiss Point and 't Hooft Anomaly

We study the phase diagram of two-flavor massless two-color QCD (QC$_2$D) under the presence of quark chemical potentials and imaginary isospin chemical potentials. At the special point of the imaginary isospin chemical potential, called the isospin Roberge--Weiss (RW) point, two-flavor QC$_2$D enjoys the $\mathbb{Z}_2$ center symmetry that acts on both quark flavors and the Polyakov loop. We find a $\mathbb{Z}_2$ 't Hooft anomaly of this system, which involves the $\mathbb{Z}_2$ center symmetry, the baryon-number symmetry, and the isospin chiral symmetry. Anomaly matching, therefore, constrains the possible phase diagram at any temperatures and quark chemical potentials at the isospin RW point, and we compare it with previous results obtained by chiral effective field theory and lattice simulations. We also point out an interesting similarity of two-flavor massless QC$_2$D with $(2+1)$d quantum anti-ferromagnetic systems.

hep-th

Global anomaly matching in higher-dimensional $\mathbb{CP}^{N-1}$ model

We investigate 't Hooft anomalies in the $\mathbb{CP}^{N-1}$ model in spacetime dimensions higher than two and identify two types of anomalies: One is a mixed anomaly between the $\mathrm{PSU}(N)$ flavor-rotation and magnetic symmetries, and the other is between the reflection and magnetic symmetries. The latter indicates that even in the absence of the flavor symmetry, the model cannot have a unique gapped ground state as long as the reflection and magnetic symmetries are respected. We also clarified the condition for the 't Hooft anomalies to survive under monopole deformations, which explicitly break the magnetic symmetry down to its discrete subgroup. Besides, we explicitly show how the identified 't Hooft anomalies match in the low-energy effective description of symmetry broken phases---the N\'eel, $\mathrm{U}(1)$ spin liquid, and the valence bond solid phases. An application to the finite-temperature phase diagram of the four-dimensional $\mathbb{CP}^{N-1}$ model is also discussed.

cond-mat.str-el

Boson-fermion duality in four dimensions

Dualities provide deep insight into physics by relating two seemingly distinct theories. Here we propose and elaborate on a novel duality between bosonic and fermionic theories in four spacetime dimensions. Starting with a Euclidean lattice action consisting of bosonic and fermionic degrees of freedom and integrating out one of them alternatively, we derive a UV duality between a Wilson fermion with self-interactions and an XY model coupled to a compact U(1) gauge field. We find a continuous phase transition between topological and trivial insulators on the fermion side corresponding to Higgs and confinement phases on the boson side. The continuum limit of each lattice theory then leads to an IR duality between a free Dirac fermion and a scalar QED with the vacuum angle $\pi$. The resulting bosonic theory proves to incorporate a scalar boson and dyons as low-energy degrees of freedom and it is their three-body composite that realizes the Dirac fermion of the fermionic theory.

hep-th