SearcharxivSearch

arXiv subjects

Andreas Küpfer

Publications and source records attributed to Andreas Küpfer.

2 recordsLinked to original sources

Structuring Quantitative Image Analysis with Object Prominence

When photographers or media professionals compose an image, they make deliberate choices about what to foreground and what to background, shaping how viewers interpret visual content. Yet most quantitative approaches to image analysis overlook this structure and treat detected objects as equally important. We introduce a framework for measuring object prominence-- the relative salience of objects in an image-- as a means to make computational image analysis attentive to the compositional emphasis a curator has built into an image. Drawing on research in cognitive psychology and computer vision, we outline three approaches for estimating object prominence: size and centeredness, inferred depth, and saliency maps. Validating that curator-composed prominence measurably shifts human visual attention in a pre-registered eye-tracking study, we illustrate this framework's benefits in two further applications. First, we demonstrate how weighting features in line with their prominence can enhance the unsupervised ideological scaling of U.S. newspaper images. Second, we examine gendered visual prominence in U.S. presidential campaign ads from 2016 and 2020, showing that Republican candidates depict women less prominently than their Democratic counterparts. Our framework lets researchers analyze image data at scale while remaining attentive to its communicative structure and intent.

cs.CV

Alignment Helps Make the Most of Multimodal Data

Political scientists increasingly analyze multimodal data. However, the effective analysis of such data requires aligning information across different modalities. In our paper, we demonstrate the significance of such alignment. Informed by a systematic review of 2,703 papers, we find that political scientists typically do not align their multimodal data. Introducing a decision tree that guides alignment choices, our framework highlights alignment's untapped potential and provides concrete advice in research design and modeling decisions. We illustrate alignment's analytical value through two applications: predicting tonality in U.S. presidential campaign ads and cross-modal querying of German parliamentary speeches to examine responses to the far-right AfD.

cs.CL