SearcharxivSearch

arXiv subjects

Marc Böhlen

Publications and source records attributed to Marc Böhlen.

9 recordsLinked to original sources

Synthetic Reflections on Resource Extraction

This paper describes how AI models can be augmented and adapted to interpret landscapes. We present the technical framework of a Sentinel-2 satellite asset interpretation pipeline that combines statistical operations, human judgment, and generative AI models to produce succinct commentaries on industrial mining sites across the planet. To this end we introduce a novel bespoke landscape descriptor, the Urban Dwelling and Mining Index, and discuss how this metric can improve the performance of a multimodal language model in assessing the spatial distribution of mining operations.

cs.CY

Scrapyard AI

This paper considers AI model churn as an opportunity for frugal investigation of large AI models. It describes how the incessant push for ever more powerful AI systems leaves in its wake a collection of obsolete yet powerful AI models, discarded in a veritable scrapyard of AI production. This scrapyard offers a potent opportunity for resource-constrained experimentation into AI systems. As in the physical scrapyard, nothing ever truly disappears in the AI scrapyard, it is just waiting to be reconfigured into something else. Project Nudge-x is an example of what can emerge from the AI scrapyard. Nudge-x seeks to manipulate legacy AI models to describe how mining sites across the planet are impacting landscapes and lives. By sharing this collection of brutal landscape interventions with people and AI systems alike, Nudge-x creates a venue for the appreciation of a history sadly shared between AI and people.

cs.CY

GeoAI in resource-constrained environments

This paper describes spatially aware Artificial Intelligence, GeoAI, tailored for small organizations such as NGOs in resource constrained contexts where access to large datasets, expensive compute infrastructure and AI expertise may be restricted. We furthermore consider future scenarios in which resource-intensive, large geospatial models may homogenize the representation of complex landscapes, and suggest strategies to prepare for this condition.

cs.CY

A.I. In All The Wrong Places

This text describes experiences gained across a two-year test period during which two generations of Generative Artificial Intelligence (A.I.) systems were incorporated into an interdisciplinary, university level course on A.I. for art and design practices. The text uses the results from the courses to reflect on new opportunities for generative systems in art and design, while considering traps and limits.

cs.CY

From images in the wild to video-informed image classification

Image classifiers work effectively when applied on structured images, yet they often fail when applied on images with very high visual complexity. This paper describes experiments applying state-of-the-art object classifiers toward a unique set of images in the wild with high visual complexity collected on the island of Bali. The text describes differences between actual images in the wild and images from Imagenet, and then discusses a novel approach combining informational cues particular to video with an ensemble of imperfect classifiers in order to improve classification results on video sourced images of plants in the wild.

cs.CV

Classification, Slippage, Failure and Discovery

This text argues for the potential of machine learning infused classification systems as vectors for a technically-engaged and constructive technology critique. The text describes this potential with several experiments in image data creation and neural network based classification. The text considers varying aspects of slippage in classification and considers the potential for discovery - as opposed to disaster - stemming from machine learning systems when they fail to perform as anticipated.

cs.CY

Return to Bali

This paper gives an overview of the project Return to Bali that seeks to create a living dataset of ethnobotanically significant flora on the island of Bali and new methods through which underrepresented forms of knowledge can be documented, shared and made compatible within the logics of machine learning while considering practical approaches to benefit multiple stakeholders and preventing unintended harm.

cs.CY

Machine Learning in Ethnobotany -- a first experiment

We describe new opportunities afforded by bring A.I to the field of ethnobotany. In particular we describe a novel approach to ethnobotany documentation that harnesses machine learning opportunities, specifically for the documentation of traditional ecological knowledge with mobile phones in emerging economies. Using a case study on the island of Bali as a departure point, the project maps out machine learning approaches to documentation and responds to technology and capital gradients between research contexts in the global north and south in an attempt to capture knowledge that might otherwise not be represented.

cs.CY

Server, server in the cloud. Who is the fairest in the crowd?

This paper follows the recent history of automated beauty competitions to discuss how machine learning techniques, in particular neural networks, alter the way attractiveness is handled and how this impacts the cultural landscape. We describe experiments performed to probe the behavior of two different convolutional neural network architectures in the classification of facial attractiveness in a large database of celebrity faces. As opposed to other easily definable facial features, attractiveness is difficult to detect robustly even for the best classification systems. Based on the observations from these experiments, we discuss several approaches to detect factors that come into play when a machine evaluates human features, and how bias can occur not only in data selection but in network architectures; in multiple forms on multiple levels throughout the process. The overall goal is to map out with mixed methods a novel condition: slippages produced by platform level machine learning systems that make judgements in domains considered dependent on high level human intelligence.

cs.CY