SearcharxivSearch

arXiv subjects

Florence E. Enock

Publications and source records attributed to Florence E. Enock.

6 recordsLinked to original sources

Ingroup bias is prevalent in user reports of hate and abuse online

The prevalence of online hate and abuse is a pressing global problem. While tackling such societal harms is a priority for research across the social sciences, it is a difficult task, in part because of the magnitude of the problem. People's engagement with reporting mechanisms ('flagging') online is an increasingly important part of monitoring and addressing harmful content at scale. However, users may not flag content routinely enough, and when users do engage, they may be biased by group identity and political beliefs. Across five well-powered and pre-registered online experiments, we examine the extent of ingroup bias in people's flagging of hate and abuse in four different intergroup contexts: political affiliation, vaccination opinions, beliefs about climate change, and stance on abortion rights. Overall, participants reported abuse reliably, with approximately half of the abusive comments in each study reported. However, a pervasive ingroup bias was present whereby across studies, participants were between 17% and 63% more likely to flag abuse directed at the ingroup than at the outgroup. Our findings offer new insights into the nature of user flagging online, an understanding of which is crucial for enhancing user intervention against online hate and thus ensuring a safer online environment.

cs.CY

Gendered Inequalities in Online Harms: Fear, Safety Work, and Online Participation

Online harms, such as hate speech, trolling and self-harm promotion, continue to be widespread. There are growing concerns that these harms may disproportionately affect women, reflecting and reproducing existing structural inequalities within digital spaces. Using a nationally representative survey of UK adults (N=1992), we examine how gender shapes exposure to a variety of online harms, fears surrounding being targeted, the psychological impact of online experiences, the use of safety tools, and comfort with various forms of online participation. We find that while men and women report roughly similar levels of absolute exposure to harmful content online, women are more often targeted by contact-based harms including image-based abuse, cyberstalking and cyberflashing. Women report heightened fears about being targeted by online harms, more negative psychological impact in response to online experiences, and increased use of safety tools, reflecting more engagement with personal safety work. Importantly, women also say they are significantly less comfortable with several forms of online participation, for example just 23% of women are comfortable expressing political views online compared to 40% of men. Explanatory models show direct associations between fears surrounding harms and comfort with particular online behaviours. Our findings show how online harms reinforce gender inequality by placing disproportionate psychological burden and participation constraints on women. These results are important because with much public discourse happening online, we must ensure all members of society feel safe and able to participate in online spaces.

cs.CY

Large language models can consistently generate high-quality content for election disinformation operations

Advances in large language models have raised concerns about their potential use in generating compelling election disinformation at scale. This study presents a two-part investigation into the capabilities of LLMs to automate stages of an election disinformation operation. First, we introduce DisElect, a novel evaluation dataset designed to measure LLM compliance with instructions to generate content for an election disinformation operation in localised UK context, containing 2,200 malicious prompts and 50 benign prompts. Using DisElect, we test 13 LLMs and find that most models broadly comply with these requests; we also find that the few models which refuse malicious prompts also refuse benign election-related prompts, and are more likely to refuse to generate content from a right-wing perspective. Secondly, we conduct a series of experiments (N=2,340) to assess the "humanness" of LLMs: the extent to which disinformation operation content generated by an LLM is able to pass as human-written. Our experiments suggest that almost all LLMs tested released since 2022 produce election disinformation operation content indiscernible by human evaluators over 50% of the time. Notably, we observe that multiple models achieve above-human levels of humanness. Taken together, these findings suggest that current LLMs can be used to generate high-quality content for election disinformation operations, even in hyperlocalised scenarios, at far lower costs than traditional methods, and offer researchers and policymakers an empirical benchmark for the measurement and evaluation of these capabilities in current and future models.

cs.CY

Understanding gender differences in experiences and concerns surrounding online harms: A short report on a nationally representative survey of UK adults

Online harms, such as hate speech, misinformation, harassment and self-harm promotion, continue to be widespread. While some work suggests that women are disproportionately affected by such harms, other studies find little evidence for gender differences in overall exposure. Here, we present preliminary results from a large, nationally representative survey of UK adults (N = 2000). We asked about exposure to 15 specific harms, along with fears surrounding exposure and comfort engaging in certain online behaviours. While men and women report seeing online harms to a roughly equal extent overall, we find that women are significantly more fearful of experiencing every type of harm that we asked about, and are significantly less comfortable partaking in several online behaviours. Strikingly, just 24% of women report being comfortable expressing political opinions online compared with almost 40% of men, with similar overall proportions for challenging certain content. Our work suggests that women may suffer an additional psychological burden in response to the proliferation of harmful online content, doing more 'safety work' to protect themselves. With much public discourse happening online, gender inequality in public voice is likely to be perpetuated if women feel too fearful to participate. Our results are important because to establish greater equality in society, we must take measures to ensure all members feel safe and able to participate in the online space.

cs.CY

Understanding engagement with platform safety technology for reducing exposure to online harms

User facing 'platform safety technology' encompasses an array of tools offered by platforms to help people protect themselves from harm, for example allowing people to report content and unfollow or block other users. These tools are an increasingly important part of online safety: in the UK, legislation has made it a requirement for large platforms to offer them. However, little is known about user engagement with such tools. We present findings from a nationally representative survey of UK adults covering their awareness of and experiences with seven common safety technologies. We show that experience of online harms is widespread, with 67% of people having seen what they perceived as harmful content online; 26% of people have also had at least one piece of content removed by content moderation. Use of safety technologies is also high, with more than 80\% of people having used at least one. Awareness of specific tools is varied, with people more likely to be aware of 'post-hoc' safety tools, such as reporting, than preventative measures. However, satisfaction with safety technologies is generally low. People who have previously seen online harms are more likely to use safety tools, implying a 'learning the hard way' route to engagement. Those higher in digital literacy are also more likely to use some of these tools, raising concerns about the accessibility of these technologies to all users. Additionally, women are more likely to engage in particular types of online 'safety work'. We discuss the implications of our results for those seeking a safer online environment.

cs.CY

Generative AI is already widespread in the public sector

Generative AI has the potential to transform how public services are delivered by enhancing productivity and reducing time spent on bureaucracy. Furthermore, unlike other types of artificial intelligence, it is a technology that has quickly become widely available for bottom-up adoption: essentially anyone can decide to make use of it in their day to day work. But to what extent is generative AI already in use in the public sector? Our survey of 938 public service professionals within the UK (covering education, health, social work and emergency services) seeks to answer this question. We find that use of generative AI systems is already widespread: 45% of respondents were aware of generative AI usage within their area of work, while 22% actively use a generative AI system. Public sector professionals were positive about both current use of the technology and its potential to enhance their efficiency and reduce bureaucratic workload in the future. For example, those working in the NHS thought that time spent on bureaucracy could drop from 50% to 30% if generative AI was properly exploited, an equivalent of one day per week (an enormous potential impact). Our survey also found a high amount of trust (61%) around generative AI outputs, and a low fear of replacement (16%). While respondents were optimistic overall, areas of concern included feeling like the UK is missing out on opportunities to use AI to improve public services (76%), and only a minority of respondents (32%) felt like there was clear guidance on generative AI usage in their workplaces. In other words, it is clear that generative AI is already transforming the public sector, but uptake is happening in a disorganised fashion without clear guidelines. The UK's public sector urgently needs to develop more systematic methods for taking advantage of the technology.

cs.CY