arXiv subjects

Annie Collins

Publications and source records attributed to Annie Collins.

3 recordsLinked to original sources

arXiv2021

Reproducibility of COVID-19 pre-prints

To examine the reproducibility of COVID-19 research, we create a dataset of pre-prints posted to arXiv, bioRxiv, and medRxiv between 28 January 2020 and 30 June 2021 that are related to COVID-19. We extract the text from these pre-prints and parse them looking for keyword markers signaling the availability of the data and code underpinning the pre-print. For the pre-prints that are in our sample, we are unable to find markers of either open data or open code for 75 per cent of those on arXiv, 67 per cent of those on bioRxiv, and 79 per cent of those on medRxiv.

stat.AP↗

arXiv2021

An Introduction to DoSStoolkit

We describe a series of interactive, student-developed, self-paced, modules for learning R. We detail the components of this resource, and the pedagogical underpinning. We discuss the development of this resource, and avenues for future work. Our resource is available as an R package: DoSStoolkit.

stat.OT↗

arXiv2021

Detecting Hate Speech with GPT-3

Sophisticated language models such as OpenAI's GPT-3 can generate hateful text that targets marginalized groups. Given this capacity, we are interested in whether large language models can be used to identify hate speech and classify text as sexist or racist. We use GPT-3 to identify sexist and racist text passages with zero-, one-, and few-shot learning. We find that with zero- and one-shot learning, GPT-3 can identify sexist or racist text with an average accuracy between 55 per cent and 67 per cent, depending on the category of text and type of learning. With few-shot learning, the model's accuracy can be as high as 85 per cent. Large language models have a role to play in hate speech detection, and with further development they could eventually be used to counter hate speech.

cs.CL↗