SearcharxivSearch

arXiv subjects

Medha Sharma

Publications and source records attributed to Medha Sharma.

4 recordsLinked to original sources

Evaluating Large Language Models' Responses to Sexual and Reproductive Health Queries in Nepali

As Large Language Models (LLMs) become integrated into daily life, they are increasingly used for personal queries, including Sexual and Reproductive Health (SRH), allowing users to chat anonymously without fear of judgment. However, current evaluation methods primarily focus on accuracy, often for objective queries in high-resource languages, and lack criteria to assess usability and safety, especially for low-resource languages and culturally sensitive domains like SRH. This paper introduces LLM Evaluation Framework (LEAF), that conducts assessments across multiple criteria: accuracy, language, usability gaps (including relevance, adequacy, and cultural appropriateness), and safety gaps (safety, sensitivity, and confidentiality). Using the LEAF framework, we assessed 14K SRH queries in Nepali from over 9K users. Responses were manually annotated by SRH experts according to the framework. Results revealed that only 35.1% of the responses were "proper", meaning they were accurate, adequate and had no major usability or safety related gaps. Insights include differences in performance between ChatGPT versions, such as similar accuracy but varying usability and safety aspects. This evaluation highlights significant limitations of current LLMs and underscores the need for improvement. The LEAF Framework is adaptable across domains and languages, particularly where usability and safety are critical, offering a pathway to better address sensitive topics.

cs.CL

Identification of Patterns of Cognitive Impairment for Early Detection of Dementia

Early detection of dementia is crucial to devise effective interventions. Comprehensive cognitive tests, while being the most accurate means of diagnosis, are long and tedious, thus limiting their applicability to a large population, especially when periodic assessments are needed. The problem is compounded by the fact that people have differing patterns of cognitive impairment as they progress to different forms of dementia. This paper presents a novel scheme by which individual-specific patterns of impairment can be identified and used to devise personalized tests for periodic follow-up. Patterns of cognitive impairment are initially learned from a population cluster of combined normals and MCIs, using a set of standardized cognitive tests. Impairment patterns in the population are identified using a 2-step procedure involving an ensemble wrapper feature selection followed by cluster identification and analysis. These patterns have been shown to correspond to clinically accepted variants of MCI, a prodrome of dementia. The learned clusters of patterns can subsequently be used to identify the most likely route of cognitive impairment, even for pre-symptomatic and apparently normal people. Baseline data of 24,000 subjects from the NACC database was used for the study.

cs.CV

Organization of the Hilbert Space for Exact Diagonalization of Hubbard Model

We present an alternative scheme to the widely used method of representing the basis of one-band Hubbard model through the relation $I=I_{\uparrow}+2^{M}I_{\downarrow}$ given by H. Q. Lin and J. E. Gubernatis [Comput. Phys. 7, 400 (1993)], where $I_{\uparrow}$, $I_{\downarrow}$ and $I$ are the integer equivalents of binary representations of occupation patterns of spin up, spin down and both spin up and spin down electrons respectively, with $M$ being the number of sites. We compute and store only $I_{\uparrow}$ or $I_{\downarrow}$ at a time to generate the full Hamiltonian matrix. The non-diagonal part of the Hamiltonian matrix given as ${\cal{I}}_{\downarrow}\otimes{\bf{H}_{\uparrow}} \oplus {\bf{H}_{\downarrow}}\otimes{\cal{I}}_{\uparrow}$ is generated using a bottom-up approach by computing the small matrices ${\bf{H}_{\uparrow}}$(spin up hopping Hamiltonian) and ${\bf{H}_{\downarrow}}$(spin down hopping Hamiltonian) and then forming the tensor product with respective identity matrices ${\cal{I}}_{\downarrow}$ and ${\cal{I}}_{\uparrow}$, thereby saving significant computation time and memory. We find that the total CPU time to generate the non-diagonal part of the Hamiltonian matrix using the new one spin configuration basis scheme is reduced by about an order of magnitude as compared to the two spin configuration basis scheme. The present scheme is shown to be inherently parallelizable. Its application to translationally invariant systems, computation of Green's functions and in impurity solver part of DMFT procedure is discussed and its extention to other models is also pointed out.

cond-mat.str-el

A Davidson-Lanczos iteration method for computation of continued-fraction expansion of the Green's function at very low temperatures: Applications to the dynamical mean field theory

We present a combination method based on orignal version of Davidson algorithm for extracting few of the lowest eigenvalues and eigenvectors of a sparse symmetric Hamiltonian matrix and the simplest version of Lanczos technique for obtaining a tridiagonal representation of the Hamiltonian to compute the continued fraction expansion of the Green's function at a very low temperature. We compare the Davidson$+$Lanczos method with the full diagonalization on a one-band Hubbard model on a Bethe lattice of infinite-coordination using dynamical mean field theory.

cond-mat.str-el