Searcharxiv⌕ Search

arXiv subjects

Ali Hassan Khan

Publications and source records attributed to Ali Hassan Khan.

2 recordsLinked to original sources

Do Language Models Feel the Sentiment? Investigating Emotion Vectors

Emotion vectors are directions in a language model's internal representations that are associated with emotional concepts. Prior work shows that these vectors can influence model behavior, but their role in sentiment classification remains unclear. This study investigates emotion directions in Qwen2.5-0.5B-Instruct and Qwen2.5-3B-Instruct. Eight directions extracted from GoEmotions are evaluated through sentiment probing, activation interventions, and supervised correction. Emotion-only probes achieve 88.66% and 90.70% accuracy on binary TweetEval. In exploratory matched-ablation experiments, raw emotion-space removal causes 2.39 and 1.10 percentage points more accuracy loss than matched isotropic random-subspace removal for 0.5B and 3B, respectively. All four TweetEval raw and denoised effects are significant after Holm adjustment across eight comparisons. An exploratory SST-2 extension shows smaller raw excess losses of 0.66 and 0.57 points, with no effects surviving Holm adjustment. Frozen sentiment-correction classifiers are also tested on 20,000 Amazon Polarity reviews. Emotion-based correction improves accuracy over uncorrected Qwen, but does not consistently outperform margin-only baselines. These results distinguish sentiment information available in model representations, the effects of changing those representations, and their practical value for classification. They do not establish a uniquely emotional mechanism.

cs.CL↗

A Hybrid Hierarchical 1D-CNN-BiLSTM Framework for Extractive Summarization of Biomedical and Clinical Text

Large language models have made abstractive summarization remarkably fluent, but fluency has come at a cost. Models trained to generate freely over long documents may hallucinate, producing summaries that read well but drift from what the source actually says. This risk is especially serious in biomedical and clinical text, where fabricated details can have serious consequences. We address this by removing free-form generation from the pipeline rather than trying to constrain it. Our Hybrid Hierarchical CNN-LSTM Summarizer reframes summarization as extractive sentence selection: a stacked, multi-kernel convolutional network progressively refines contextual representations, while a bidirectional LSTM models long-range dependencies across the document. A lightweight scoring head predicts sentence importance using binary cross-entropy supervision. For PubMed, a document-adaptive mean-plus-standard-deviation threshold with a Top-3 fallback determines extraction; clinical evaluations instead use a fixed top-30\% sentence-selection policy. Because output sentences are copied verbatim, the framework prevents source-external generation, although omissions and contextual inaccuracies remain possible. Evaluated on PubMed and transferred without clinical fine-tuning to MIMIC-CXR and MIMIC-IV BHC, the model demonstrates competitive extractive summarization performance, with threshold and component ablations supporting adaptive extraction and the combined CNN--BiLSTM architecture. Clinical factuality analysis further highlights limitations in preserving important findings and negations. These results suggest that structural constraints offer a promising direction for source-grounded biomedical summarization, while emphasizing the importance of clinical completeness and contextual fidelity.

cs.CL↗