Searcharxiv⌕ Search

arXiv subjects

Sayed Ayaan Ahmed Sha

Publications and source records attributed to Sayed Ayaan Ahmed Sha.

2 recordsLinked to original sources

A Study of Prior Case Retrieval Using Lexical, Semantic, and Rhetorical Role Information in Indian Legal Documents

For retrieving prior cases in Indian legal judgments, the problem involves distinguishing relevant legal facts from mere lexical similarities because a prior case that shares a statute with the query judgment is not necessarily relevant. In this paper, we describe an empirical evaluation of three consecutive designs of retrieval systems for the IL PCR(Indian Legal Prior Case Retrieval) task. We demonstrate that the combination of the rhetorical roles (Fact, Ratio Of The Decision, Precedent, Argument, Statute) is better than either using individual roles or performing full text retrieval, that statute similarity is not discriminative, and that a legal entailment reranker with training data produced by an LLM is much worse in terms of official evaluation than its internal validation score. Two rankers, with excellent internal MRR up to 0.97, performed poorly in terms of official evaluation (MRR as low as 0.14). Thus, we propose a new design with query disjoint splitting and frozen validation fusion. The result is a four stage pipeline with Micro F1 0.2549, MRR 0.6081, and nDCG@10 0.4187.

cs.IR↗

Rhetorical-Role-Aware Retrieval-Augmented Generation for Legal Question Answering over Indian Supreme Court Judgments

This research paper proposes a Retrieval Augmented Generation (RAG) framework that is specific to the legal field in order to assist interactive retrieval and reason about judgments from the Supreme Court of India. The solution uses an enhanced version of RAG framework which consists of rhetorically based chunking, fusion-based retrieval, and cross encoder reranking methods to increase the relevancy of the information retrieved. In order to improve conversations, the proposed framework uses chat history along with query classification and rewriting in order to understand user intention from successive queries. Additionally, there are features that take into account structural aspects of legal documents, such as isolated names of judges that could have an impact on retrieval quality. The evaluation was done using the DeepEval framework and demonstrated strong performance on metrics including contextual recall and answer relevancy, which proves that the framework is very effective in dealing with legal question-answering tasks that require a lot of context. The results emphasize the importance of domain specific enhancements in developing legal AI systems that are both reliable and explainable.

cs.IR↗