arXiv subjects

Varun Iyer

Publications and source records attributed to Varun Iyer.

6 recordsLinked to original sources

arXiv2026

BLooP: Zero-Shot Abstractive Summarization using Large Language Models with Bigram Lookahead Promotion

Abstractive summarization requires models to generate summaries that convey information in the source document. While large language models can generate summaries without fine-tuning, they often miss key details and include extraneous information. We propose BLooP (Bigram Lookahead Promotion), a simple training-free decoding intervention that encourages large language models (LLMs) to generate tokens that form bigrams from the source document. BLooP operates through a hash table lookup at each decoding step, requiring no training, fine-tuning, or model modification. We demonstrate improvements in ROUGE and BARTScore for Llama-3.1-8B-Instruct, Mistral-Nemo-Instruct-2407, and Gemma-2-9b-it on CNN/DM, CCSum, Multi-News, and SciTLDR. Human evaluation shows that BLooP significantly improves faithfulness without reducing readability. We make the code available at https://github.com/varuniyer/BLooP

cs.CL↗

arXiv2025

The Local Galactic Transient Survey Applied to an Optical Search for Directed Intelligence

We discuss our transient search for directed energy systems in local galaxies, with calculations indicating the ability of modest searches to detect optical Search for Extraterrestrial Intelligence (SETI) sources in the closest galaxies. Our analysis follows Lubin (2016) where a messenger civilization follows a beacon strategy we call "intelligent targeting." We plot the required laser time to achieve an SNR of 10 and find the time for a blind transmission to target all stars in the Milky Way to be achievable for local galactic civilizations. As high cadence and sky coverage is the pathway to enable such a detection, we operate the Local Galactic Transient Survey (LGTS) targeting M31 (the Andromeda Galaxy), the Large Magellanic Cloud (LMC), and the Small Magellanic Cloud (SMC) via Las Cumbres Observatory's (LCO) network of 0.4 m telescopes. We explore the ability of modest searches like the LGTS to detect directed pulses in optical and near-infrared wavelengths from Extraterrestrial Intelligence (ETI) at these distances and conclude a civilization utilizing less powerful laser technology than we can construct in this century is readily detectable with the LGTS's observational capabilities. Data processing of 30,000 LGTS images spanning 5 years is in progress with the TRansient Image Processing Pipeline (TRIPP; Thomas et al. (2025)).

astro-ph.IM↗

arXiv2025

TRIPP: A General Purpose Data Pipeline for Astronomical Image Processing

We present the TRansient Image Processing Pipeline (TRIPP), a transient and variable source detection pipeline that employs both difference imaging and light curve analysis techniques for astronomical data. Additionally, we demonstrate TRIPP's rapid analysis capability by detecting transient candidates in near-real time. TRIPP was tested using image data of the supernova SN2023ixf and from the Local Galactic Transient Survey (LGTS, Thomas et al. (2025)) collected by the Las Cumbres Observatory's (LCO) network of 0.4 m telescopes. To verify the methods employed by TRIPP, we compare our results to published findings on the photometry of SN2023ixf. Additionally, we report the ability of TRIPP to detect transient signals from optical Search for Extra Terrestrial Intelligence (SETI) sources.

astro-ph.IM↗

arXiv2023

LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models

The advent of large language models (LLMs) and their adoption by the legal community has given rise to the question: what types of legal reasoning can LLMs perform? To enable greater study of this question, we present LegalBench: a collaboratively constructed legal reasoning benchmark consisting of 162 tasks covering six different types of legal reasoning. LegalBench was built through an interdisciplinary process, in which we collected tasks designed and hand-crafted by legal professionals. Because these subject matter experts took a leading role in construction, tasks either measure legal reasoning capabilities that are practically useful, or measure reasoning skills that lawyers find interesting. To enable cross-disciplinary conversations about LLMs in the law, we additionally show how popular legal frameworks for describing legal reasoning -- which distinguish between its many forms -- correspond to LegalBench tasks, thus giving lawyers and LLM developers a common vocabulary. This paper describes LegalBench, presents an empirical evaluation of 20 open-source and commercial LLMs, and illustrates the types of research explorations LegalBench enables.

cs.CL↗

arXiv2023

ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation

Paraphrase generation is a long-standing task in natural language processing (NLP). Supervised paraphrase generation models, which rely on human-annotated paraphrase pairs, are cost-inefficient and hard to scale up. On the other hand, automatically annotated paraphrase pairs (e.g., by machine back-translation), usually suffer from the lack of syntactic diversity -- the generated paraphrase sentences are very similar to the source sentences in terms of syntax. In this work, we present ParaAMR, a large-scale syntactically diverse paraphrase dataset created by abstract meaning representation back-translation. Our quantitative analysis, qualitative examples, and human evaluation demonstrate that the paraphrases of ParaAMR are syntactically more diverse compared to existing large-scale paraphrase datasets while preserving good semantic similarity. In addition, we show that ParaAMR can be used to improve on three NLP tasks: learning sentence embeddings, syntactically controlled paraphrase generation, and data augmentation for few-shot learning. Our results thus showcase the potential of ParaAMR for improving various NLP applications.

cs.CL↗

arXiv2022

Unsupervised Syntactically Controlled Paraphrase Generation with Abstract Meaning Representations

Syntactically controlled paraphrase generation has become an emerging research direction in recent years. Most existing approaches require annotated paraphrase pairs for training and are thus costly to extend to new domains. Unsupervised approaches, on the other hand, do not need paraphrase pairs but suffer from relatively poor performance in terms of syntactic control and quality of generated paraphrases. In this paper, we demonstrate that leveraging Abstract Meaning Representations (AMR) can greatly improve the performance of unsupervised syntactically controlled paraphrase generation. Our proposed model, AMR-enhanced Paraphrase Generator (AMRPG), separately encodes the AMR graph and the constituency parse of the input sentence into two disentangled semantic and syntactic embeddings. A decoder is then learned to reconstruct the input sentence from the semantic and syntactic embeddings. Our experiments show that AMRPG generates more accurate syntactically controlled paraphrases, both quantitatively and qualitatively, compared to the existing unsupervised approaches. We also demonstrate that the paraphrases generated by AMRPG can be used for data augmentation to improve the robustness of NLP models.

cs.CL↗