SearcharxivSearch

arXiv subjects

Joohee Park

Publications and source records attributed to Joohee Park.

5 recordsLinked to original sources

A Study on Token Pruning for ColBERT

The ColBERT model has recently been proposed as an effective BERT based ranker. By adopting a late interaction mechanism, a major advantage of ColBERT is that document representations can be precomputed in advance. However, the big downside of the model is the index size, which scales linearly with the number of tokens in the collection. In this paper, we study various designs for ColBERT models in order to attack this problem. While compression techniques have been explored to reduce the index size, in this paper we study token pruning techniques for ColBERT. We compare simple heuristics, as well as a single layer of attention mechanism to select the tokens to keep at indexing time. Our experiments show that ColBERT indexes can be pruned up to 30\% on the MS MARCO passage collection without a significant drop in performance. Finally, we experiment on MS MARCO documents, which reveal several challenges for such mechanism.

cs.IR

Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval

The semantic matching capabilities of neural information retrieval can ameliorate synonymy and polysemy problems of symbolic approaches. However, neural models' dense representations are more suitable for re-ranking, due to their inefficiency. Sparse representations, either in symbolic or latent form, are more efficient with an inverted index. Taking the merits of the sparse and dense representations, we propose an ultra-high dimensional (UHD) representation scheme equipped with directly controllable sparsity. UHD's large capacity and minimal noise and interference among the dimensions allow for binarized representations, which are highly efficient for storage and search. Also proposed is a bucketing method, where the embeddings from multiple layers of BERT are selected/merged to represent diverse linguistic aspects. We test our models with MS MARCO and TREC CAR, showing that our models outperforms other sparse models

cs.CL

Electrical tuning of exciton-plasmon polariton coupling in monolayer MoS2 integrated with plasmonic nanoantenna lattice

Active control of light-matter interactions in semiconductors is critical for realizing next generation optoelectronic devices, with tunable control of the systems optical properties via external fields. The ability to manipulate optical interactions in active materials coupled to cavities via geometrical parameters, which are fixed along with dynamic control with applied fields opens up possibilities of controlling exciton lifetimes, oscillator strengths and their relaxation properties. Here, we demonstrate electrical control of exciton-plasmon polariton coupling strength of a two-dimensional semiconductor integrated with plasmonic nanoresonators assembled in a field-effect transistor device between strong and weak coupling limits by electrostatic doping. As a result, the exciton-plasmon polarion dispersion can be altered dynamically with applied electric field by modulating the excitonic properties of monolayer MoS2 arising from many-body effects with carrier concentration. In addition, strong coupling between charged excitons plasmons was also observed upon increased carrier injection. The ability to dynamically control the optical properties of an ultra-thin semiconductor with plasmonic nanoresonators and electric fields demonstrates the versatility of the coupled system and offers a new platform for the design of optoelectronic devices with precisely tailored responses.

cond-mat.mtrl-sci

Strong exciton-plasmon coupling in MoS2 coupled with plasmonic lattice

We demonstrate strong exciton-plasmon coupling in silver nanodisk arrays integrated with monolayer MoS2 via angle-resolved reflectance microscopy spectra of the coupled system. Strong exciton-plasmon coupling is observed with the exciton-plasmon coupling strength up to 58 meV at 77 K, which also survives at room temperature. The strong coupling involves three types of resonances: MoS2 excitons, localized surface plasmon resonances (LSPRs) of individual silver nanodisks and plasmonic lattice resonances of the nanodisk array. We show that the exciton-plasmon coupling strength, polariton composition and dispersion can be effectively engineered by tuning the geometry of the plasmonic lattice, which makes the system promising for realizing novel two-dimensional plasmonic polaritonic devices.

cond-mat.mtrl-sci

Fano resonance and spectrally modified photoluminescence enhancement in monolayer MoS2 integrated with plasmonic nanoantenna array

The manipulation of light-matter interactions in two-dimensional atomically thin crystals is critical for obtaining new optoelectronic functionalities in these strongly confined materials. Here, by integrating chemically grown monolayers of MoS2 with a silver-bowtie nanoantenna array supporting narrow surface-lattice plasmonic resonances, a unique two-dimensional optical system has been achieved. The enhanced exciton-plasmon coupling enables profound changes in the emission and excitation processes leading to spectrally tunable, large photoluminescence enhancement as well as surface-enhanced Raman scattering at room temperature. Furthermore, at low temperatures, due to the decreased damping of MoS2 excitons interacting with the plasmonic resonances of the bowtie array, stronger exciton-plasmon coupling is achieved resulting in a Fano lineshape in the reflection spectrum. The Fano lineshape, which is due to the interference between the pathways involving the excitation of the exciton and plasmon, can be tuned by altering the coupling strengths between the two systems via changing the design of the bowties lattice. The ability to manipulate the optical properties of two-dimensional systems with tunable plasmonic resonators offers a new platform for the design of novel optical devices with precisely tailored responses.

cond-mat.mtrl-sci