arXiv subjects

Yujie Lin

Publications and source records attributed to Yujie Lin.

39 records · Page 3Linked to original sources

arXiv2019

Improving Outfit Recommendation with Co-supervision of Fashion Generation

The task of fashion recommendation includes two main challenges: visual understanding and visual matching. Visual understanding aims to extract effective visual features. Visual matching aims to model a human notion of compatibility to compute a match between fashion items. Most previous studies rely on recommendation loss alone to guide visual understanding and matching. Although the features captured by these methods describe basic characteristics (e.g., color, texture, shape) of the input items, they are not directly related to the visual signals of the output items (to be recommended). This is problematic because the aesthetic characteristics (e.g., style, design), based on which we can directly infer the output items, are lacking. Features are learned under the recommendation loss alone, where the supervision signal is simply whether the given two items are matched or not. To address this problem, we propose a neural co-supervision learning framework, called the FAshion Recommendation Machine (FARM). FARM improves visual understanding by incorporating the supervision of generation loss, which we hypothesize to be able to better encode aesthetic information. FARM enhances visual matching by introducing a novel layer-to-layer matching mechanism to fuse aesthetic information more effectively, and meanwhile avoiding paying too much attention to the generation quality and ignoring the recommendation performance. Extensive experiments on two publicly available datasets show that FARM outperforms state-of-the-art models on outfit recommendation, in terms of AUC and MRR. Detailed analyses of generated and recommended items demonstrate that FARM can encode better features and generate high quality images as references to improve recommendation performance.

cs.IR↗

arXiv2019

Explainable Outfit Recommendation with Joint Outfit Matching and Comment Generation

Most previous work on outfit recommendation focuses on designing visual features to enhance recommendations. Existing work neglects user comments of fashion items, which have been proved to be effective in generating explanations along with better recommendation results. We propose a novel neural network framework, neural outfit recommendation (NOR), that simultaneously provides outfit recommendations and generates abstractive comments. NOR consists of two parts: outfit matching and comment generation. For outfit matching, we propose a convolutional neural network with a mutual attention mechanism to extract visual features. The visual features are then decoded into a rating score for the matching prediction. For abstractive comment generation, we propose a gated recurrent neural network with a cross-modality attention mechanism to transform visual features into a concise sentence. The two parts are jointly trained based on a multi-task learning framework in an end-to-end back-propagation paradigm. Extensive experiments conducted on an existing dataset and a collected real-world dataset show NOR achieves significant improvements over state-of-the-art baselines for outfit recommendation. Meanwhile, our generated comments achieve impressive ROUGE and BLEU scores in comparison to human-written comments. The generated comments can be regarded as explanations for the recommendation results. We release the dataset and code to facilitate future research.

cs.IR↗

arXiv2017

NOMA based Calibration for Large-Scale Spaceborne Antenna Arrays

In the parallel calibration for transmitting phased arrays, the calibration receiver must separate the signals belonging to different antenna elements to avoid mutual interference. Existing algorithms encode different antenna elements' radiation with orthogonal signature codes, but these algorithms are far from desired for large-scale spaceborne antenna arrays. Considering the strictly limited resources on satellites, to improve hardware efficiency of large-scale spaceborne antenna arrays, in this work inspired by the idea of non-orthogonal multiple access (NOMA) we design a series of non-orthogonal signature codes for different antenna elements by Cyclically Shifting an m-Sequence (CSmS) with different offsets named as CSmS-NOMA signaling. This design can strike an elegant balance between the performance and complexity and is very suitable for large-scale spaceborne antenna arrays. It is shown that no matter how many antenna elements there are to be calibrated simultaneously, CSmS-NOMA signaling needs only one calibrating waveform generator and one matched filter. Hence it is much more efficient than the existing fully orthogonal schemes. In order to evaluate the achievable calibration accuracy, a unified theoretical framework is developed based on which the relationship between calibration accuracy and signal to noise ratio (SNR) has been clearly revealed. Furthermore, a hardware experiment platform is also built to assess the theoretical work. For all the considered scenarios, it can be concluded that the theoretical, simulated and experimental results coincide with each other perfectly.

cs.IT↗