SearcharxivSearch

arXiv subjects

Arshad Shaikh

Publications and source records attributed to Arshad Shaikh.

3 recordsLinked to original sources

Introducing Self-Attention to Target Attentive Graph Neural Networks

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate information from neighboring nodes i.e., local message passing. Such graph-based architectures have representational limits, as a single sub-graph is susceptible to overfit the sequential dependencies instead of accounting for complex transitions between items in different sessions. We propose a new technique that leverages a Transformer in combination with a target attentive GNN. This allows richer representations to be learnt, which translates to empirical performance gains in comparison to a vanilla target attentive GNN. Our experimental results and ablation show that our proposed method is competitive with the existing methods on real-world benchmark datasets, improving on graph-based hypotheses. Code is available at https://github.com/The-Learning-Machines/SBR

cs.IR

Rethinking Neural Networks With Benford's Law

Benford's Law (BL) or the Significant Digit Law defines the probability distribution of the first digit of numerical values in a data sample. This Law is observed in many naturally occurring datasets. It can be seen as a measure of naturalness of a given distribution and finds its application in areas like anomaly and fraud detection. In this work, we address the following question: Is the distribution of the Neural Network parameters related to the network's generalization capability? To that end, we first define a metric, MLH (Model Enthalpy), that measures the closeness of a set of numbers to Benford's Law and we show empirically that it is a strong predictor of Validation Accuracy. Second, we use MLH as an alternative to Validation Accuracy for Early Stopping, removing the need for a Validation set. We provide experimental evidence that even if the optimal size of the validation set is known before-hand, the peak test accuracy attained is lower than not using a validation set at all. Finally, we investigate the connection of BL to Free Energy Principle and First Law of Thermodynamics, showing that MLH is a component of the internal energy of the learning system and optimization as an analogy to minimizing the total energy to attain equilibrium.

cs.LG

Performance Evaluation of Ad Hoc Multicast Routing Protocols to Facilitate Video Streaming in VANETS

Vehicular Ad Hoc Network (VANET) is a type of mobile ad hoc network (MANET) that facilitates communication among vehicles. VANET provides inter-vehicular communications to serve for the application like road traffic safety and traffic efficiency. Infotainment service has been an anticipating trend in VANETs, and video streaming has a high potential in VANET. Although, this emerging technology is trending, there are still some issues like QoS provisions, decentralized medium access control, node coverage area, and finding and maintaining routes due to highly dynamic topology. These issues make multicast communication difficult in VANETs. Numerous routing protocols and routing strategies have been projected to cope with these issues. Lots of work has taken place to assess and measure the performances of these protocols in VANETs but these protocols are rarely analyzed for performance under stress of real time video multicast. In this study two different multicast routing protocols viz. Multicast Ad hoc On Demand Distance Vector (MAODV) and Protocol for Unified Multicasting through Announcements (PUMA) are evaluated for facilitating video streaming in VANETS. The protocols are examined against the QoS parameters such as Network Throughput, Packet Delivery Ratio (PDR), Average end to end Delay, and Normalized Routing Load (NRL). Variable Bit Rate (VBR) traffic is used to evaluate the performances of protocol. PUMA, at the end, showed better performance against different QoS provisions in different scenarios

cs.NI