SearcharxivSearch

arXiv subjects

Sina Salek

Publications and source records attributed to Sina Salek.

8 recordsLinked to original sources

Using the Path of Least Resistance to Explain Deep Networks

Integrated Gradients (IG), a widely used axiomatic path-based attribution method, assigns importance scores to input features by integrating model gradients along a straight path from a baseline to the input. While effective in some cases, we show that straight paths can lead to flawed attributions. In this paper, we identify the cause of these misattributions and propose an alternative approach that equips the input space with a model-induced Riemannian metric (derived from the explained model's Jacobian) and computes attributions by integrating gradients along geodesics under this metric. We call this method Geodesic Integrated Gradients (GIG). To approximate geodesic paths, we introduce two techniques: a k-Nearest Neighbours-based approach for smaller models and a Stochastic Variational Inference-based method for larger ones. Additionally, we propose a new axiom, No-Cancellation Completeness (NCC), which strengthens completeness by ruling out feature-wise cancellation. We prove that, for path-based attributions under the model-induced metric, NCC holds if and only if the integration path is a geodesic. Through experiments on both synthetic and real-world image classification data, we provide empirical evidence supporting our theoretical analysis and showing that GIG produces more faithful attributions than existing methods, including IG, on the benchmarks considered.

cs.LG

Experimental Quantum Communication Enhancement by Superposing Trajectories

In quantum communication networks, wires represent well-defined trajectories along which quantum systems are transmitted. In spite of this, trajectories can be used as a quantum control to govern the order of different noisy communication channels, and such a control has been shown to enable the transmission of information even when quantum communication protocols through well-defined trajectories fail. This result has motivated further investigations on the role of the superposition of trajectories in enhancing communication, which revealed that the use of quantum control of parallel communication channels, or of channels in series with quantum-controlled operations, can also lead to communication advantages. Building upon these findings, here we experimentally and numerically compare different ways in which two trajectories through a pair of noisy channels can be superposed. We observe that, within the framework of quantum interferometry, the use of channels in series with quantum-controlled operations generally yields the largest advantages. Our results contribute to clarify the nature of these advantages in experimental quantum-optical scenarios, and showcase the benefit of an extension of the quantum communication paradigm in which both the information exchanged and the trajectory of the information carriers are quantum.

quant-ph

Resource theories of communication

A series of recent works has shown that placing communication channels in a coherent superposition of alternative configurations can boost their ability to transmit information. Instances of this phenomenon are the advantages arising from the use of communication devices in a superposition of alternative causal orders, and those arising from the transmission of information along a superposition of alternative trajectories. The relation among these advantages has been the subject of recent debate, with some authors claiming that the advantages of the superposition of orders could be reproduced, and even surpassed, by other forms of superpositions. To shed light on this debate, we develop a general framework of resource theories of communication. In this framework, the resources are communication devices, and the allowed operations are (a) the placement of communication devices between the communicating parties, and (b) the connection of communication devices with local devices in the parties' laboratories. The allowed operations are required to satisfy the minimal condition that they do not enable communication independently of the devices representing the initial resources. The resource-theoretic analysis reveals that the aforementioned criticisms on the superposition of causal orders were based on an uneven comparison between different types of quantum superpositions, exhibiting different operational features.

quant-ph

Quantum Rate-Distortion Coding of Relevant Information

Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the original source data and the best approximation after decompression. The so-called Information Bottleneck Method is designed to compress only `relevant' information. Which information is relevant is determined by the correlation between the data being compressed and a variable of interest, so-called side information. In this paper, an Information Bottleneck Method is introduced for the compression of quantum data. The channel communication picture is used for compression and decompression. The rate of compression is derived using an entanglement assisted protocol with classical communication, and under an unproved conjecture that the rate function is convex in the distortion parameter. The optimum channel achieving this rate for a given input state is characterised. The conceptual difficulties arising due to differences in the mathematical formalism between quantum and classical probability theory are discussed and solutions are presented.

quant-ph

Quantum communication in a superposition of causal orders

Quantum mechanics allows for situations where the relative order between two processes is entangled with a quantum degree of freedom. Here we show that such entanglement can enhance the ability to transmit quantum information over noisy communication channels. We consider two completely dephasing channels, which in normal conditions are unable to transmit any quantum information. We show that, when the two channels are traversed in an indefinite order, a quantum bit sent through them has a 25% probability to reach the receiver without any error. For partially dephasing channels, a similar advantage takes place deterministically: the amount of quantum information that can travel through two channels in a superposition of orders can be larger than the amount of quantum information that can travel through each channel individually.

quant-ph

Enhanced communication with the assistance of indefinite causal order

In quantum Shannon theory, the way information is encoded and decoded takes advantage of the laws of quantum mechanics, while the way communication channels are interlinked is assumed to be classical. In this Letter we relax the assumption that quantum channels are combined classically, showing that a quantum communication network where quantum channels are combined in a superposition of different orders can achieve tasks that are impossible in conventional quantum Shannon theory. In particular, we show that two identical copies of a completely depolarizing channel become able to transmit information when they are combined in a quantum superposition of two alternative orders. This finding runs counter to the intuition that if two communication channels are identical, using them in different orders should not make any difference. The failure of such intuition stems from the fact that a single noisy channel can be a random mixture of elementary, non-commuting processes, whose order (or lack thereof) can affect the ability to transmit information.

quant-ph

Fluctuations in Single-Shot $ε$-Deterministic Work Extraction

There has been an increasing interest in the quantification of nearly deterministic work extraction from a finite number of copies of microscopic particles in finite time. This paradigm, so called single-shot epsilon-deterministic work extraction, considers processes with small failure probabilities. However, the resulting fluctuations in the extracted work entailed by this failure probability have not been studied before. In the standard thermodynamics paradigm fluctuation theorems are powerful tools to study fluctuating quantities. Given that standard fluctuation theorems are inadequate for a single-shot scenario, here we formulate and prove a fluctuation relation specific to the single-shot epsilon-deterministic work extraction to bridge this gap. Our results are general in the sense that we allow the system to be in contact with the heat bath at all times. As a corollary of our theorem we derive the known bounds on the epsilon-deterministic work.

quant-ph

Negative Conditional Entropy of Post-Selected States

We define a quantum entropy conditioned on post-selection which has the von Neumann entropy of pure states as a special case. This conditional entropy can take negative values which is consistent with part of a quantum system containing less information than the whole which can be in a pure state. The definition is based on generalised density operators for postselected ensembles. The corresponding density operators are consistent with the quantum generalisation of classical conditional probabilities following Dirac s formalism of quasiprobability distributions.

quant-ph