arXiv subjects

Pablo Ortiz

Publications and source records attributed to Pablo Ortiz.

8 recordsLinked to original sources

arXiv2024

SiamTST: A Novel Representation Learning Framework for Enhanced Multivariate Time Series Forecasting applied to Telco Networks

We introduce SiamTST, a novel representation learning framework for multivariate time series. SiamTST integrates a Siamese network with attention, channel-independent patching, and normalization techniques to achieve superior performance. Evaluated on a real-world industrial telecommunication dataset, SiamTST demonstrates significant improvements in forecasting accuracy over existing methods. Notably, a simple linear network also shows competitive performance, achieving the second-best results, just behind SiamTST. The code is available at https://github.com/simenkristoff/SiamTST.

cs.LG↗

arXiv2022

The Norwegian Parliamentary Speech Corpus

The Norwegian Parliamentary Speech Corpus (NPSC) is a speech dataset with recordings of meetings from Stortinget, the Norwegian parliament. It is the first, publicly available dataset containing unscripted, Norwegian speech designed for training of automatic speech recognition (ASR) systems. The recordings are manually transcribed and annotated with language codes and speakers, and there are detailed metadata about the speakers. The transcriptions exist in both normalized and non-normalized form, and non-standardized words are explicitly marked and annotated with standardized equivalents. To test the usefulness of this dataset, we have compared an ASR system trained on the NPSC with a baseline system trained on only manuscript-read speech. These systems were tested on an independent dataset containing spontaneous, dialectal speech. The NPSC-trained system performed significantly better, with a 22.9% relative improvement in word error rate (WER). Moreover, training on the NPSC is shown to have a "democratizing" effect in terms of dialects, as improvements are generally larger for dialects with higher WER from the baseline system.

cs.CL↗

arXiv2022

BERT Attends the Conversation: Improving Low-Resource Conversational ASR

We propose new, data-efficient training tasks for BERT models that improve performance of automatic speech recognition (ASR) systems on conversational speech. We include past conversational context and fine-tune BERT on transcript disambiguation without external data to rescore ASR candidates. Our results show word error rate recoveries up to 37.2%. We test our methods in low-resource data domains, both in language (Norwegian), tone (spontaneous, conversational), and topics (parliament proceedings and customer service phone calls). These techniques are applicable to any ASR system and do not require any additional data, provided a pre-trained BERT model. We also show how the performance of our context-augmented rescoring methods strongly depends on the degree of spontaneity and nature of the conversation.

cs.CL↗

arXiv2015

Localized correlated features in the CMB power spectrum and primordial bispectrum from a transient reduction in the speed of sound

The first year of observations by the Planck satellite mission shows that the cosmic microwave background (CMB) fluctuations are consistent with gaussian statistics in the primordial perturbations, a key prediction of the simplest models of inflation. However, there are hints of anomalies in the CMB power spectrum and bispectrum. We check for the possibility that some of these anomalous features have a common physical origin in a transient reduction of the inflaton speed of sound. We do this by exploiting predicted correlations between the power spectrum and bispectrum. Our results suggest that current data might already be sensitive enough to detect transient reductions in the speed of sound as mild as a few percent. Since this is a signature of interactions, it opens a new window for the detection of extra degrees of freedom during inflation.

astro-ph.CO↗

arXiv2015

Inflation with moderately sharp features in the speed of sound: GSR and in-in formalism for power spectrum and bispectrum

We continue the study of mild transient reductions in the speed of sound of the adiabatic mode during inflation, of their effect on the primordial power spectrum and bispectrum, and of their detectability in the Cosmic Microwave Background (CMB). We focus on the regime of \emph{moderately sharp} mild reductions in the speed of sound during uninterrupted slow-roll inflation, a theoretically well motivated and self-consistent regime that admits an effective single-field description. The signatures on the power spectrum and bispectrum were previously computed using a slow-roll Fourier transform (SRFT) approximation, and here we compare it with generalized slow-roll (GSR) and in-in methods, for which we derive new formulas that account for moderately sharp features. The agreement between them is excellent, and also with the power spectrum obtained from the numerical solution to the equation of motion. We show that, in this regime, the SRFT approximation correctly captures with simplicity the effect of higher derivatives of the speed of sound in the mode equation, and makes manifest the correlations between power spectrum and bispectrum features. In a previous paper we reported hints of these correlations in the Planck data and here we perform several consistency checks and further analyses of the best fits, such as polarization and local significance at different angular scales. For the data analysis, we show the excellent agreement between the CLASS and CAMB Boltzmann codes. Our results confirm that the theoretical framework is consistent, and they suggest that the predicted correlations are robust enough to be searched for in CMB and Large Scale Structure (LSS) surveys.

astro-ph.CO↗

arXiv2015

A new class of de Sitter vacua in String Theory Compactifications

We revisit the stability of the complex structure moduli in the large volume regime of type-IIB flux compactifications. We argue that when the volume is not exponentially large, such as in Kähler uplifted dS vacua, the quantum corrections to the tree-level mass spectrum can induce tachyonic instabilities in this sector. We discuss a Random Matrix Theory model for the classical spectrum of the complex structure fields, and derive a new stability bound involving the compactification volume and the (very large) number of moduli. We also present a new class of vacua for this sector where the mass spectrum presents a finite gap, without invoking large supersymmetric masses. At these vacua the complex structure sector is protected from tachyonic instabilities even at non-exponential volumes. A distinguishing feature is that all fermions in this sector are lighter than the gravitino.

hep-th↗

arXiv2015

Perturbative Stability along the Supersymmetric Directions of the Landscape

We consider the perturbative stability of non-supersymmetric configurations in N=1 supergravity models with a spectator sector not involved in supersymmetry breaking. Motivated by the supergravity description of complex structure moduli in Large Volume Compactifications of type IIB-superstrings, we concentrate on models where the interactions are consistent with the supersymmetric truncation of the spectator fields, and we describe their couplings by a random ensemble of generic supergravity theories. We characterise the mass spectrum of the spectator fields in terms of the statistical parameters of the ensemble and the geometry of the scalar manifold. Our results show that the non-generic couplings between the spectator and the supersymmetry breaking sectors can stabilise all the tachyons which typically appear in the spectator sector before including the supersymmetry breaking effects, and we find large regions of the parameter space where the supersymmetric sector remains stable with probability close to one. We discuss these results about the stability of the supersymmetric sector in two physically relevant situations: non-supersymmetric Minkowski vacua, and slow-roll inflation driven by the supersymmetry breaking sector. For the class of models we consider, we have reproduced the regimes in which the KKLT and Large Volume Scenarios stabilise all supersymmetric moduli. We have also identified a new regime in which the supersymmetric sector is stabilised at a very robust type of dS minimum without invoking a large mass hierarchy.

hep-th↗

arXiv2013

Sgoldstino inflation

We discuss the possibility that inflation is driven by the sgoldstino, the superpartner of the goldstino. Unlike in generic supergravity scenarios, the sgoldstino decouples from all other fields in the theory, which allows for a simple and robust inflationary model. We argue that the two-field model given by this single complex scalar correctly captures the full multifield inflationary phenomenology. On the other hand, the assumption of stability, along the entire inflationary trajectory, of the supersymmetry-preserving sector that is integrated out leads to supplementary constraints on the parent supergravity. We investigate small field, large field and hybrid sgoldstino inflation scenarios and provide some working examples. They are subject to the usual fine-tuning issues that are common to all supergravity models of inflation. We comment on some other recently proposed sgoldstino inflation models.

hep-th↗