SearcharxivSearch

arXiv subjects

Masato Mimura

Publications and source records attributed to Masato Mimura.

54 records · Page 3Linked to original sources

Improving OOV Detection and Resolution with External Language Models in Acoustic-to-Word ASR

Acoustic-to-word (A2W) end-to-end automatic speech recognition (ASR) systems have attracted attention because of an extremely simplified architecture and fast decoding. To alleviate data sparseness issues due to infrequent words, the combination with an acoustic-to-character (A2C) model is investigated. Moreover, the A2C model can be used to recover out-of-vocabulary (OOV) words that are not covered by the A2W model, but this requires accurate detection of OOV words. A2W models learn contexts with both acoustic and transcripts; therefore they tend to falsely recognize OOV words as words in the vocabulary. In this paper, we tackle this problem by using external language models (LM), which are trained only with transcriptions and have better linguistic information to detect OOV words. The A2C model is used to resolve these OOV words. Experimental evaluations show that external LMs have the effects of not only reducing errors but also increasing the number of detected OOV words, and the proposed method significantly improves performances in English conversational and Japanese lecture corpora, especially for out-of-domain scenario. We also investigate the impact of the vocabulary size of A2W models and the data size for training LMs. Moreover, our approach can reduce the vocabulary size several times with marginal performance degradation.

cs.CL

An extreme counterexample to the Lubotzky--Weiss conjecture

In 1993, Lubotzky and Weiss conjectured that if a compact group admits two finitely generated dense subgroups, one of which is amenable and the other has Kazhdan's property (T), then it would be finite. This conjecture was resolved in the negative by Ershov and Jaikin-Zapirain, and by Kassabov around 2010. In the present paper, we provide an extreme counterexample to this conjecture. More precisely, the latter dense group with property (T) may contain a given countable residually finite group; in particular, it can be non-exact by a result of Osajda. We may construct these counterexamples with a compact group common for all countable residually finite groups.

math.GR

Unsupervised Speech Enhancement Based on Multichannel NMF-Informed Beamforming for Noise-Robust Automatic Speech Recognition

This paper describes multichannel speech enhancement for improving automatic speech recognition (ASR) in noisy environments. Recently, the minimum variance distortionless response (MVDR) beamforming has widely been used because it works well if the steering vector of speech and the spatial covariance matrix (SCM) of noise are given. To estimating such spatial information, conventional studies take a supervised approach that classifies each time-frequency (TF) bin into noise or speech by training a deep neural network (DNN). The performance of ASR, however, is degraded in an unknown noisy environment. To solve this problem, we take an unsupervised approach that decomposes each TF bin into the sum of speech and noise by using multichannel nonnegative matrix factorization (MNMF). This enables us to accurately estimate the SCMs of speech and noise not from observed noisy mixtures but from separated speech and noise components. In this paper we propose online MVDR beamforming by effectively initializing and incrementally updating the parameters of MNMF. Another main contribution is to comprehensively investigate the performances of ASR obtained by various types of spatial filters, i.e., time-invariant and variant versions of MVDR beamformers and those of rank-1 and full-rank multichannel Wiener filters, in combination with MNMF. The experimental results showed that the proposed method outperformed the state-of-the-art DNN-based beamforming method in unknown environments that did not match training data.

cs.SD

Group approximation in Cayley topology and coarse geometry, Part II: Fibered coarse embeddings

The objective of this series is to study metric geometric properties of disjoint unions of amenable Cayley graphs by group properties of the Cayley accumulation points in the space of marked groups. In this Part II, we prove that a disjoint union admits a fibred coarse embedding into a Hilbert space (in a generalized sense) if and only if the Cayley boundary of the sequence in the space of marked groups is uniformly a-T-menable. We furthermore extend this result to ones with other target spaces. By combining our main results with constructions of Arzhantseva--Osajda and Osajda, we construct two systems of markings of a certain sequence of finite groups with two opposite extreme behaviors of the resulting two disjoint unions: With respect to one marking, the space has property A. On the other hand, with respect to the other, the space does not admit fibred coarse embeddings into Banach spaces with non-trivial type (for instance, uniformly convex Banach spaces) or Hadamard manifolds; the Cayley limit group is, furthermore, non-exact.

math.GR

Amenability versus non-exactness of dense subgroups of a compact group

Given a countable residually finite group, we construct a compact group K and two elements w and u of K with the following properties: The group generated by w and the cube of u is amenable, the group generated by w and u contains a copy of the given group, and these two groups are dense in K. By combining it with a construction of non-exact groups that are LEF by Osajda and Arzhantseva--Osajda and formation of diagonal products, we construct an example for which the latter dense group is non-exact. Our proof employs approximations in the space of marked groups of LEF ("Locally Embeddable into Finite groups") groups.

math.GR

Group approximation in Cayley topology and coarse geometry, Part I: Coarse embeddings of amenable groups

The objective of this series is to study metric geometric properties of (coarse) disjoint unions of amenable Cayley graphs. We employ the Cayley topology and observe connections between large scale structure of metric spaces and group properties of Cayley accumulation points. In this Part I, we prove that a disjoint union has property A of G. Yu if and only if all groups appearing as Cayley accumulation points in the space of marked groups are amenable. As an application, we construct two disjoint unions of finite special linear groups (and unimodular linear groups) with respect to two systems of generators that look similar such that one has property A and the other does not admit (fibred) coarse embeddings into any Banach space with non-trivial type (for instance, any uniformly convex Banach space).

math.GR

Statistical Speech Enhancement Based on Probabilistic Integration of Variational Autoencoder and Non-Negative Matrix Factorization

This paper presents a statistical method of single-channel speech enhancement that uses a variational autoencoder (VAE) as a prior distribution on clean speech. A standard approach to speech enhancement is to train a deep neural network (DNN) to take noisy speech as input and output clean speech. Although this supervised approach requires a very large amount of pair data for training, it is not robust against unknown environments. Another approach is to use non-negative matrix factorization (NMF) based on basis spectra trained on clean speech in advance and those adapted to noise on the fly. This semi-supervised approach, however, causes considerable signal distortion in enhanced speech due to the unrealistic assumption that speech spectrograms are linear combinations of the basis spectra. Replacing the poor linear generative model of clean speech in NMF with a VAE---a powerful nonlinear deep generative model---trained on clean speech, we formulate a unified probabilistic generative model of noisy speech. Given noisy speech as observed data, we can sample clean speech from its posterior distribution. The proposed method outperformed the conventional DNN-based method in unseen noisy environments.

cs.SD

An alternative proof of Kazhdan property for elementary groups

In 2010, Invent. Math., Ershov and Jaikin-Zapirain proved Kazhdan's property (T) for elementary groups. This expository article focuses on presenting an alternative simpler proof of that. Unlike the original one, our proof supplies no estimate of Kazhdan constants. It may be regarded as a specific example of the results in the paper "Upgrading fixed points without bounded generation" (arXiv:1505.06728, forthcoming version) by the author.

math.GR

Superrigidity from Chevalley groups into acylindrically hyperbolic groups via quasi-cocycles

We prove that every homomorphism from the elementary Chevalley group over a finitely generated unital commutative ring associated with reduced irreducible classical root system of rank at least 2, and ME analogues of such groups, into acylindrically hyperbolic groups has an absolutely elliptic image. This result provides a non-arithmetic generalization of homomorphism superrigidity of Farb--Kaimanovich--Masur and Bridson--Wade.

math.GR

Strong algebraization of fixed point properties

The following natural question arises from Shalom's innovational work (1999, Publ. IHES): "Can we establish an intrinsic criterion to synthesize relative fixed point properties into the whole fixed point property without assuming Bounded Generation?" This paper resolves this question in the affirmative. Our criterion works for ones with respect to certain classes of Busemann NPC spaces. It, moreover, suggests a further step toward constructing super-expanders from finite simple groups of Lie type.

math.GR

On strong property (T) and fixed point properties for Lie groups

We consider certain strengthenings of property (T) relative to Banach spaces that are satisfied by high rank Lie groups. Let X be a Banach space for which, for all k, the Banach--Mazur distance to a Hilbert space of all k-dimensional subspaces is bounded above by a power of k strictly less than one half. We prove that every connected simple Lie group of sufficiently large real rank depending on X has strong property (T) of Lafforgue with respect to X. As a consequence, we obtain that every continuous affine isometric action of such a high rank group (or a lattice in such a group) on X has a fixed point. This result corroborates a conjecture of Bader, Furman, Gelander and Monod. For the special linear Lie groups, we also present a more direct approach to fixed point properties, or, more precisely, to the boundedness of quasi-cocycles. Without appealing to strong property (T), we prove that given a Banach space X as above, every special linear group of sufficiently large rank satisfies the following property: every quasi-1-cocycle with values in an isometric representation on X is bounded.

math.FA

Multi-way expanders and imprimitive group actions on graphs

For n at least 2, the concept of n-way expanders was defined by various researchers. Bigger n gives a weaker notion in general, and 2-way expanders coincide with expanders in usual sense. Koji Fujiwara asked whether these concepts are equivalent to that of ordinary expanders for all n for a sequence of Cayley graphs. In this paper, we answer his question in the affirmative. Furthermore, we obtain universal inequalities on multi-way isoperimetric constants on any finite connected vertex-transitive graph, and show that gaps between these constants imply the imprimitivity of the group action on the graph.

math.CO

Sphere equivalence, Banach expanders, and extrapolation

We study the Banach spectral gap lambda_1(G;X,p) of finite graphs G for pairs (X,p) of Banach spaces and exponents. We define the notion of sphere equivalence between Banach spaces and show a generalization of Matousek's extrapolation for Banach spaces sphere equivalent to uniformly convex ones. As a byproduct, we prove that expanders are automatically expanders with respects to (X,p) for any X sphere equivalent to a uniformly curved Banach space and for any p strictly bigger than 1.

math.GR

Group approximation in Cayley topology and coarse geometry, Part III: Geometric property (T)

In this series of papers, we study correspondence between the following: (1) large scale structure of the metric space bigsqcup_m {Cay(G(m))} consisting of Cayley graphs of finite groups with k generators; (2) structure of groups which appear in the boundary of the set {G(m)}_m in the space of k-marked groups. In this third part of the series, we show the correspondence among the metric properties `geometric property (T),' `cohomological property (T),' and the group property `Kazhdan's property (T).' Geometric property (T) of Willett--Yu is stronger than being expander graphs. Cohomological property (T) is stronger than geometric property (T) for general coarse spaces.

math.OA

Property $(TT)$ modulo $T$ and homomorphism superrigidity into mapping class groups

Every homomorphism from finite index subgroups of a universal lattices to mapping class groups of orientable surfaces (possibly with punctures), or to outer automorphism groups of finitely generated nonabelian free groups must have finite image. Here the universal lattice denotes the special linear group G=SL_m(Z[x1,...,xk]) with m at least 3 and k finite. Moreover, the same results hold ture if universal lattices are replaced with symplectic universal lattices Sp_{2m}(Z[x1,...,xk]) with m at least 2. These results can be regarded as a non-arithmetization of the theorems of Farb--Kaimanovich--Masur and Bridson--Wade. A certain measure equivalence analogue is also established. To show the statements above, we introduce a notion of property (TT)/T ("/T" stands for "modulo trivial part"), which is a weakening of property (TT) of N. Monod. Furthermore, symplectic universal lattices Sp_{2m}(Z[x1,...,xk]) with m at least 3 has the fixed point property for L^p-spaces for any p in (1,infinity).

math.GR

Fixed point property for universal lattice on Schatten classes

The special linear group G=SL_n(Z[x1,...,xk]) (n at least 3 and k finite) is called the universal lattice. Let n be at least 4, p be any real number in (1,\infty). The main result is the following: any finite index subgroup of G has the fixed point property with respect to every affine isometric action on the space of p-Schatten class operators. It is in addition shown that higher rank lattices have the same property. These results are generalization of previous theorems repsectively of the author and of Bader--Furman--Gelander--Monod, which treated commutative Lp-setting.

math.GR

Fixed point properties and second bounded cohomology of universal lattices on Banach space

Let B be any Lp space for p in (1,infty) or any Banach space isomorphic to a Hilbert space, and k be a nonnegative integer. We show that if n is at least 4, then the universal lattice Gamma =SL_n (Z[x1,...,xk]) has property (F_B) in the sense of Bader--Furman--Gelander--Monod. Namely, any affine isometric action of Gamma on B has a global fixed point. The property of having (F_B) for all B above is known to be strictly stronger than Kazhdan's property (T). We also define the following generalization of property (F_B)$ for a group: the boundedness property of all affine quasi-actions on B. We name it property (FF_B) and prove that the group Gamma above also has this property modulo trivial part. The conclusion above in particular implies that the comparison map in degree two H^2_b (Gamma; B) \to H^2(Gamma; B) from bounded to ordinary cohomology is injective, provided that the associated linear representation does not contain the trivial representation.

math.FA

On Quasi-homomorphisms and Commutators in the Special Linear Group over a Euclidean Ring

We prove that for any euclidean ring R and n at least 6, Gamma=SL_n(R) has no unbounded quasi-homomorphisms. From Bavard's duality theorem, this means that the stable commutator length vanishes on Gamma. The result is particularly interesting for R = F[x] for a certain field F (such as the field C of complex numbers, because in this case the commutator length on Gamma is known to be unbounded. This answers a question of M. Abért and N. Monod for n at least 6.

math.GR