SearcharxivSearch

arXiv subjects

Youngmi Hur

Publications and source records attributed to Youngmi Hur.

16 recordsLinked to original sources

Detail Loss in Super-Resolution Models Based on the Laplacian Pyramid and Repeated Upscaling and Downscaling Process

With advances in artificial intelligence, image processing has gained significant interest. Image super-resolution is a vital technology closely related to real-world applications, as it enhances the quality of existing images. Since enhancing fine details is crucial for the super-resolution task, pixels that contribute to high-frequency information should be emphasized. This paper proposes two methods to enhance high-frequency details in super-resolution images: a Laplacian pyramid-based detail loss and a repeated upscaling and downscaling process. Total loss with our detail loss guides a model by separately generating and controlling super-resolution and detail images. This approach allows the model to focus more effectively on high-frequency components, resulting in improved super-resolution images. Additionally, repeated upscaling and downscaling amplify the effectiveness of the detail loss by extracting diverse information from multiple low-resolution features. We conduct two types of experiments. First, we design a CNN-based model incorporating our methods. This model achieves state-of-the-art results, surpassing all currently available CNN-based and even some attention-based models. Second, we apply our methods to existing attention-based models on a small scale. In all our experiments, attention-based models adding our detail loss show improvements compared to the originals. These results demonstrate our approaches effectively enhance super-resolution images across different model structures.

cs.CV

Provable wavelet-based neural approximation

In this paper, we develop a wavelet-based theoretical framework for analyzing the universal approximation capabilities of neural networks over a wide range of activation functions. Leveraging wavelet frame theory on the spaces of homogeneous type, we derive sufficient conditions on activation functions to ensure that the associated neural network approximates any functions in the given space, along with an error estimate. These sufficient conditions accommodate a variety of smooth activation functions, including those that exhibit oscillatory behavior. Furthermore, by considering the $L^2$-distance between smooth and non-smooth activation functions, we establish a generalized approximation result that is applicable to non-smooth activations, with the error explicitly controlled by this distance. This provides increased flexibility in the design of network architectures.

cs.LG

Simplifying Formal Proof-Generating Models with ChatGPT and Basic Searching Techniques

The challenge of formal proof generation has a rich history, but with modern techniques, we may finally be at the stage of making actual progress in real-life mathematical problems. This paper explores the integration of ChatGPT and basic searching techniques to simplify generating formal proofs, with a particular focus on the miniF2F dataset. We demonstrate how combining a large language model like ChatGPT with a formal language such as Lean, which has the added advantage of being verifiable, enhances the efficiency and accessibility of formal proof generation. Despite its simplicity, our best-performing Lean-based model surpasses all known benchmarks with a 31.15% pass rate. We extend our experiments to include other datasets and employ alternative language models, showcasing our models' comparable performance in diverse settings and allowing for a more nuanced analysis of our results. Our findings offer insights into AI-assisted formal proof generation, suggesting a promising direction for future research in formal mathematical proof.

cs.LO

Design of Wavelet Filter Banks for Any Dilation Using Extended Laplacian Pyramid Matrices

In this paper, we present a new method for designing wavelet filter banks for any dilation matrices and in any dimension. Our approach utilizes extended Laplacian pyramid matrices to achieve this flexibility. By generalizing recent tight wavelet frame construction methods based on the sum of squares representation, we introduce the sum of vanishing products (SVP) condition, which is significantly easier to satisfy. These flexible design methods rely on our main results, which establish the equivalence between the SVP and mixed unitary extension principle conditions. Additionally, we provide illustrative examples to showcase our main findings.

cs.IT

New Tight Wavelet Frame Constructions Sharing Responsibility

Tight wavelet frames (TWFs) in \(L^2(\mathbb{R}^n)\) are versatile, and are practically useful due to their perfect reconstruction property. Nevertheless, existing TWF construction methods exhibit limitations, including a lack of specific methods for generating mother wavelets in extension-based construction, and the necessity to address the sum of squares (SOS) problem even when specific methods for generating mother wavelets are provided in SOS-based construction. Many TWF constructions begin with a given refinable function. However, this approach places the entire burden on finding suitable mother wavelets. In this paper, we introduce TWF construction methods that spread the burden between both types of functions: refinable functions and mother wavelets. These construction methods offer an alternative approach to addressing the SOS problem. We present examples to illustrate our construction methods.

math.FA

Wavelet series expansion in Hardy spaces with approximate duals

In this paper, we provide sufficient conditions for the functions $\psi$ and $\phi$ to be the approximate duals in the Hardy space $H^p(\mathbb{R})$ for all $0<p\leq1$. Based on these conditions, we obtain the wavelet series expansion in the Hardy space with the approximate duals. The important properties of our approach include the following: (i) our results work for any $0<p\leq1$; (ii) we do not assume that the functions $\psi$ and $\phi$ are exact duals; (iii) we provide a tractable bound for the operator norm of the associated wavelet frame operator so that it is possible to check the suitability of the functions $\psi$ and $\phi$.

math.CA

Laplacian Pyramid-like Autoencoder

In this paper, we develop the Laplacian pyramid-like autoencoder (LPAE) by adding the Laplacian pyramid (LP) concept widely used to analyze images in Signal Processing. LPAE decomposes an image into the approximation image and the detail image in the encoder part and then tries to reconstruct the original image in the decoder part using the two components. We use LPAE for experiments on classifications and super-resolution areas. Using the detail image and the smaller-sized approximation image as inputs of a classification network, our LPAE makes the model lighter. Moreover, we show that the performance of the connected classification networks has remained substantially high. In a super-resolution area, we show that the decoder part gets a high-quality reconstruction image by setting to resemble the structure of LP. Consequently, LPAE improves the original results by combining the decoder part of the autoencoder and the super-resolution network.

cs.CV

Tight Wavelet Filter Banks with Prescribed Directions

Constructing tight wavelet filter banks with prescribed directions is challenging. This paper presents a systematic method for designing a tight wavelet filter bank, given any prescribed directions. There are two types of wavelet filters in our tight wavelet filter bank. One type is entirely determined by the prescribed information about the directionality and makes the wavelet filter bank directional. The other type helps the wavelet filter bank to be tight. In addition to the flexibility in choosing the directions, our construction method has other useful properties. It works for any multi-dimension, and it allows the user to have any prescribed number of vanishing moments along the chosen directions. Furthermore, our tight wavelet filter banks have fast algorithms for analysis and synthesis. Concrete examples are given to illustrate our construction method and properties of resulting tight wavelet filter banks.

math.NA

Invertibility of circulant matrices of arbitrary size

In this paper, we present sufficient conditions to guarantee the invertibility of rational circulant matrices with any given size. These sufficient conditions consist of linear combinations of the entries in the first row with integer coefficients. Our result is general enough to show the invertibility of circulant matrices with any size and arrangement of entries. For example, using these conditions, we show the invertibility of the family of circulant matrices with particular forms of integers generated by a primitive element in $\mathbb{Z}_p$. Also, using a combinatorial structure of these sufficient conditions, we show invertibility for circulant $0, 1$-matrices.

math.GM

Deep Scattering Network with Max-pooling

Scattering network is a convolutional network, consisting of cascading convolutions using pre-defined wavelets followed by the modulus operator. Since its introduction in 2012, the scattering network is used as one of few mathematical tools explaining components of the convolutional neural networks (CNNs). However, a pooling operator, which is one of main components of conventional CNNs, is not considered in the original scattering network. In this paper, we propose a new network, called scattering-maxp network, integrating the scattering network with the max-pooling operator. We model continuous max-pooling, apply it to the scattering network, and get the scattering-maxp network. We show that the scattering-maxp network shares many useful properties of the scattering network including translation invariance, but with much smaller number of parameters. Numerical experiments show that the use of scattering-maxp does not degrade the performance too much and is much faster than the original one, in image classification tasks.

math.NA

Multivariate Tight Wavelet Frames with Few Generators and High Vanishing Moments

Tight wavelet frames are computationally and theoretically attractive, but most existing multivariate constructions have various drawbacks, including low vanishing moments for the wavelets, or a large number of wavelet masks. We further develop existing work combining sums of squares representations with tight wavelet frame construction, and present a new and general method for constructing such frames. Focusing on the case of box splines, we also demonstrate how the flexibility of our approach can lead to tight wavelet frames with high numbers of vanishing moments for all of the wavelet masks, while still having few highpass masks: in fact, we match the best known upper bound on the number of highpass masks for general box spline tight wavelet frame constructions, while typically achieving much better vanishing moments for all of the wavelet masks, proving a nontrivial lower bound on this quantity.

math.FA

Scaling Laplacian Pyramids

Laplacian pyramid based Laurent polynomial (LP$^2$) matrices are generated by Laurent polynomial column vectors and have long been studied in connection with Laplacian pyramidal algorithms in Signal Processing. In this paper, we investigate when such matrices are scalable, that is when right multiplication by Laurent polynomial diagonal matrices results in paraunitary matrices. The notion of scalability has recently been introduced in the context of finite frame theory and can be considered as a preconditioning method for frames. This paper significantly extends the current research on scalable frames to the setting of polyphase representations of filter banks. Furthermore, as applications of our main results we propose new construction methods for tight wavelet filter banks and tight wavelet frames.

math.FA

Generalizations of the Maillet Determinant

We consider several extensions of the Maillet determinant studied by Malo, Turnbull, and Carlitz and Olson, and derive properties of the underlying matrices. In particular, we compute the eigenvectors and eigenvalues of these matrices, which yield formulas for these new determinants.

math.RA

Prime Coset Sum: A Systematic Method for Designing Multi-D Wavelet Filter Banks with Fast Algorithms

As constructing multi-D wavelets remains a challenging problem, we propose a new method called prime coset sum to construct multi-D wavelets. Our method provides a systematic way to construct multi-D non-separable wavelet filter banks from two 1-D lowpass filters, with one of whom being interpolatory. Our method has many important features including the following: 1) it works for any spatial dimension, and any prime scalar dilation, 2) the vanishing moments of the multi-D wavelet filter banks are guaranteed by certain properties of the initial 1-D lowpass filters, and furthermore, 3) the resulting multi-D wavelet filter banks are associated with fast algorithms that are faster than the existing fast tensor product algorithms.

math.NA

Committee Algorithm: An Easy Way to Construct Wavelet Filter Banks

Given a lowpass filter, finding a dual lowpass filter is an essential step in constructing non-redundant wavelet filter banks. Obtaining dual lowpass filters is not an easy task. In this paper, we introduce a new method called committee algorithm that builds a dual filter straightforwardly from two easily-constructible lowpass filters. It allows to design a wide range of new wavelet filter banks. An example based on the family of Burt-Adelson's 1-D Laplacian filters is given.

math.NA

Coset Sum: an alternative to the tensor product in wavelet construction

A multivariate biorthogonal wavelet system can be obtained from a pair of multivariate biorthogonal refinement masks in Multiresolution Analysis setup. Some multivariate refinement masks may be decomposed into lower dimensional refinement masks. Tensor product is a popular way to construct a decomposable multivariate refinement mask from lower dimensional refinement masks. We present an alternative method, which we call coset sum, for constructing multivariate refinement masks from univariate refinement masks. The coset sum shares many essential features of the tensor product that make it attractive in practice: (1) it preserves the biorthogonality of univariate refinement masks, (2) it preserves the accuracy number of the univariate refinement mask, and (3) the wavelet system associated with it has fast algorithms for computing and inverting the wavelet coefficients. The coset sum can even provide a wavelet system with faster algorithms in certain cases than the tensor product. These features of the coset sum suggest that it is worthwhile to develop and practice alternative methods to the tensor product for constructing multivariate wavelet systems. Some experimental results using 2-D images are presented to illustrate our findings.

math.NA