SearcharxivSearch

arXiv subjects

Debasis Kundu

Publications and source records attributed to Debasis Kundu.

At least 19 recordsLinked to original sources

Least Absolute Deviations Estimation for Sinusoidal Models

We study robust parameter estimation in sinusoidal regression models within a least absolute deviations (LAD) framework. While classical approaches rely predominantly on least-squares formulations, they are known to be sensitive to heavy-tailed noise and outliers. We formulate the estimation problem as direct minimization of the LAD objective and propose a simple, modular coordinate descent algorithm that exploits the partial convexity of the objective: amplitude parameters are updated via weighted median computations, leading to substantial computational improvements over traditional simplex-based optimization methods, while frequency parameters are estimated via a periodogram-inspired grid search with local refinement. We establish strong consistency and asymptotic normality of the proposed estimator under mild regularity conditions. Empirically, we demonstrate the method's effectiveness on both synthetic datasets and real-world time series, including the Mauna Loa atmospheric CO2 data, air passenger data, and UK drivers' deaths data, where robustness to non-Gaussian noise is essential. The proposed approach provides a simple, interpretable, and robust alternative to least-squares-based methods for sinusoidal signal estimation.

stat.ME

Coordinate Descent Algorithm for Least Absolute Deviations Regression

Least Absolute Deviations (LAD) regression provides a robust alternative to ordinary least squares by minimizing the sum of absolute residuals. However, its widespread use has been limited by the computational cost of existing solvers, particularly simplex-based methods in high-dimensional settings. We propose a coordinate descent algorithm for LAD regression that avoids matrix inversion, naturally accommodates the non-differentiability of the objective function, and remains well-defined even when the number of predictors exceeds the number of observations. The key observation is that each coordinate update reduces to a one-dimensional minimization admitting a closed-form solution given by a median or weighted median. The resulting algorithm has per-iteration complexity $O(p\,n \log n)$ and is provably convergent due to the convexity of the LAD objective and the exactness of each coordinate update. Experiments on synthetic and real datasets show that the method matches the accuracy of linear-programming-based LAD solvers while offering improved scalability and stability in high-dimensional regimes, including cases where $p \ge n$. The method is easy to implement, requires no specialized optimization software, and provides a practical tool for robust linear models.

stat.ME

Modeling time to failure using a temporal sequence of events

In recent years, the requirement for real-time understanding of machine behavior has become an important objective in industrial sectors to reduce the cost of unscheduled downtime and to maximize production with expected quality. The vast majority of high-end machines are equipped with a number of sensors that can record event logs over time. In this paper, we consider an injection molding (IM) machine that manufactures plastic bottles for soft drink. We have analyzed the machine log data with a sequence of three type of events, ``running with alert'', ``running without alert'', and ``failure''. Failure event leads to downtime of the machine and necessitates maintenance. The sensors are capable of capturing the corresponding operational conditions of the machine as well as the defined states of events. This paper presents a new model to predict a) time to failure of the IM machine and b) identification of important sensors in the system that may explain the events which in-turn leads to failure. The proposed method is more efficient than the popular competitor and can help reduce the downtime costs by controlling operational parameters in advance to prevent failures from occurring too soon.

stat.ME

Estimation Method under Three-Parameter Generalized Exponential Model: Consistency, Uniqueness and its Applications

In numerous instances, the generalized exponential distribution can be used as an alternative to the most widely used non-regular family of distributions: Weibull, gamma, lognormal with three-parameters when analyzing lifetime or any skewed continuous data. A non-regular family is a class of probability distributions that do not satisfy the regularity conditions typically assumed in classical statistical inference. Some key features of such family of distributions are: support of its probability density function depends on one its parameters; its likelihood function may not be bounded for a certain range of parameter space, hence maximum likelihood estimators do not exist; the likelihood function even may not be differentiable or integrable as needed, hence Fisher Information may not exist or be infinite. Moreover, standard results like MLE existence, consistency, asymptotic normality may fail. Therefore, specialized or robust inferential techniques are needed. This article offers a consistent method for estimating the parameters of a three-parameter generalized exponential distribution that sidesteps the issue of an unbounded likelihood function. The method is hinged on a maximum likelihood estimation of shape and scale parameters that uses a location-invariant statistic. Important estimator properties, such as uniqueness and consistency, are demonstrated for the first time under this approach. In addition, quantile estimates for the assumed distribution are provided. We present a Monte Carlo simulation study along with comparisons to a number of well-known estimation techniques in terms of bias and root mean square error. For illustrative purposes, a real dataset from reliability engineering, has been analyzed and the goodness of fit along with the bootstrap confidence intervals are compared with existing traditional methods.

stat.ME

On estimating parameters of a multi-component Chirp Model with equal chirp rates

Multi-component chirp signal models with equal chirp rates appear in various radar applications, e.g., synthetic aperture radar, echo signal of a rapid mobile target, etc. Many sub-optimal estimators have been developed for such models, however, these suffer from the problem of either identifiability or error propagation effect. In this paper, we have developed theoretical properties of the least squares estimators (LSEs) of the parameters of multi-component chirp model with equal chirp rates, where the model is contaminated with linear stationary errors. We also propose two computationally efficient estimators as alternative to LSEs, namely sequential combined estimators and sequential plugin estimators. Strong consistency and asymptotic normality of these estimators have been derived. Interestingly, it is observed that sequential combined estimator of the chirp rate parameter is asymptotically efficient. Extensive numerical simulations have been performed, which validate satisfactory computational and theoretical performance of all three estimators. {We have also analysed a simulated radar data with the help of our proposed estimators of multi-component chirp model with equal chirp rates, which performs efficiently in recovery of inverse synthetic aperture radar (ISAR) image of a target from a noisy data.

stat.ME

Estimation methods for elementary chirp model parameters

In this paper, we propose some estimation techniques to estimate the elementary chirp model parameters, which are encountered in sonar, radar, acoustics, and other areas. We derive asymptotic theoretical properties of least squares estimators and approximate least squares estimators for the one-component elementary chirp model. It is proved that the proposed estimators are strongly consistent and follow the normal distribution asymptotically. We also suggest how to obtain proper initial values for these methods. The problem of finding initial values is a difficult problem when the number of components in the model is large, or when the signal-to-noise ratio is low, or when two frequency rates are close to each other. We propose sequential procedures to estimate the multiple-component elementary chirp model parameters. We prove that the theoretical properties of sequential least squares estimators and sequential approximate least squares estimators coincide with those of least squares estimators and approximate least squares estimators, respectively. To evaluate the performance of the proposed estimators, numerical experiments are performed. It is observed that the proposed sequential estimators perform well even in situations where least squares estimators do not perform well. We illustrate the performance of the proposed sequential algorithm on a bat data.

stat.ME

A Computationally Efficient algorithm to estimate the Parameters of a Two-Dimensional Chirp Model with the product term

Chirp signal models and their generalizations have been used to model many natural and man-made phenomena in signal processing and time series literature. In recent times, several methods have been proposed for parameter estimation of these models. These methods however are either statistically sub-optimal or computationally burdensome, specially for two dimensional (2D) chirp models. In this paper, we consider the problem of parameter estimation of 2D chirp models and propose a computationally efficient estimator and establish asymptotic theoretical properties of the proposed estimators. And the proposed estimators are observed to have the same rates of convergence as the least squares estimators (LSEs). Furthermore, the proposed estimators of chirp rate parameters are shown to be asymptotically optimal. Extensive and detailed numerical simulations are conducted, which support theoretical results of the proposed estimators.

stat.ME

Order Restricted Inference for Adaptive Progressively Censored Competing Risks Data

Under adaptive progressive Type-II censoring schemes, order restricted inference based on competing risks data is discussed in this article. The latent failure lifetimes for the competing causes are assumed to follow Weibull distributions, with an order restriction on the scale parameters of the distributions. The practical implication of this order restriction is that one of the risk factors is dominant, as often observed in competing risks scenarios. In this setting, likelihood estimation for the model parameters, along with bootstrap based techniques for constructing asymptotic confidence intervals are presented. Bayesian inferential methods for obtaining point estimates and credible intervals for the model parameters are also discussed. Through a detailed Monte Carlo simulation study, the performance of order restricted inferential methods are assessed. In addition, the results are also compared with the case when no order restriction is imposed on the estimation approach. The simulation study shows that order restricted inference is more efficient between the two, when this additional information is taken into consideration. A numerical example is provided for illustrative purpose.

stat.ME

Stationary GE-Process and its Application in Analyzing Gold Price Data

In this paper we introduce a new discrete time and continuous state space stationary process $\{X_n; n = 1, 2, \ldots \}$, such that $X_n$ follows a two-parameter generalized exponential (GE) distribution. Joint distribution functions, characterization and some dependency properties of this new process have been investigated. The GE-process has three unknown parameters, two shape parameters and one scale parameter, and due to this reason it is more flexible than the existing exponential process. In presence of the scale parameter, if the two shape parameters are equal, then the maximum likelihood estimators of the unknown parameters can be obtained by solving one non-linear equation and if the two shape parameters are arbitrary, then the maximum likelihood estimators can be obtained by solving a two dimensional optimization problem. Two {\color{black} synthetic} data sets, and one real gold-price data set have been analyzed to see the performance of the proposed model in practice. Finally some generalizations have been indicated.

q-fin.GN

Bayesian Inference of a Dependent Competing Risk Data

Analysis of competing risks data plays an important role in the lifetime data analysis. Recently Feizjavadian and Hashemi (Computational Statistics and Data Analysis, vol. 82, 19-34, 2015) provided a classical inference of a competing risks data set using four-parameter Marshall-Olkin bivariate Weibull distribution when the failure of an unit at a particular time point can happen due to more than one cause. The aim of this paper is to provide the Bayesian analysis of the same model based on a very flexible Gamma-Dirichlet prior on the scale parameters. It is observed that the Bayesian inference has certain advantages over the classical inference in this case. We provide the Bayes estimates of the unknown parameters and the associated highest posterior density credible intervals based on Gibbs sampling technique. We further consider the Bayesian inference of the model parameters assuming partially ordered Gamma-Dirichlet prior on the scale parameters when one cause is more severe than the other cause. We have extended the results for different censoring schemes also.

stat.ME

Analysis of Left Truncated and Right Censored Competing Risks Data

In this article, the analysis of left truncated and right censored competing risks data is carried out, under the assumption of the latent failure times model. It is assumed that there are two competing causes of failures, although most of the results can be extended for more than two causes of failures. The lifetimes corresponding to the competing causes of failures are assumed to follow Weibull distributions with the same shape parameter but different scale parameters. The maximum likelihood estimation procedure of the model parameters is discussed, and confidence intervals are provided using the bootstrap approach. When the common shape parameter is known, the maximum likelihood estimators of the scale parameters can be obtained in explicit forms, and when it is unknown we provide a simple iterative procedure to compute the maximum likelihood estimator of the shape parameter. The Bayes estimates and the associated credible intervals of unknown parameters are also addressed under a very flexible set of priors on the shape and scale parameters. Extensive Monte Carlo simulations are performed to compare the performances of the different methods. A numerical example is provided for illustrative purposes. Finally the results have been extended when the two competing causes of failures are assumed to be independent Weibull distributions with different shape parameters.

stat.ME

An efficient methodology to estimate the parameters of a two-dimensional chirp signal model

In various capacities of statistical signal processing two-dimensional (2-D) chirp models have been considered significantly, particularly in image processing$-$ to model gray-scale and texture images, magnetic resonance imaging, optical imaging etc. In this paper we address the problem of estimation of the unknown parameters of a 2-D chirp model under the assumption that the errors are independently and identically distributed (i.i.d.). The key attribute of the proposed estimation procedure is that it is computationally more efficient than the least squares estimation method. Moreover, the proposed estimators are observed to have the same asymptotic properties as the least squares estimators, thus providing computational effectiveness without any compromise on the efficiency of the estimators. We extend the propounded estimation method to provide a sequential procedure to estimate the unknown parameters of a 2-D chirp model with multiple components and under the assumption of i.i.d. errors we study the large sample properties of these sequential estimators. Simulation studies and a synthetic data analysis show that the proposed estimators perform satisfactorily.

stat.ME

Estimating the fundamental frequency using modified Newton-Raphson algorithm

In this paper, we propose a modified Newton-Raphson algorithm to estimate the frequency parameter in the fundamental frequency model in presence of an additive stationary error. The proposed estimator is super efficient in nature in the sense that its asymptotic variance is less than the asymptotic variance of the least squares estimator. With a proper step factor modification, the proposed modified Newton-Raphson algorithm produces an estimator with the rate $O_p(n^{-\frac{3}{2}})$, the same rate as the least squares estimator. Numerical experiments are performed for different sample sizes, different error variances and for different models. For illustrative purposes, two real data sets are analyzed using the fundamental frequency model and the estimators are obtained using the proposed algorithm. It is observed the model and the proposed algorithm work quite well in both cases.

math.ST

Parameter Estimation of absolute continuous four parameter Geometric Marshall-Olkin bivariate Pareto Distribution

In this paper we formulate a four parameter absolute continuous Geometric Marshall-Olkin bivariate Pareto distribution and study its parameter estimation through EM algorithm and also explore the bayesian analysis through slice cum Gibbs sampler approach. Numerical results are shown to verify the performance of the algorithms. We illustrate the procedures through a real life data analysis.

stat.ME

Asymptotic of Approximate Least Squares Estimators of Parameters Two-Dimensional Chirp Signal

In this paper, we address the problem of parameter estimation of a 2-D chirp model under the assumption that the errors are stationary. We extend the 2-D periodogram method for the sinusoidal model, to find initial values to use in any iterative procedure to compute the least squares estimators (LSEs) of the unknown parameters, to the 2-D chirp model. Next we propose an estimator, known as the approximate least squares estimator (ALSE), that is obtained by maximising a periodogram-type function and is observed to be asymptotically equivalent to the LSE. Moreover the asymptotic properties of these estimators are obtained under slightly mild conditions than those required for the LSEs. For the multiple component 2-D chirp model, we propose a sequential method of estimation of the ALSEs, that significantly reduces the computational difficulty involved in reckoning the LSEs and the ALSEs. We perform some simulation studies to see how the proposed method works and a data set has been analysed for illustrative purposes.

stat.ME

Simple Step-Stress Models with a Cure Fraction

In this article, we consider models for time-to-event data obtained from experiments in which stress levels are altered at intermediate stages during the observation period. These experiments, known as step-stress tests, belong to the larger class of accelerated tests used extensively in the reliability literature. The analysis of data from step-stress tests largely relies on the popular cumulative exposure model. However, despite its simple form, the utility of the model is limited, as it is assumed that the hazard function of the underlying distribution is discontinuous at the points at which the stress levels are changed, which may not be very reasonable. Due to this deficiency, Kannan et al. \cite{KKNT:2010} introduced the cumulative risk model, where the hazard function is continuous. In this paper we propose a class of parametric models based on the cumulative risk model assuming the underlying population contains long-term survivors or `cured' fraction. An EM algorithm to compute the maximum likelihood estimators of the unknown parameters is proposed. This research is motivated by a study on altitude decompression sickness. The performance of different parametric models will be evaluated using data from this study.

stat.AP

Estimation of Parameters of Multiple Chirp Signal in presence of Heavy Tailed Errors

In this paper, we consider the estimation of the unknown parameters of the multiple chirp signal model in presence of additive error. The chirp signals are quite common in many areas of science and engineering, specially sonar, radar, audio signals etc. The observed signals are usually corrupted by noise. In different signal processing applications it is observed that the errors may be heavy tailed. In this paper it is assumed that the additive errors have mean zero but may not have finite variance and are independent and identically distributed. We consider the least squares estimators and the approximate least squares estimators which maximize a periodogram like function. It has been observed that both the estimators are strongly consistent. The asymptotic distribution of the least squares estimators is obtained under the assumption that the additive errors are from a symmetric stable distribution. The approximate least squares estimators have the same asymptotic distribution as the least squares estimators. We perform some numerical simulations to see how the proposed estimators work. It is observed that the least squares estimators perform slightly better than the approximately least squares estimators in terms of the biases and mean absolute deviation.

eess.SP

A new decision theoretic sampling plan for type-I and type-I hybrid censored samples from the exponential distribution

The study proposes a new decision theoretic sampling plan (DSP) for Type-I and Type-I hybrid censored samples when the lifetimes of individual items are exponentially distributed with a scale parameter. The DSP is based on an estimator of the scale parameter which always exists, unlike the MLE which may not always exist. Using a quadratic loss function and a decision function based on the proposed estimator, a DSP is derived. To obtain the optimum DSP, a finite algorithm is used. Numerical results demonstrate that in terms of the Bayes risk, the optimum DSP is as good as the Bayesian sampling plan (BSP) proposed by \cite{lin2002bayesian} and \cite{liang2013optimal}. The proposed DSP performs better than the sampling plan of \cite{Lam1994bayesian} and \cite{lin2008-10exact} in terms of Bayes risks. The main advantage of the proposed DSP is that for higher degree polynomial and non-polynomial loss functions, it can be easily obtained as compared to the BSP.

stat.ME