🤖 AI Summary
To stably solve the nonlinear equation $g( heta)=0$ for its unique root $ heta^*$, this paper proposes the Up-crossing/Solving (US) algorithm—a novel open-method that requires no initial guess and avoids root isolation. Its core innovation lies in constructing a U-function based on a “direction-switching inequality,” incorporating first- through third-order derivative information; convergence is achieved iteratively via alternating up-crossing steps (U-function construction) and solving steps (analytical solution of the U-equation). Theoretically, the algorithm is proven to be strongly stable and globally convergent. Empirical evaluations demonstrate its superiority over conventional methods in quantile computation, exact p-value calculation for skewed distributions, and maximum likelihood estimation (MLE). Notably, it achieves both high accuracy and efficiency in parameter estimation for continuous and discrete distributions, as well as in robust multi-root scenarios.
📝 Abstract
In this paper, we propose a new and broadly applicable root-finding method, called as the upper-crossing/solution (US) algorithm, which belongs to the category of non-bracketing (or open domain) methods. The US algorithm is a general principle for iteratively seeking the unique root $ heta^{*}$ of a non-linear equation $g( heta)=0$ and its each iteration consists of two steps: an upper-crossing step (U-step) and a solution step (S-step), where the U-step finds an upper-crossing function or a $U$-function $U( heta| heta^{(t)})$ [whose form depends on $ heta^{(t)}$ being the $t$-th iteration of $ heta^{*}$] based on a new notion of so-called changing direction inequality, and the S-step solves the simple $U$-equation $U( heta| heta^{(t)}) =0$ to obtain its explicit solution $ heta^{(t+1)}$. The US algorithm holds two major advantages: (i) It strongly stably converges to the root $ heta^{*}$; and (ii) it does not depend on any initial values, in contrast to Newton's method. The key step for applying the US algorithm is to construct one simple $U$-function $U( heta| heta^{(t)})$ such that an explicit solution to the $U$-equation $U( heta| heta^{(t)}) =0$ is available. Based on the first-, second- and third-derivative of $g( heta)$, three methods are given for constructing such $U$-functions. We show various applications of the US algorithm in such as calculating quantile in continuous distributions, calculating exact $p$-values for skew null distributions, and finding maximum likelihood estimates of parameters in a class of continuous/discrete distributions. The analysis of the convergence rate of the US algorithm and some numerical experiments are also provided. Especially, because of the property of strongly stable convergence, the US algorithm could be one of the powerful tools for solving an equation with multiple roots.