TL;DR: Automated Lyapunov analysis for first-order methods establishes the existence of quadratic Lyapunov inequalities for a wide range of first-order methods used to solve convex optimization problems.
Abstract: Abstract We present a methodology for establishing the existence of quadratic Lyapunov inequalities for a wide range of first-order methods used to solve convex optimization problems. In particular, we consider (i) classes of optimization problems of finite-sum form with (possibly strongly) convex and possibly smooth functional components, (ii) first-order methods that can be written as a linear system on state-space form in feedback interconnection with the subdifferentials of the functional components of the objective function, and (iii) quadratic Lyapunov inequalities that can be used to draw convergence conclusions. We present a necessary and sufficient condition for the existence of a quadratic Lyapunov inequality within a predefined class of Lyapunov inequalities, which amounts to solving a small-sized semidefinite program. We showcase our methodology on several first-order methods that fit the framework. Most notably, our methodology allows us to significantly extend the region of parameter choices that allow for duality gap convergence in the Chambolle–Pock method when the linear operator is the identity mapping.
TL;DR: Optimization of numerical solutions of stochastic differential equations with time delay focuses on investigating the characteristics of approximate solutions, including stability and boundedness.
Abstract: Abstract The research focuses on the optimization of numerical solutions of neutral stochastic differential equations with time delay. Analyzing approaches such as Euler-Maruyama, backward Euler, and θ -Euler-Maruyama methods, the goal is to investigate the characteristics of approximate solutions, especially stability and boundedness. This study contributes to the understanding of the complexity of stochastic processes, offering a perspective for further mathematical modeling and optimization. The study of the characteristics of approximate solutions includes a detailed analysis of their stability and limitations, providing insight into the system’s behavior in dynamic conditions. This analysis lays the foundations for the improvement of numerical methods and more precise modeling of stochastic processes with time delay. The aforementioned approaches, such as the Euler-Maruyama, backward Euler, and θ -Euler-Maruyama methods, provide tools for understanding and solving complex mathematical challenges. Through an interdisciplinary approach, this study sheds light on the field of optimization of numerical solutions, encouraging further development of theoretical and practical aspects of stochastic differential equations.
TL;DR: A novel third-order numerical method is developed for solving nonlinear fractional ordinary differential equations, transforming them into Volterra integral equations and using a time-stepping algorithm with a mesh parameter h, achieving O(h^3) convergence.
Abstract: In this paper, we developed a novel numerical method for solving general nonlinear fractional ordinary differential equations (FODEs). First, we transformed the nonlinear FODEs into the equivalent Volterra integral equations. We then developed a time-stepping algorithm for the numerical solution of the Volterra integral equations based on the third-order Taylor expansion for approximating the integrands in the Volterra integral equations on a chosen mesh with the mesh parameter $ h $. This approximation led to implicit nonlinear algebraic equations in the unknowns at each given mesh point, and an iterative algorithm based on Newton's method was developed to solve the resulting implicit equations. A convergence analysis of this numerical scheme showed that the error between the exact solution and numerical solution at each mesh point is $ \mathcal{O}(h^{3}) $, independent of the fractional order. Finally, four numerical examples were solved to verify the theoretical results and demonstrate the effectiveness of the proposed method.
TL;DR: In this article , the authors considered the numerical approximation of a two dimensional elliptic singularly perturbed weakly-coupled system of convection-reaction-diffusion type, which has two different parameters affecting the diffusion and the convection terms, respectively.
TL;DR: The parametrization of nonconvex optimization landscapes is studied. Relations between landscapes of paired problems are analyzed. The framework enables new guarantees for various optimization problems.
Abstract: Abstract We develop new tools to study landscapes in nonconvex optimization. Given one optimization problem, we pair it with another by smoothly parametrizing the domain. This is either for practical purposes (e.g., to use smooth optimization algorithms with good guarantees) or for theoretical purposes (e.g., to reveal that the landscape satisfies a strict saddle property). In both cases, the central question is: how do the landscapes of the two problems relate? More precisely: how do desirable points such as local minima and critical points in one problem relate to those in the other problem? A key finding in this paper is that these relations are often determined by the parametrization itself, and are almost entirely independent of the cost function. Accordingly, we introduce a general framework to study parametrizations by their effect on landscapes. The framework enables us to obtain new guarantees for an array of problems, some of which were previously treated on a case-by-case basis in the literature. Applications include: optimizing low-rank matrices and tensors through factorizations; solving semidefinite programs via the Burer–Monteiro approach; training neural networks by optimizing their weights and biases; and quotienting out symmetries.
TL;DR: The COS method is an efficient numerical method for pricing European options. An explicit bound for the number of terms N is found for pricing and sensitivities under smooth density assumptions. The method has an exponential order of convergence when the density is smooth and decays exponentially.
Abstract: Abstract The Fourier-cosine expansion (COS) method is used to price European options numerically in a very efficient way. To apply the COS method, one has to specify two parameters: a truncation range for the density of the log-returns and a number of terms N to approximate the truncated density by a cosine series. How to choose the truncation range is already known. Here, we are able to find an explicit and useful bound for N as well for pricing and for the sensitivities, i.e., the Greeks Delta and Gamma, provided the density of the log-returns is smooth. We further show that the COS method has an exponential order of convergence when the density is smooth and decays exponentially. However, when the density is smooth and has heavy tails, as in the Finite Moment Log Stable model, the COS method does not have exponential order of convergence. Numerical experiments confirm the theoretical results.
TL;DR: A randomized operator splitting scheme inspired by stochastic optimization methods significantly reduces computational cost compared to deterministic splitting schemes.
Abstract: Abstract In this paper, we combine the operator splitting methodology for abstract evolution equations with that of stochastic methods for large-scale optimization problems. The combination results in a randomized splitting scheme, which in a given time step does not necessarily use all the parts of the split operator. This is in contrast to deterministic splitting schemes which always use every part at least once, and often several times. As a result, the computational cost can be significantly decreased in comparison to such methods. We rigorously define a randomized operator splitting scheme in an abstract setting and provide an error analysis where we prove that the temporal convergence order of the scheme is at least 1/2. We illustrate the theory by numerical experiments on both linear and quasilinear diffusion problems, using a randomized domain decomposition approach. We conclude that choosing the randomization in certain ways may improve the order to 1. This is as accurate as applying e.g. backward (implicit) Euler to the full problem, without splitting.
TL;DR: Initialisation in lattice Boltzmann methods is similar to one-step and multi-step finite difference methods. Modified equations for initialisation are derived based on the choice of initial data. The number of matched terms between modified equations and bulk methods determines the smoothness of the numerical solution. The lack of observability for certain lattice Boltzmann schemes can yield simple initialisation conditions.
Abstract: Latitude on the choice of initialisation is a shared feature between one-step extended state-space and multi-step methods. The paper focuses on lattice Boltzmann schemes, which can be interpreted as examples of both previous categories of numerical schemes. We propose a modified equation analysis of the initialisation schemes for lattice Boltzmann methods, determined by the choice of initial data. These modified equations provide guidelines to devise and analyze the initialisation in terms of order of consistency with respect to the target Cauchy problem and time smoothness of the numerical solution. In detail, the larger the number of matched terms between modified equations for initialisation and bulk methods, the smoother the obtained numerical solution. This is particularly manifest for numerical dissipation. Starting from the constraints to achieve time smoothness, which can quickly become prohibitive for they have to take the parasitic modes into consideration, we explain how the distinct lack of observability for certain lattice Boltzmann schemes—seen as dynamical systems on a commutative ring—can yield rather simple conditions and be easily studied as far as their initialisation is concerned. This comes from the reduced number of initialisation schemes at the fully discrete level. These theoretical results are successfully assessed on several lattice Boltzmann methods.
TL;DR: Trefftz discontinuous Galerkin discretization for the Stokes problem introduces a new method that fulfills Stokes equations pointwise within each element and yields element-wise divergence-free solutions with a reduced number of degrees of freedom compared to standard DG methods.
Abstract: Abstract We introduce a new discretization based on a polynomial Trefftz-DG method for solving the Stokes equations. Discrete solutions of this method fulfill the Stokes equations pointwise within each element and yield element-wise divergence-free solutions. Compared to standard DG methods, a strong reduction of the degrees of freedom is achieved, especially for higher polynomial degrees. In addition, in contrast to many other Trefftz-DG methods, our approach allows us to easily incorporate inhomogeneous right-hand sides (driving forces) by using the concept of the embedded Trefftz-DG method. On top of a detailed a priori error analysis, we further compare our approach to other (hybrid) discontinuous Galerkin Stokes discretizations and present numerical examples.
TL;DR: Novel numerical methods based on affine-splitting pseudo-spectral methods are highly effective for solving fractional complex Ginzburg-Landau equations. The methods are accurate, computationally efficient, and applicable to both reversible and irreversible models.
Abstract: We evaluate the performance of novel numerical methods for solving one-dimensional nonlinear fractional dispersive and dissipative evolution equations. The methods are based on affine combinations of time-splitting integrators and pseudo-spectral discretizations using Hermite and Fourier expansions. We show the effectiveness of the proposed methods by numerically computing the dynamics of soliton solutions of the standard and fractional variants of the nonlinear Schrödinger equation (NLSE) and the complex Ginzburg-Landau equation (CGLE), and by comparing the results with those obtained by standard splitting integrators. An exhaustive numerical investigation shows that the new technique is competitive when compared to traditional composition-splitting schemes for the case of Hamiltonian problems both in terms accuracy and computational cost. Moreover, it is applicable straightforwardly to irreversible models, outperforming high-order symplectic integrators which could become unstable due to their need of negative time steps. Finally, we discuss potential improvements of the numerical methods aimed to increase their efficiency, and possible applications to the investigation of dissipative solitons that arise in nonlinear optical systems of contemporary interest. Overall, the method offers a promising alternative for solving a wide range of evolutionary partial differential equations.
TL;DR: The paper investigates strategies to improve the efficiency of ADER methods for solving differential problems. It focuses on improving the order of accuracy and introducing efficient p-adaptive modifications.
Abstract: The (modern) arbitrary derivative (ADER) approach is a popular technique for the numerical solution of differential problems based on iteratively solving an implicit discretization of their weak formulation. In this work, focusing on an ODE context, we investigate several strategies to improve this approach. Our initial emphasis is on the order of accuracy of the method in connection with the polynomial discretization of the weak formulation. We demonstrate that precise choices lead to higher-order convergences in comparison to the existing literature. Then, we put ADER methods into a Deferred Correction (DeC) formalism. This allows to determine the optimal number of iterations, which is equal to the formal order of accuracy of the method, and to introduce efficient p-adaptive modifications. These are defined by matching the order of accuracy achieved and the degree of the polynomial reconstruction at each iteration. We provide analytical and numerical results, including the stability analysis of the new modified methods, the investigation of the computational efficiency, an application to adaptivity and an application to hyperbolic PDEs with a Spectral Difference (SD) space discretization.
TL;DR: Thick-restart Lanczos bidiagonalization for the GSVD is an efficient method for computing the partial GSVD of large-scale matrix pairs.
Abstract: The computation of the partial generalized singular value decomposition (GSVD) of large-scale matrix pairs can be approached by means of iterative methods based on expanding subspaces, particularly Krylov subspaces. We consider the joint Lanczos bidiagonalization method, and analyze the feasibility of adapting the thick restart technique that is being used successfully in the context of other linear algebra problems. Numerical experiments illustrate the effectiveness of the proposed method. We also compare the new method with an alternative solution via equivalent eigenvalue problems, considering accuracy as well as computational performance. The analysis is done using a parallel implementation in the SLEPc library.
TL;DR: A hybrid numerical scheme combining Lucas-Fibonacci polynomials and Störmer's method is proposed for solving nonlinear Klein/Sinh-Gordon equations, demonstrating superior accuracy and convergence in one and two-dimensional problems compared to existing solutions.
Abstract: <p>In this article, a hybrid numerical scheme based on Lucas and Fibonacci polynomials in combination with Störmer's method for the solution of Klein/Sinh-Gordon equations is proposed. Initially, the problem is transformed to a time-discrete form by using Störmer's technique. Then, with the help of Fibonacci polynomials, we approximate the derivatives of the function. The suggested technique is validated to both one and two-dimensional problems. The resultant findings are compared with existing numerical solutions and presented in a tabular form. The comparison reveals the superior accuracy of the scheme. The numerical convergence of the scheme is computed in each example.</p>
TL;DR: A 3D fluid-structure-coupled simulation investigates the hydrodynamic performance of a flexible caudal fin with different trailing-edge shapes, comparing a square fin to forked and deeply forked designs under various non-dimensional flapping frequencies.
Abstract: This paper presents a three-dimensional fluid-structure-coupled simulation of a flexible caudal fin with different trailing-edge shapes. The influences of caudal-fin shape on hydrodynamic performance are investigated by comparing the results of a simplified model of a square caudal fin with forked and deeply forked caudal fins under a wider range of non-dimensional flapping frequency, 0.6 <
TL;DR: The paper presents an adaptive hybrid high-order method for guaranteed lower eigenvalue bounds that utilizes a new inequality with a constant $$C_{\text {st},2}$$ Cst,2 to design a modified hybrid high-order eigensolver.
Abstract: Abstract The higher-order guaranteed lower eigenvalue bounds of the Laplacian in the recent work by Carstensen et al. (Numer Math 149(2):273–304, 2021) require a parameter $$C_{\text {st},1}$$ Cst,1 that is found not robust as the polynomial degree p increases. This is related to the $$H^1$$ H1 stability bound of the $$L^{2}$$ L2 projection onto polynomials of degree at most p and its growth $$C_{\textrm{st, 1}}\propto (p+1)^{1/2}$$ Cst, 1∝(p+1)1/2 as $$p \rightarrow \infty $$ p→∞ . A similar estimate for the Galerkin projection holds with a p -robust constant $$C_{\text {st},2}$$ Cst,2 and $$C_{\text {st},2} \le 2$$ Cst,2≤2 for right-isosceles triangles. This paper utilizes the new inequality with the constant $$C_{\text {st},2}$$ Cst,2 to design a modified hybrid high-order eigensolver that directly computes guaranteed lower eigenvalue bounds under the idealized hypothesis of exact solve of the generalized algebraic eigenvalue problem and a mild explicit condition on the maximal mesh-size in the simplicial mesh. A key advance is a p -robust parameter selection. The analysis of the new method with a different fine-tuned volume stabilization allows for a priori quasi-best approximation and improved $$L^{2}$$ L2 error estimates as well as a stabilization-free reliable and efficient a posteriori error control. The associated adaptive mesh-refining algorithm performs superior in computer benchmarks with striking numerical evidence for optimal higher empirical convergence rates.
TL;DR: Numerical schemes for singular fractional integro-differential equations with singular behavior at the origin. Existence, uniqueness, regularity and numerical approximation.
Abstract: We consider a class of fractional integro-differential equations with certain type of singularities at the origin. Using a change of variables we reformulate the original problem as a cordial Volterra integral equation and study the existence, uniqueness and regularity of the exact solution. With the help of the obtained information we construct a collocation based numerical method for finding the approximate solution of the original problem and analyse the convergence and the convergence order of the proposed method. We also give some numerical examples.
TL;DR: The gradient discretisation method (GDM) is applied to a stochastic Stefan problem with multiplicative noise, proving convergence using compactness method and discrete functional analysis tools, with generic results applicable to various numerical methods.
Abstract: The gradient discretisation method (GDM) – a generic framework encompassing many numerical methods – is studied for a general stochastic Stefan problem with multiplicative noise. The convergence of the numerical solutions is proved by compactness method using discrete functional analysis tools, Skorokhod theorem and the martingale representation theorem. The generic convergence results established in the GDM framework are applicable to a range of different numerical methods, including for example mass-lumped finite elements, but also some finite volume methods, mimetic methods, lowest-order virtual element methods, etc. Theoretical results are complemented by numerical tests based on two methods that fit in GDM framework.
TL;DR: Model correlation techniques using transformation matrix T to detect discrepancies in mass and stiffness between numerical and experimental models.
Abstract: Model correlation techniques are methods used to compare two different models, usually a numerical model and an experimental model. According to the structural dynamic modification theory, the experimental mode shapes estimated by modal analysis can be expressed as a linear combination of the numerical mode shapes through a transformation matrix T. In this paper, matrix T is proposed as a novel model correlation technique to detect discrepancies between the numerical and the experimental models in terms of mass. The discrepancies in stiffness can be identified by combining the numerical natural frequencies and the matrix T. This methodology can be applied to correlate the numerical and experimental results of civil (bridges, dams, towers, buildings, etc.), aerospace and mechanical structures and to detect damage when using structural health monitoring techniques. The technique was validated by numerical simulations on a lab-scaled two-span bridge considering different degradation scenarios and experimentally on a lab-scaled structure, which was correlated with two numerical models.