Received: 2025-08-07
Revised: 2025-09-15
Accepted: 2025-09-16
Published in Issue 2025-09-30
Copyright (c) 2025 Maged Alkilayh, Bader Ibrahim Alshaqqawi (Author)

This work is licensed under a Creative Commons Attribution 4.0 International License.
PDF views: 183
Abstract
We propose the Iterated Flexible Arnoldi–Tikhonov (IFAT) method for large-scale discrete ill-posed problems. IFAT embeds nonstationary Tikhonov updates into a flexible Arnoldi reduction whose basis is enriched with problem-aware directions, enabling regularization in subspaces that standard Arnoldi and classical projected Tikhonov schemes may fail to capture. Building on the Arnoldi-based preconditioner of Buccini–Onisk Reichel and recent projected/iterated frameworks with adaptive parameter choice, we (i) unify flexible sub space enrichment with discrepancy-principle parameter selection on the reduced problem, (ii) derive a residual update that requires no additional matrix–vector products, and (iii) establish monotone error decrease and stability under inherited spectral–equivalence assumptions. Extensive experiments in image deblurring, signal reconstruction, tomography, MRI, seismic deconvolution, and electrical impedance tomography demonstrate that IFAT achieves consistently higher reconstruction quality (PSNR/SSIM, SNR/CNR, EPI) with approximately 40–60% fewer outer iterations than IAT and classical Tikhonov. Additional comparisons with Landweber and damped Gauss–Newton show that IFAT converges substantially faster than gradient-based schemes and is less sensitive to noise amplification than second-order approaches. Against the best published baselines from BOR (2023) and PIT–GF (2025), IFAT attains lower or comparable relative reconstruction error at the same discrepancy breakout. These results indicate that flexible augmentation provides a robust and practically significant improvement over fixed-subspace methods for real-world inverse problems.
Keywords
- Discrete ill-posed inverse problems,
- Iterated Tikhonov regularization,
- Flexible Arnoldi decom position,
- Krylov subspaces,
- Image deblurring,
- Signal reconstruction,
- Tomographic imaging
References
- Alkilayh, M., Reichel, L. (2023). Some numerical aspects of Arnoldi-Tikhonov regularization. Applied Numerical Mathematics, 185, 503–515.https://doi.org/10.1016/j.apnum.2022.12.009
- Berisha, S., Gazzola, S. (2021). Iterated Tikhonov regularization in function space: Anewperspective. Journal of Computational and Applied Mathematics, 392, 113472.
- Buccini, A. (2017). Regularizing preconditioners by non-stationary iterated Tikhonov with general penalty term. Applied Numerical Mathematics, 116, 64–81.https://doi.org/10.1016/j.apnum.2016.07.009
- Donatelli M. and Hanke M. , Fast nonstationary preconditioned iterative methods for ill-posed problems, with application to image deblurring, Inverse Problems, 29(9):095008, 2013.https://doi.org/10.1088/0266-5611/29/9/095008
- Buccini A., Donatelli M., Reichel L., and W. Zhang, A new non-stationary preconditioned iterative method for linear discrete ill-posed problems, Numerical Linear Algebra with Applications, 28(2):e2353, 2021.https://doi.org/10.1002/nla.2353
- Buccini A., Donatelli M., and Reichel L. , Theoretical and numerical aspects of a non-stationary preconditioned iterative method for linear discrete ill-posed problems, Journal of Computational and Applied Mathematics, 423:114940, 2023. https://doi.org/10.1016/j.cam.2022.114940
- Buccini A., Onisk L. , and Reichel L. , for iterated Tikhonov regularization, An Arnoldi-based preconditioner Numerical Algorithms, 92(1):223–245, 2023.https://doi.org/10.1007/s11075-022-01407-7
- Buccini, A., Gazzola, S., Onisk, L., Pasha, M., Reichel, L. (2025). Projected iterated Tikhonov in general form with adaptive choice of the regularization parameter. Numerical Algorithms. https://doi.org/10.1007/s11075-025-02072-2
- Dennis, J. E., & Schnabel, R. B. (1996). Numerical Methods for Unconstrained Optimization and Nonlinear Equations. SIAM.30
- Engl, H.W., Hanke, M., Neubauer, A. (1996). Regularization of Inverse Problems. Kluwer, Dordrecht.
- Fenu, C., Reichel, L., Rodriguez, G. (2016). GCV for Tikhonov regularization viaglobal Golub-Kahan decomposition. Numerical Linear Algebra with Applications, 23(3), 467–484.https://doi.org/10.1002/nla.2034
- Gazzola, S., Nagy, J.G., Novati, P. (2019). Efficient Krylov subspace methods for Tikhonov regularization with general linear regularization operators. SIAM Journal on Scientific Computing, 41(5), S137–S162.
- Golub, G.H., Heath, M., Wahba, G. (1979). Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics, 21(2), 215–223.
- Hansen, P.C. (1998). Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion. SIAM, Philadelphia.
- Hansen, P.C. (2010). Discrete Inverse Problems: Insight and Algorithms. SIAM.
- Landweber, L. (1951). An iteration formula for Fredholm integral equations of the first kind. American Journal of Mathematics, 73(3), 615–624.
- Madsen, K., Nielsen, H. B., & Tingleff, O. (2004). Methods for Non-linear Least Squares Problems. Technical University of Denmark.
- Morikuni, K., Reichel, L., Hayami, K. (2014). FGMRES for linear discrete ill-posed problems. Applied Numerical Mathematics, 75, 175–187.
- Neubauer, A. (2008). On convergence rates for Morozov’s discrepancy principle. Inverse Problems, 24(5), 055005.
- Reichel, L., Rodriguez, G. (2013). Old and new parameter choice rules for discrete ill posed problems. Numerical Algorithms, 63, 65–87. https://doi.org/10.1007/s11075 012-9612-8
- Saad, Y. (1986). On the rates of convergence of the Lanczos and the block-Lanczos methods. SIAM Journal on Numerical Analysis, 23(5), 1051–1073.https://doi.org/10.1137/0717059
- Saad, Y. (1993). A flexible inner-outer preconditioned GMRES algorithm. SIAM Journal on Scientific Computing, 14, 461–469. https://doi.org/10.1137/0914028
- Saad, Y. (2003). Iterative Methods for Sparse Linear Systems (2nd ed.). SIAM, Philadelphia.
- Vogel, C.R. (2002). Computational Methods for Inverse Problems. SIAM.
- Zhdanov, M. (2002). Geophysical Inverse Theory and Regularization Problems. Elsevier.
10.57647/mathsci.2025.1903.13
