No CrossRef data available.
Article contents
The geometry of monotone operator splitting methods
Published online by Cambridge University Press: 04 September 2024
Abstract
We propose a geometric framework to describe and analyse a wide array of operator splitting methods for solving monotone inclusion problems. The initial inclusion problem, which typically involves several operators combined through monotonicity-preserving operations, is seldom solvable in its original form. We embed it in an auxiliary space, where it is associated with a surrogate monotone inclusion problem with a more tractable structure and which allows for easy recovery of solutions to the initial problem. The surrogate problem is solved by successive projections onto half-spaces containing its solution set. The outer approximation half-spaces are constructed by using the individual operators present in the model separately. This geometric framework is shown to encompass traditional methods as well as state-of-the-art asynchronous block-iterative algorithms, and its flexible structure provides a pattern to design new ones.
- Type
- Research Article
- Information
- Copyright
- © The Author(s), 2024. Published by Cambridge University Press
Footnotes
*
This work was supported by the National Science Foundation under grant CCF-2211123.
References
Acker, F. and Prestel, M. A. (1980), Convergence d’un schéma de minimisation alternée, Ann.
.Fac. Sci. Toulouse V. Sér. Math 2, 1–9.CrossRefGoogle Scholar
Adly, S., Hantoute, A. and Le, B. K. (2017), Maximal monotonicity and cyclic monotonicity arising in nonsmooth Lur’e dynamical systems, J. Math. Anal. Appl. 448, 691–706.CrossRefGoogle Scholar
Agmon, S. (1954), The relaxation method for linear inequalities, Canad. J. Math. 6, 382–392.10.4153/CJM-1954-037-2CrossRefGoogle Scholar
Alber, Y. and Ryazantseva, I. (2006), Nonlinear Ill-Posed Problems of Monotone Type, Springer.Google Scholar
Alduncin, G. (2005), Composition duality principles for mixed variational inequalities, Math. Comput. Modelling 41, 639–654.CrossRefGoogle Scholar
Alduncin, G. (2023), Multidomain optimal control of variational subpotential mixed evolution inclusions, Appl. Math. Optim. 88, art. 35.10.1007/s00245-023-10010-8CrossRefGoogle Scholar
Alghamdi, M. A., Alotaibi, A., Combettes, P. L. and Shahzad, N. (2014), A primal–dual method of partial inverses for composite inclusions, Optim. Lett. 8, 2271–2284.10.1007/s11590-014-0734-xCrossRefGoogle Scholar
Alimohammady, M., Ramazannejad, M. and Roohi, M. (2014), Notes on the difference of two monotone operators, Optim. Lett. 8, 81–84.CrossRefGoogle Scholar
Alotaibi, A., Combettes, P. L. and Shahzad, N. (2014), Solving coupled composite monotone inclusions by successive Fejér approximations of their Kuhn–Tucker set, SIAM J. Optim. 24, 2076–2095.CrossRefGoogle Scholar
Alotaibi, A., Combettes, P. L. and Shahzad, N. (2015), Best approximation from the Kuhn–Tucker set of composite monotone inclusions, Numer.
.Funct. Anal. Optim 36, 1513–1532.CrossRefGoogle Scholar
Anderson, W. N. Jr and Trapp, G. E. (1976), A class of monotone operator functions related to electrical network theory, Linear Algebra Appl. 15, 53–67.CrossRefGoogle Scholar
Antipin, A. S. (1976), On a method for convex programs using a symmetrical modification of the Lagrange function, Èkonom. i Mat. Metody 12, 1164–1173.Google Scholar
Aoyama, K., Kimura, Y. and Takahashi, W. (2008), Maximal monotone operators and maximal monotone functions for equilibrium problems, J. Convex Anal. 15, 395–409.Google Scholar
Aragón-Artacho, F. J., Boţ, R. I. and Torregrosa-Belén, D. (2023), A primal–dual splitting algorithm for composite monotone inclusions with minimal lifting, Numer. Algorithms 93, 103–130.10.1007/s11075-022-01405-9CrossRefGoogle ScholarPubMed
Argyriou, A., Foygel, R. and Srebro, N. (2012), Sparse prediction with the k-support norm, in Advances in Neural Information Processing Systems 25 (Pereira, F. et al., eds), Curran Associates, pp. 1457–1465.Google Scholar
Attouch, H. and Cabot, A. (2020), Convergence of a relaxed inertial proximal algorithm for maximally monotone operators, Math. Program. A184, 243–287.CrossRefGoogle Scholar
Attouch, H. and Théra, M. (1996), A general duality principle for the sum of two operators, J. Convex Anal. 3, 1–24.Google Scholar
Attouch, H., Bolte, J., Redont, P. and Soubeyran, A. (2008), Alternating proximal algorithms for weakly coupled convex minimization problems: Applications to dynamical games and PDE’s, J. Convex Anal. 15, 485–506.Google Scholar
Attouch, H., Briceño-Arias, L. M. and Combettes, P. L. (2010), A parallel splitting method for coupled monotone inclusions, SIAM J. Control Optim. 48, 3246–3270.CrossRefGoogle Scholar
Attouch, H., Briceño-Arias, L. M. and Combettes, P. L. (2016), A strongly convergent primal–dual method for nonoverlapping domain decomposition, Numer. Math. 133, 433–470.CrossRefGoogle Scholar
Attouch, H., Buttazzo, G. and Michaille, G. (2014), Variational Analysis in Sobolev and BV Spaces, second edition, SIAM.CrossRefGoogle Scholar
Attouch, H., Cabot, A., Frankel, P. and Peypouquet, J. (2011), Alternating proximal algorithms for linearly constrained variational inequalities: Application to domain decomposition for PDE’s, Nonlinear Anal. 74, 7455–7473.CrossRefGoogle Scholar
Attouch, H., Peypouquet, J. and Redont, P. (2018), Backward–forward algorithms for structured monotone inclusions in Hilbert spaces, J. Math. Anal. Appl. 457, 1095–1117.CrossRefGoogle Scholar
Aubin, J.-P. and Cellina, A. (1984), Differential Inclusions: Set-Valued Maps and Viability Theory, Springer.CrossRefGoogle Scholar
Aujol, J.-F. and Chambolle, A. (2005), Dual norms and image decomposition models, Int. J. Comput. Vision 63, 85–104.CrossRefGoogle Scholar
Baillon, J.-B. and Haddad, G. (1977), Quelques propriétés des opérateurs angle-bornés et n-cycliquement monotones, Israel J. Math. 26, 137–150.CrossRefGoogle Scholar
Bakušinskiĭ, A. B. and Polyak, B. T. (1974), The solution of variational inequalities, Soviet Math. Dokl. 15, 1705–1710.Google Scholar
Banert, S., Boţ, R. I. and Csetnek, E. R. (2021), Fixing and extending some recent results on the ADMM algorithm, Numer. Algorithms 86, 1303–1325.CrossRefGoogle ScholarPubMed
Barbu, V. (2010), Nonlinear Differential Equations of Monotone Types in Banach Spaces, Springer.CrossRefGoogle Scholar
Bartz, S., Bauschke, H. H., Moffat, S. M. and Wang, X. (2016), The resolvent average of monotone operators: Dominant and recessive properties, SIAM J. Optim. 26, 602–634.CrossRefGoogle Scholar
Bauschke, H. H. and Borwein, J. M. (1994), Dykstra’s alternating projection algorithm for two sets, J. Approx. Theory 79, 418–443.CrossRefGoogle Scholar
Bauschke, H. H. and Combettes, P. L. (2001), A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces, Math. Oper. Res. 26, 248–264.CrossRefGoogle Scholar
Bauschke, H. H. and Combettes, P. L. (2008), A Dykstra-like algorithm for two monotone operators, Pacific J. Optim. 4, 383–391.Google Scholar
Bauschke, H. H. and Combettes, P. L. (2017), Convex Analysis and Monotone Operator Theory in Hilbert Spaces, second edition, Springer.CrossRefGoogle Scholar
Bauschke, H. H. and Moursi, W. M. (2017), On the Douglas–Rachford algorithm, Math. Program. A164, 263–284.CrossRefGoogle Scholar
Bauschke, H. H., Bolte, J. and Teboulle, M. (2017), A descent lemma beyond Lipschitz gradient continuity: First-order methods revisited and applications, Math. Oper. Res. 42, 330–348.CrossRefGoogle Scholar
Bauschke, H. H., Borwein, J. M. and Combettes, P. L. (2003), Bregman monotone optimization algorithms, SIAM J. Control Optim. 42, 596–636.CrossRefGoogle Scholar
Bauschke, H. H., Bùi, M. N. and Wang, X. (2019), On sums and convex combinations of projectors onto convex sets, J. Approx. Theory 242, 31–57.CrossRefGoogle Scholar
Bauschke, H. H., Combettes, P. L. and Reich, S. (2005), The asymptotic behavior of the composition of two resolvents, Nonlinear Anal. 60, 283–301.CrossRefGoogle Scholar
Bauschke, H. H., Deutsch, F. and Hundal, H. (2009), Characterizing arbitrarily slow convergence in the method of alternating projections, Int. Trans. Oper. Res. 16, 413–425.CrossRefGoogle Scholar
Bauschke, H. H., Koch, V. R. and Phan, H. M. (2016), Stadium norm and Douglas–Rachford splitting: A new approach to road design optimization, Oper. Res. 64, 201–218.CrossRefGoogle Scholar
Bauschke, H. H., Matoušková, E. and Reich, S. (2004), Projection and proximal point methods: Convergence results and counterexamples, Nonlinear Anal. 56, 715–738.CrossRefGoogle Scholar
Beck, A. and Teboulle, M. (2009a), Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems, IEEE Trans. Image Process. 18, 2419–2434.CrossRefGoogle ScholarPubMed
Beck, A. and Teboulle, M. (2009b), A fast iterative shrinkage-thresholding algorithm for linear inverse problems, SIAM J. Imaging Sci. 2, 183–202.CrossRefGoogle Scholar
Beck, A. and Teboulle, M. (2010), Gradient-based algorithms with applications to signal recovery problems, in Convex Optimization in Signal Processing and Communications (Palomar, D. P. and Eldar, Y. C., eds), Cambridge University Press, pp. 42–88.Google Scholar
Becker, S. R. and Combettes, P. L. (2014), An algorithm for splitting parallel sums of linearly composed monotone operators, with applications to signal recovery, J. Nonlinear Convex Anal. 15, 137–159.Google Scholar
Bednarczuk, E. M., Jezierska, A. and Rutkowski, K. E. (2018), Proximal primal–dual best approximation algorithm with memory, Comput. Optim. Appl. 71, 767–794.CrossRefGoogle Scholar
Belgioioso, G., Nedich, A. and Grammatico, S. (2021), Distributed generalized Nash equilibrium seeking in aggregative games on time-varying networks, IEEE Trans. Automat. Control 66, 2061–2075.CrossRefGoogle Scholar
Bellman, R., Kalaba, R. E. and Lockett, J. A. (1966), Numerical Inversion of the Laplace Transform: Applications to Biology, Economics Engineering, and Physics, Elsevier.Google Scholar
Beltrami, E. (1972), A note regarding abstract operators and passive networks, Quart. Appl. Math. 30, 369–370.CrossRefGoogle Scholar
Benning, M. and Burger, M. (2018), Modern regularization methods for inverse problems, Acta Numer. 27, 1–111.CrossRefGoogle Scholar
Berge, C. and Ghouila-Houri, A. (1962), Programmes, Jeux, et Réseaux de Transport, Dunod. English translation: Programming, Games and Transportation Networks, Wiley (1965).Google Scholar
Bertero, M., Bindi, D., Boccacci, P., Cattaneo, M., Eva, C. and Lanza, V. (1997), Application of the projected Landweber method to the estimation of the source time function in seismology, Inverse Problems 13, 465–486.CrossRefGoogle Scholar
Bertsekas, D. P. (1998), Network Optimization: Continuous and Discrete Models, Athena Scientific.Google Scholar
Birkhoff, G. and Varga, R. S. (1959), Implicit alternating direction methods, Trans. Amer. Math. Soc. 92, 13–24.CrossRefGoogle Scholar
Blum, E. and Oettli, W. (1994), From optimization and variational inequalities to equilibrium problems, Math. Student 63, 123–145.Google Scholar
Börgens, E. and Kanzow, C. (2021), ADMM-type methods for generalized Nash equilibrium problems in Hilbert spaces, SIAM J. Optim. 31, 377–403.CrossRefGoogle Scholar
Borwein, J. M. (2010), Fifty years of maximal monotonicity, Optim. Lett. 4, 473–490.CrossRefGoogle Scholar
Boţ, R. I. and Csetnek, E. R. (2019), ADMM for monotone operators: Convergence analysis and rates, Adv. Comput. Math. 45, 327–359.CrossRefGoogle Scholar
Boţ, R. I. and Hendrich, C. (2013), A Douglas–Rachford type primal–dual method for solving inclusions with mixtures of composite and parallel-sum type monotone operators, SIAM J. Optim. 23, 2541–2565.CrossRefGoogle Scholar
Boţ, R. I. and Hendrich, C. (2014), Convergence analysis for a primal–dual monotone+skew splitting algorithm with applications to total variation minimization, J. Math. Imaging Vision 49, 551–568.CrossRefGoogle Scholar
Boyd, S., Parikh, N., Chu, E., Peleato, B. and Eckstein, J. (2010), Distributed optimization and statistical learning via the alternating direction method of multipliers, Found. Trends Machine Learn. 3, 1–122.CrossRefGoogle Scholar
Boyle, J. P. and Dykstra, R. L. (1986), A method for finding projections onto the intersection of convex sets in Hilbert spaces, in Advances in Order Restricted Statistical Inference, Vol. 37 of Lecture Notes in Statistics, Springer, pp. 28–47.CrossRefGoogle Scholar
Bredies, K., Chenchene, E., Lorenz, D. A. and Naldi, E. (2022), Degenerate preconditioned proximal point algorithms, SIAM J. Optim. 32, 2376–2401.CrossRefGoogle Scholar
Brègman, L. M. (1965), The method of successive projection for finding a common point of convex sets, Soviet Math. Dokl. 6, 688–692.Google Scholar
Brègman, L. M. (1967), The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming, USSR Comput. Math. Math. Phys. 7, 200–217.CrossRefGoogle Scholar
Brézis, H. (1966), Les opérateurs monotones, Séminaire Choquet: Initiation à l’Analyse 5, 1–33.Google Scholar
Brézis, H. (1971), Monotonicity methods in Hilbert spaces and some applications to nonlinear partial differential equations, in Contributions to Nonlinear Functional Analysis (Zarantonello, E. H., ed.), Academic, pp. 101–156.CrossRefGoogle Scholar
Brézis, H. (1973), Opérateurs Maximaux Monotones et Semi-Groupes de Contractions dans les Espaces de Hilbert, North-Holland/Elsevier.Google Scholar
Brézis, H. and Browder, F. (1998), Partial differential equations in the 20th century, Adv.
.Math 135, 76–144.CrossRefGoogle Scholar
Brézis, H. and Lions, P. L. (1978), Produits infinis de résolvantes, Israel J. Math. 29, 329–345.CrossRefGoogle Scholar
Briceño-Arias, L. M. (2012), A Douglas–Rachford splitting method for solving equilibrium problems, Nonlinear Anal. 75, 6053–6059.CrossRefGoogle Scholar
Briceño-Arias, L. M. and Combettes, P. L. (2009), Convex variational formulation with smooth coupling for multicomponent signal decomposition and recovery, Numer. Math. Theory Methods Appl. 2, 485–508.Google Scholar
Briceño-Arias, L. M. and Combettes, P. L. (2011), A monotone+skew splitting model for composite monotone inclusions in duality, SIAM J. Optim. 21, 1230–1250.CrossRefGoogle Scholar
Briceño-Arias, L. M. and Combettes, P. L. (2013), Monotone operator methods for Nash equilibria in non-potential games, in Computational and Analytical Mathematics (Bailey, D. et al., eds), Springer, pp. 143–159.CrossRefGoogle Scholar
Briceño-Arias, L. M. and Davis, D. (2018), Forward–backward-half forward algorithm for solving monotone inclusions, SIAM J. Optim. 28, 2839–2871.CrossRefGoogle Scholar
Briceño-Arias, L. M. and Roldán, F. (2023), Primal–dual splittings as fixed point iterations in the range of linear operators, J. Global Optim. 85, 847–866.CrossRefGoogle Scholar
Briceño-Arias, L. M., Chierchia, G., Chouzenoux, E. and Pesquet, J.-C. (2019), A random block-coordinate Douglas–Rachford splitting method with low computational complexity for binary logistic regression, Comput. Optim. Appl. 72, 707–726.CrossRefGoogle Scholar
Briceño-Arias, L. M., Combettes, P. L., Pesquet, J.-C. and Pustelnik, N. (2011), Proximal algorithms for multicomponent image recovery problems, J. Math. Imaging Vision 41, 3–22.CrossRefGoogle Scholar
Briceño-Arias, L. M., Deride, J., López-Rivera, S. and Silva, F. J. (2023), A primal–dual partial inverse algorithm for constrained monotone inclusions: Applications to stochastic programming and mean field games, Appl. Math. Optim. 87, art. 21.CrossRefGoogle Scholar
Briceño-Arias, L. M., Kalise, D. and Silva, F. J. (2018), Proximal methods for stationary mean field games with local couplings, SIAM J. Control Optim. 56, 801–836.CrossRefGoogle Scholar
Brogliato, B. and Tanwani, A. (2020), Dynamical systems coupled with monotone set-valued operators: Formalisms, applications, well-posedness, and stability, SIAM Rev. 62, 3–129.CrossRefGoogle Scholar
Brogliato, B., Lozano, R., Maschke, B. and Egeland, O. (2007), Dissipative Systems Analysis and Control: Theory and Applications, second edition, Springer.CrossRefGoogle Scholar
Browder, F. E. (1963), The solvability of non-linear functional equations, Duke Math. J. 30, 557–566.CrossRefGoogle Scholar
Browder, F. E. (1965), Multi-valued monotone nonlinear mappings and duality mappings in Banach spaces, Trans. Amer. Math. Soc. 118, 338–351.CrossRefGoogle Scholar
Browder, F. E. (1968/1976), Nonlinear operators and nonlinear equations of evolution in Banach spaces, Proc. Sympos. Pure Math. 18, 1–308.Google Scholar
Bruck, R. E. (1973), The iterative solution of the equation y ∈ x+Tx for a monotone operator T in Hilbert space, Bull. Amer. Math. Soc. 79, 1258–1261.CrossRefGoogle Scholar
Bruck, R. E. (1974), A strongly convergent iterative solution of 0 ∈ U(x) for a maximal monotone operator U in Hilbert space, J. Math. Anal. Appl. 48, 114–126.CrossRefGoogle Scholar
Bruck, R. E. (1975), An iterative solution of a variational inequality for certain monotone operators in Hilbert space, Bull. Amer. Math. Soc. 81, 890–892. Corrigendum: 82, 353 (1976).CrossRefGoogle Scholar
Bùi, M. N. (2022a), A decomposition method for solving multicommodity network equilibria, Oper. Res. Lett. 50, 40–44.CrossRefGoogle Scholar
Bùi, M. N. (2022b), Projective splitting as a warped proximal algorithm, Appl. Math. Optim. 85, art. 4.CrossRefGoogle Scholar
Bùi, M. N. and Combettes, P. L. (2020a), The Douglas–Rachford algorithm converges only weakly, SIAM J. Control Optim. 58, 1118–1120.CrossRefGoogle Scholar
Bùi, M. N. and Combettes, P. L. (2020b), Warped proximal iterations for monotone inclusions, J. Math. Anal. Appl. 491, art. 124315.CrossRefGoogle Scholar
Bùi, M. N. and Combettes, P. L. (2021), Bregman forward–backward operator splitting, Set-Valued Var.
.Anal 29, 583–603.CrossRefGoogle Scholar
Bùi, M. N. and Combettes, P. L. (2022a), Analysis and numerical solution of a modular convex Nash equilibrium problem, J. Convex Anal. 29, 1007–1021.Google Scholar
Bùi, M. N. and Combettes, P. L. (2022b), Multivariate monotone inclusions in saddle form, Math. Oper. Res. 47, 1082–1109.CrossRefGoogle Scholar
Bùi, M. N., Combettes, P. L. and Woodstock, Z. C. (2022), Block-activated algorithms for multicomponent fully nonsmooth minimization, in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2022), pp. 5428–5432.Google Scholar
Byrne, C., Censor, Y., Gibali, A. and Reich, S. (2012), The split common null point problem, J. Nonlinear Convex Anal. 13, 759–775.Google Scholar
Camlibel, M. K. and Schumacher, J. M. (2016), Linear passive systems and maximal monotone mappings, Math. Program. B157, 397–420.CrossRefGoogle Scholar
Cauchy, A. (1847), Méthode générale pour la résolution des systèmes d’équations simultanées, C. R. Acad. Sci. Paris 25, 536–538.Google Scholar
Cederbaum, I. (1962), On optimal operation of communication nets, J. Franklin Inst. 274, 130–141.CrossRefGoogle Scholar
Cegielski, A. (2012), Iterative Methods for Fixed Point Problems in Hilbert Spaces, Vol. 2057 of Lecture Notes in Mathematics, Springer.Google Scholar
Censor, Y. and Zaknoon, M. (2018), Algorithms and convergence results of projection methods for inconsistent feasibility problems: A review, Pure Appl. Funct. Anal. 3, 565–586.Google Scholar
Censor, Y. and Zenios, S. A. (1992), Proximal minimization algorithm with D-functions, J. Optim. Theory Appl. 73, 451–464.CrossRefGoogle Scholar
Chaffey, T. and Sepulchre, R. (2024), Monotone one-port circuits, IEEE Trans. Automat. Control 69, 783–796.CrossRefGoogle Scholar
Chaffey, T., Banert, S., Giselsson, P. and Pates, R. (2023a), Circuit analysis using monotone+skew splitting, Eur. J. Control 74, art. 100854.CrossRefGoogle Scholar
Chaffey, T., Forni, F. and Sepulchre, R. (2023b), Graphical nonlinear system analysis, IEEE Trans. Automat. Control 68, 6067–6081.CrossRefGoogle Scholar
Chambolle, A. (2004), An algorithm for total variation minimization and applications, J. Math. Imaging Vision 20, 89–97.Google Scholar
Chambolle, A. (2005), Total variation minimization and a class of binary MRF models, in Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR 2005), Vol. 3757 of Lecture Notes in Computer Science, Springer, pp. 136–152.CrossRefGoogle Scholar
Chambolle, A. and Dossal, C. (2015), On the convergence of the iterates of the ‘fast iterative shrinkage/thresholding algorithm’, J. Optim. Theory Appl. 166, 968–982.CrossRefGoogle Scholar
Chambolle, A. and Pock, T. (2011), A first-order primal–dual algorithm for convex problems with applications to imaging, J. Math. Imaging Vision 40, 120–145.CrossRefGoogle Scholar
Chambolle, A. and Pock, T. (2016), An introduction to continuous optimization for imaging, Acta Numer. 25, 161–319.CrossRefGoogle Scholar
Chan, R. H., Setzer, S. and Steidl, G. (2008), Inpainting by flexible Haar-wavelet shrinkage, SIAM J. Imaging Sci. 1, 273–293.CrossRefGoogle Scholar
Chan, S. H., Wang, X. and Elgendy, O. A. (2017), Plug-and-play ADMM for image restoration: Fixed-point convergence and applications, IEEE Trans. Comput. Imaging 3, 84–98.CrossRefGoogle Scholar
Chaux, C., El-Gheche, M., Farah, J., Pesquet, J.-C. and Pesquet-Popescu, B. (2013), A parallel proximal splitting method for disparity estimation from multicomponent images under illumination variation, J. Math. Imaging Vision 47, 167–178.CrossRefGoogle Scholar
Chen, G. and Teboulle, M. (1994), A proximal-based decomposition method for convex minimization problems, Math. Program. 64, 81–101.CrossRefGoogle Scholar
Chen, G. H.-G. and Rockafellar, R. T. (1997), Convergence rates in forward–backward splitting, SIAM J. Optim. 7, 421–444.CrossRefGoogle Scholar
Cheney, E. W. and Goldstein, A. A. (1959a), Newton’s method for convex programming and Tchebycheff approximation, Numer. Math. 1, 253–268.CrossRefGoogle Scholar
Cheney, W. and Goldstein, A. A. (1959b), Proximity maps for convex sets, Proc. Amer. Math. Soc. 10, 448–450.CrossRefGoogle Scholar
Chierchia, G., Chouzenoux, E., Combettes, P. L. and Pesquet, J.-C. (2016), The proximity operator repository. Available at http://proximity-operator.net/.Google Scholar
Clason, C. and Valkonen, T. (2017), Primal–dual extragradient methods for nonlinear nonsmooth PDE-constrained optimization, SIAM J. Optim. 27, 1314–1339.CrossRefGoogle Scholar
Cohen, G. (1987), Nash equilibria: Gradient and decomposition algorithms, Large Scale Syst. 12, 173–184.Google Scholar
Combettes, P. L. (2001a), Fejér-monotonicity in convex optimization, in Encyclopedia of Optimization (Floudas, C. A. and Pardalos, P. M., eds), Vol. 2, Springer, pp. 106–114. Also available in second edition (2009), pp. 1016–1024.Google Scholar
Combettes, P. L. (2001b), Quasi-Fejérian analysis of some optimization algorithms, in Inherently Parallel Algorithms for Feasibility and Optimization (Butnariu, D., Censor, Y. and Reich, S., eds), Elsevier, pp. 115–152.CrossRefGoogle Scholar
Combettes, P. L. (2004), Solving monotone inclusions via compositions of nonexpansive averaged operators, Optimization 53, 475–504.CrossRefGoogle Scholar
Combettes, P. L. (2009), Iterative construction of the resolvent of a sum of maximal monotone operators, J. Convex Anal. 16, 727–748.Google Scholar
Combettes, P. L. (2013a), Can one genuinely split m > 2 monotone operators?, in Workshop on Algorithms and Dynamics for Games and Optimization (ADGO 2013). Available at https://pcombet.math.ncsu.edu/2013open-pbs1.pdf.+2+monotone+operators?,+in+Workshop+on+Algorithms+and+Dynamics+for+Games+and+Optimization+(ADGO+2013).+Available+at+https://pcombet.math.ncsu.edu/2013open-pbs1.pdf.>Google Scholar
Combettes, P. L. (2013b), Systems of structured monotone inclusions: Duality, algorithms, and applications, SIAM J. Optim. 23, 2420–2447.CrossRefGoogle Scholar
Combettes, P. L. (2018), Monotone operator theory in convex optimization, Math. Program. B170, 177–206.CrossRefGoogle Scholar
Combettes, P. L. (2023), Resolvent and proximal compositions, Set-Valued Var. Anal. 31, art. 22.CrossRefGoogle Scholar
Combettes, P. L. and Bondon, P. (1999), Hard-constrained inconsistent signal feasibility problems, IEEE Trans. Signal Process. 47, 2460–2468.CrossRefGoogle Scholar
Combettes, P. L. and Eckstein, J. (2018), Asynchronous block-iterative primal–dual decomposition methods for monotone inclusions, Math. Program. B168, 645–672.CrossRefGoogle Scholar
Combettes, P. L. and Glaudin, L. E. (2017), Quasinonexpansive iterations on the affine hull of orbits: From Mann’s mean value algorithm to inertial methods, SIAM J. Optim. 27, 2356–2380.CrossRefGoogle Scholar
Combettes, P. L. and Glaudin, L. E. (2019), Proximal activation of smooth functions in splitting algorithms for convex image recovery, SIAM J. Imaging Sci. 12, 1905–1935.CrossRefGoogle Scholar
Combettes, P. L. and Glaudin, L. E. (2021), Solving composite fixed point problems with block updates, Adv. Nonlinear Anal. 10, 1154–1177.CrossRefGoogle Scholar
Combettes, P. L. and Hirstoaga, S. A. (2005), Equilibrium programming in Hilbert spaces, J. Nonlinear Convex Anal. 6, 117–136.Google Scholar
Combettes, P. L. and Müller, C. L. (2020), Perspective maximum likelihood-type estimation via proximal decomposition, Electron. J. Statist. 14, 207–238.CrossRefGoogle Scholar
Combettes, P. L. and Müller, C. L. (2021), Regression models for compositional data: General log-contrast formulations, proximal optimization, and microbiome data applications, Statist. Biosci. 13, 217–242.CrossRefGoogle Scholar
Combettes, P. L. and Pesquet, J.-C. (2007), A Douglas–Rachford splitting approach to nonsmooth convex variational signal recovery, IEEE J. Select. Topics Signal Process. 1, 564–574.CrossRefGoogle Scholar
Combettes, P. L. and Pesquet, J.-C. (2011), Proximal splitting methods in signal processing, in Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Vol. 49 of Springer Optimization and its Applications, Springer, pp. 185–212.Google Scholar
Combettes, P. L. and Pesquet, J.-C. (2012), Primal–dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators, Set-Valued Var. Anal. 20, 307–330.CrossRefGoogle Scholar
Combettes, P. L. and Pesquet, J.-C. (2015), Stochastic quasi-Fejér block-coordinate fixed point iterations with random sweeping, SIAM J. Optim. 25, 1221–1248.CrossRefGoogle Scholar
Combettes, P. L. and Pesquet, J.-C. (2020), Deep neural network structures solving variational inequalities,.Set-Valued Var. Anal 28, 491–518.CrossRefGoogle Scholar
Combettes, P. L. and Pesquet, J.-C. (2021), Fixed point strategies in data science, IEEE Trans. Signal Process. 69, 3878–3905.CrossRefGoogle Scholar
Combettes, P. L. and Vũ, B. C. (2013), Variable metric quasi-Fejér monotonicity, Nonlinear Anal. 78, 17–31.CrossRefGoogle Scholar
Combettes, P. L. and Vũ, B. C. (2014), Variable metric forward–backward splitting with applications to monotone inclusions in duality, Optimization 63, 1289–1318.CrossRefGoogle Scholar
Combettes, P. L. and Wajs, V. R. (2005), Signal recovery by proximal forward–backward splitting, Multiscale Model. Simul. 4, 1168–1200.CrossRefGoogle Scholar
Combettes, P. L. and Woodstock, Z. C. (2022), A variational inequality model for the construction of signals from inconsistent nonlinear equations, SIAM J. Imaging Sci. 15, 84–109.CrossRefGoogle Scholar
Combettes, P. L. and Yamada, I. (2015), Compositions and convex combinations of averaged nonexpansive operators, J. Math. Anal. Appl. 425, 55–70.CrossRefGoogle Scholar
Combettes, P. L., Dũng, Ðinh and Vũ, B. C. (2010), Dualization of signal recovery problems, Set-Valued Var. Anal. 18, 373–404.CrossRefGoogle Scholar
Combettes, P. L., Dũng, Ðinh and Vũ, B. C. (2011), Proximity for sums of composite functions, J. Math. Anal. Appl. 380, 680–688.CrossRefGoogle Scholar
Combettes, P. L., Salzo, S. and Villa, S. (2018), Consistent learning by composite proximal thresholding, Math. Program. B167, 99–127.CrossRefGoogle Scholar
Condat, L. (2013), A primal–dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms, J. Optim. Theory Appl. 158, 460–479.CrossRefGoogle Scholar
Condat, L., Kitahara, D., Contreras, A. and Hirabayashi, A. (2023), Proximal splitting algorithms for convex optimization: A tour of recent advances, with new twists, SIAM Rev. 65, 375–435.CrossRefGoogle Scholar
Curry, H. B. (1944), The method of steepest descent for non-linear minimization problems, Quart. Appl. Math. 2, 258–261.CrossRefGoogle Scholar
Dafermos, S. (1980), Traffic equilibrium and variational inequalities, Transport. Sci. 14, 42–54.CrossRefGoogle Scholar
Darboux, G. (1875), Mémoire sur les fonctions discontinues, Ann. Sci. École Normale Sup. 4, 57–112.CrossRefGoogle Scholar
Daubechies, I., Defrise, M. and De Mol, C. (2004), An iterative thresholding algorithm for linear inverse problems with a sparsity constraint, Comm. Pure Appl. Math. 57, 1413–1457.CrossRefGoogle Scholar
Davis, D. and Yin, W. (2017), A three-operator splitting scheme and its optimization applications, Set-Valued Var. Anal. 25, 829–858.CrossRefGoogle Scholar
Desoer, C. A. and Vidyasagar, M. (1975), Feedback Systems: Input–Output Properties, Academic.Google Scholar
Desoer, C. A. and Wu, F. F. (1974), Nonlinear monotone networks, SIAM J. Appl. Math. 26, 315–333.CrossRefGoogle Scholar
Dexter, N., Tran, H. and Webster, C. G. (2022), On the strong convergence of forward–backward splitting in reconstructing jointly sparse signals, Set-Valued Var. Anal. 30, 543–557.CrossRefGoogle Scholar
Doležal, V. (1979a), Feedback systems described by monotone operators, SIAM J. Control Optim. 17, 339–364.CrossRefGoogle Scholar
Doležal, V. (1979b), Monotone Operators and Applications in Control and Network Theory, Elsevier.Google Scholar
Dong, Q.-L., Cho, Y. J., He, S., Pardalos, P. M. and Rassias, T. M. (2022), The Krasnosel’skiĭ–Mann Iterative Method: Recent Progress and Applications, Springer.CrossRefGoogle Scholar
Dong, Y. (2005), An LS-free splitting method for composite mappings, Appl. Math. Lett. 18, 843–848.CrossRefGoogle Scholar
Douglas, J. (1955), On the numerical integration of
${\partial}^2u/\partial {x}^2+{\partial}^2u/\partial {y}^2=\partial u/\partial t$
by implicit methods, J. Soc. Indust. Appl. Math. 3, 42–65.CrossRefGoogle Scholar
by implicit methods, J. Soc. Indust. Appl. Math. 3, 42–65.CrossRefGoogle ScholarDouglas, J. and Rachford, H. H. (1956), On the numerical solution of heat conduction problems in two or three space variables, Trans. Amer. Math. Soc. 82, 421–439.CrossRefGoogle Scholar
Duffin, R. J. (1946), Nonlinear networks I, Bull. Amer. Math. Soc. 52, 833–838.CrossRefGoogle Scholar
Duffin, R. J. (1947), Nonlinear networks IIa, Bull. Amer. Math. Soc. 53, 963–971.CrossRefGoogle Scholar
Duffin, R. J. (1948), Nonlinear networks IIb, Bull. Amer. Math. Soc. 54, 119–127.CrossRefGoogle Scholar
Dykstra, R. L. (1983), An algorithm for restricted least squares regression, J. Amer. Statist. Assoc. 78, 837–842.CrossRefGoogle Scholar
Eaves, B. C. (1984), Subdivisions from primal and dual cones and polytopes, Linear Algebra Appl. 62, 277–285.CrossRefGoogle Scholar
Eckstein, J. (1993), Nonlinear proximal point algorithms using Bregman functions, with applications to convex programming, Math. Oper. Res. 18, 202–226.CrossRefGoogle Scholar
Eckstein, J. (1994), Some saddle-function splitting methods for convex programming, Optim. Methods Softw. 4, 75–83.CrossRefGoogle Scholar
Eckstein, J. (2017), A simplified form of block-iterative operator splitting and an asynchronous algorithm resembling the multi-block alternating direction method of multipliers, J. Optim. Theory Appl. 173, 155–182.CrossRefGoogle Scholar
Eckstein, J. and Bertsekas, D. P. (1992), On the Douglas–Rachford splitting method and the proximal point algorithm for maximal monotone operators, Math. Program. 55, 293–318.CrossRefGoogle Scholar
Eckstein, J. and Ferris, M. C. (1999), Smooth methods of multipliers for complementarity problems, Math. Program. A86, 65–90.CrossRefGoogle Scholar
Eckstein, J. and Svaiter, B. F. (2008), A family of projective splitting methods for the sum of two maximal monotone operators, Math. Program. 111, 173–199.CrossRefGoogle Scholar
Eckstein, J. and Svaiter, B. F. (2009), General projective splitting methods for sums of maximal monotone operators, SIAM J. Control Optim. 48, 787–811.CrossRefGoogle Scholar
Eckstein, J., Watson, J.-P. and Woodruff, D. L. (2023), Projective hedging algorithms for multistage stochastic programming, supporting distributed and asynchronous implementation, Oper. Res. Available at doi:10.1287/opre.2022.0228.CrossRefGoogle Scholar
Eicke, B. (1992), Iteration methods for convexly constrained ill-posed problems in Hilbert space, Numer. Funct. Anal. Optim. 13, 413–429.CrossRefGoogle Scholar
Ekeland, I. and Temam, R. (1974), Analyse Convexe et Problèmes Variationnels, Dunod. English translation: Convex Analysis and Variational Problems, SIAM (1999).Google Scholar
Eremin, I. I. (1968a), Methods of Fejér approximations in convex programming, Mat. Zametki 3, 217–234.Google Scholar
Eremin, I. I. (1968b), On the speed of convergence in the method of Fejér approximations, Mat. Zametki 4, 53–62.Google Scholar
Ermol’ev, Y. M. and Tuniev, A. D. (1968), Random Fejér and quasi-Fejér sequences, Theory of Optimal Solutions – Akad. Nauk Ukrainskoĭ SSR Kiev 2, 76–83.Google Scholar
Facchinei, F. and Pang, J.-S. (2003), Finite-Dimensional Variational Inequalities and Complementarity Problems, Springer.Google Scholar
Facchinei, F., Fischer, A. and Piccialli, V. (2007), On generalized Nash games and variational inequalities, Oper. Res. Lett. 35, 159–164.CrossRefGoogle Scholar
Fejér, L. (1922), Über die Lage der Nullstellen von Polynomen, die aus Minimumforderungen gewisser Art entspringen, Math. Ann. 85, 41–48.CrossRefGoogle Scholar
Fichera, G. (1963), Sul problema elastostatico di signorini con ambigue condizioni al contorno, Atti Accad. Naz. Lincei Rend. Ser. VIII 34, 138–142.Google Scholar
Figueiredo, M. A. T. and Nowak, R. D. (2003), An EM algorithm for wavelet-based image restoration, IEEE Trans. Image Process. 12, 906–916.CrossRefGoogle Scholar
Fortin, M. and Glowinski, R., eds (1983), Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems, North-Holland.Google Scholar
Froda, A. (1929), Sur la Distribution des Propriétés de Voisinage des Fonctions de Variables Réelles, Hermann.Google Scholar
Fukushima, M. (1996), The primal Douglas–Rachford splitting algorithm for a class of monotone mappings with application to the traffic equilibrium problem, Math. Program. 72, 1–15.CrossRefGoogle Scholar
Gabay, D. (1983), Applications of the method of multipliers to variational inequalities, in Augmented Lagrangian Methods: Applications to the Numerical Solution of Boundary-Value Problems (Fortin, M. and Glowinski, R., eds), North-Holland, pp. 299–331.CrossRefGoogle Scholar
Gabay, D. and Mercier, B. (1976), A dual algorithm for the solution of nonlinear variational problems via finite elements approximations, Comput. Math. Appl. 2, 17–40.CrossRefGoogle Scholar
Gaffke, N. and Mathar, R. (1989), A cyclic projection algorithm via duality, Metrika 36, 29–54.CrossRefGoogle Scholar
Gandy, S., Recht, B. and Yamada, I. (2011), Tensor completion and low-n-rank tensor recovery via convex optimization, Inverse Problems 27, art. 025010.CrossRefGoogle Scholar
Garrigos, G., Rosasco, L. and Villa, S. (2023), Convergence of the forward–backward algorithm: Beyond the worst-case with the help of geometry, Math. Program. A198, 937–996.CrossRefGoogle Scholar
Gautam, P., Sahu, D. R., Dixit, A. and Som, T. (2021), Forward–backward-half forward dynamical systems for monotone inclusion problems with application to v-GNE, J. Optim. Theory Appl. 190, 491–523.CrossRefGoogle Scholar
Genel, A. and Lindenstrauss, J. (1975), An example concerning fixed points, Israel J. Math. 22, 81–86.CrossRefGoogle Scholar
Ghizzetti, A., ed. (1969), Theory and Applications of Monotone Operators, Edizioni Oderisi.Google Scholar
Ghoussoub, N. (2009), Self-Dual Partial Differential Systems and Their Variational Principles, Springer.Google Scholar
Giselsson, P. (2021), Nonlinear forward–backward splitting with projection correction, SIAM J. Optim. 31, 2199–2226.CrossRefGoogle Scholar
Glowinski, R. and Le Tallec, P., eds (1989), Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics, SIAM.CrossRefGoogle Scholar
Glowinski, R. and Marrocco, A. (1974), Sur l’approximation, par éléments finis d’ordre un, et la résolution, par pénalisation-dualité, d’une classe de problèmes de Dirichlet non linéaires, C. R. Acad. Sci. Paris A278, 1649–1652. See also RAIRO Anal. Numer. 9, 41–76 (1975).Google Scholar
Glowinski, R., Osher, S. J. and Yin, W., eds (2016), Splitting Methods in Communication, Imaging, Science, and Engineering, Springer.CrossRefGoogle Scholar
Goeleven, D. (2017), Complementarity and Variational Inequalities in Electronics, Academic.Google Scholar
Goldburg, M. and Marks, R. J. II (1985), Signal synthesis in the presence of an inconsistent set of constraints, IEEE Trans. Circuits Syst. 32, 647–663.CrossRefGoogle Scholar
Goldstein, A. A. (1964), Convex programming in Hilbert space, Bull. Amer. Math. Soc. 70, 709–710.CrossRefGoogle Scholar
Golomb, M. (1935), Zur Theorie der nichtlinearen Integralgleichungen, Integralgleichungssysteme und allgemeinen Funktionalgleichungen, Math. Z. 39, 45–75.CrossRefGoogle Scholar
Golomb, M. (1936), Über Systeme von nichtlinearen Integralgleichungen, Publ. Math. Univ. Belgrade 5, 52–83.Google Scholar
Gol’shtein, E. G. (1987), A general approach to decomposition of optimization systems, Sov. J. Comput. Syst. Sci. 25, 105–114.Google Scholar
Gol’shtein, E. G. and Tret’yakov, N. V. (1979), Modified Lagrangians in convex programming and their generalizations, Math. Program. Studies 10, 86–97.CrossRefGoogle Scholar
Gol’shtein, E. G. and Tret’yakov, N. V. (1996), Modified Lagrangians and Monotone Maps in Optimization, Wiley.Google Scholar
Groetsch, C. W. (1972), A note on segmenting Mann iterates, J. Math. Anal. Appl. 40, 369–372.CrossRefGoogle Scholar
Gubin, L. G., Polyak, B. T. and Raik, E. V. (1967), The method of projections for finding the common point of convex sets, Comput. Math. Math. Phys. 7, 1–24.CrossRefGoogle Scholar
Güler, O. (1991), On the convergence of the proximal point algorithm for convex minimization, SIAM J. Control Optim. 29, 403–419.CrossRefGoogle Scholar
Haugazeau, Y. (1967), Sur la minimisation de formes quadratiques avec contraintes, C. R. Acad. Sci. Paris A264, 322–324.Google Scholar
Haugazeau, Y. (1968), Sur les inéquations variationnelles et la minimisation de fonctionnelles convexes. Thesis, Université de Paris.Google Scholar
He, B. and Yuan, X. (2012), Convergence analysis of primal–dual algorithms for a saddle-point problem: From contraction perspective, SIAM J. Imaging Sci. 5, 119–149.CrossRefGoogle Scholar
He, Y. and Monteiro, R. D. C. (2015), Accelerating block-decomposition first-order methods for solving composite saddle-point and two-player Nash equilibrium problems, SIAM J. Optim. 25, 2182–2211.CrossRefGoogle Scholar
Hestenes, M. R. (1969), Multiplier and gradient methods, J. Optim. Theory Appl. 4, 303–320.CrossRefGoogle Scholar
Hu, H., Sotirov, R. and Wolkowicz, H. (2023), Facial reduction for symmetry reduced semidefinite and doubly nonnegative programs, Math. Program. A200, 475–529.CrossRefGoogle Scholar
Hundal, H. S. (2004), An alternating projection that does not converge in norm, Nonlinear Anal. 57, 35–61.CrossRefGoogle Scholar
Idrissi, H., Lefebvre, O. and Michelot, C. (1989), Applications and numerical convergence of the partial inverse method, in Optimization, Vol. 1405 of Lecture Notes in Mathematics, Springer, pp. 39–54.CrossRefGoogle Scholar
Jenatton, R., Mairal, J., Obozinski, G. and Bach, F. (2011), Proximal methods for hierarchical sparse coding, J. Mach. Learn. Res. 12, 2297–2334.Google Scholar
Jensen, J. L. W. V. (1906), Sur les fonctions convexes et les inégalités entre les valeurs moyennes, Acta Math. 30, 175–193.CrossRefGoogle Scholar
Johnstone, P. R. and Eckstein, J. (2019), Convergence rates for projective splitting, SIAM J. Optim. 29, 1931–1957.CrossRefGoogle Scholar
Johnstone, P. R. and Eckstein, J. (2020), Projective splitting with forward steps only requires continuity, Optim. Lett. 14, 229–247.CrossRefGoogle Scholar
Johnstone, P. R. and Eckstein, J. (2021), Single-forward-step projective splitting: Exploiting cocoercivity, Comput. Optim. Appl. 78, 125–166.CrossRefGoogle Scholar
Johnstone, P. R. and Eckstein, J. (2022), Projective splitting with forward steps, Math. Program. A191, 631–670.CrossRefGoogle Scholar
Joly, J. L. and Laurent, P. J. (1971), Stability and duality in convex minimization problems, Rev. Fr. Inform. Rech. Opér. 5, 3–42.Google Scholar
Kačurovskiĭ, R. I. (1960), Monotone operators and convex functionals, Uspekhi Mat. Nauk 15, 213–215.Google Scholar
Kačurovskiĭ, R. I. (1968), Non-linear monotone operators in Banach spaces, Russian Math. Surveys 23, 117–165.CrossRefGoogle Scholar
Kelley, J. E. (1960), The cutting-plane method for solving convex programs, J. Soc Indust. Appl. Math. 8, 703–712.CrossRefGoogle Scholar
Kellogg, R. B. (1969), A nonlinear alternating direction method, Math. Comp. 23, 23–27.CrossRefGoogle Scholar
Kinderlehrer, D. and Stampacchia, G. (1980), An Introduction to Variational Inequalities and Their Applications, Academic.Google Scholar
Kōmura, Y. (1967), Nonlinear semi-groups in Hilbert space, J. Math. Soc. Japan 19, 493–507.CrossRefGoogle Scholar
Korpelevič, G. M. (1976), The extragradient method for finding saddle points and other problems, Èkonom. i Mat. Metody 12, 747–756.Google Scholar
Krasnosel’skiĭ, M. A. (1955), Two remarks on the method of successive approximations, Uspekhi Mat. Nauk 10, 123–127.Google Scholar
Kryanev, A. V. (1973), The solution of incorrectly posed problems by methods of successive approximations, Soviet Math. Dokl. 14, 673–676.Google Scholar
Latafat, P. and Patrinos, P. (2017), Asymmetric forward–backward-adjoint splitting for solving monotone inclusions involving three operators, Comput. Optim. Appl. 68, 57–93.CrossRefGoogle Scholar
Laurent, P. J. and Martinet, B. (1970), Méthodes duales pour le calcul du minimum d’une fonction convexe sur une intersection de convexes, in Symposium on Optimization, Vol. 132 of Lecture Notes in Mathematics, Springer, pp. 159–180.CrossRefGoogle Scholar
Lawrence, J. and Spingarn, J. E. (1987), On fixed points of non-expansive piecewise isometric mappings, Proc. London Math. Soc. 55, 605–624.CrossRefGoogle Scholar
Legendre, A. M. (1805), Nouvelles Méthodes pour la Détermination des Orbites des Comètes, Firmin Didot.Google Scholar
Lemaire, B. (1989), The proximal algorithm, in New Methods in Optimization and Their Industrial Uses (Penot, J. P., ed.), Vol. 87 of International Series of Numerical Mathematics, Birkhäuser, pp. 73–87.Google Scholar
Lemaire, B. (1996), Stability of the iteration method for nonexpansive mappings, Serdica Math. J. 22, 331–340.Google Scholar
Lemaire, B. (1997), Which fixed point does the iteration method select?, in Recent Advances in Optimization, Vol. 452 of Lecture Notes in Economics and Mathematical Systems, Springer, pp. 154–167.CrossRefGoogle Scholar
Lenoir, A. and Mahey, P. (2017), A survey on operator splitting and decomposition of convex programs, RAIRO-Oper. Res. 51, 17–41.CrossRefGoogle Scholar
Leray, J. and Lions, J.-L. (1965), Quelques résultats de Višik sur les problèmes elliptiques nonlinéaires par les méthodes de Minty–Browder, Bull. Soc. Math. France 93, 97–107.CrossRefGoogle Scholar
Levitin, E. S. and Polyak, B. T. (1966), Constrained minimization methods, USSR Comput. Math. Math. Phys. 6, 1–50.CrossRefGoogle Scholar
Lieutaud, J. (1969a), Approximations d’opérateurs monotones par des méthodes de splitting, in Theory and Applications of Monotone Operators (Ghizzetti, A., ed.), Edizioni Oderisi, pp. 259–264.Google Scholar
Lieutaud, J. (1969b), Approximation d’opérateurs par des méthodes de décomposition. Thesis, Université de Paris.Google Scholar
Lindstrom, S. and Sims, B. (2021), Survey: Sixty years of Douglas–Rachford, J. Aust. Math. Soc. 110, 333–370.CrossRefGoogle Scholar
Lions, J.-L. (1969), Quelques Méthodes de Résolution des Problèmes aux Limites Non Linéaires, Dunod.Google Scholar
Lions, J.-L., ed. (2010), Numerical Analysis of Partial Differential Equations, Springer.CrossRefGoogle Scholar
Lions, P.-L. (1978), Une méthode itérative de résolution d’une inéquation variationnelle, Israel J. Math. 31, 204–208.CrossRefGoogle Scholar
Lions, P.-L. and Mercier, B. (1979), Splitting algorithms for the sum of two nonlinear operators, SIAM J. Numer. Anal. 16, 964–979.CrossRefGoogle Scholar
Liu, J. and Wright, S. J. (2015), Asynchronous stochastic coordinate descent: Parallelism and convergence properties, SIAM J. Optim. 25, 351–376.CrossRefGoogle Scholar
Lu, H., Freund, R. M. and Nesterov, Y. (2018), Relatively smooth convex optimization by first-order methods, and applications, SIAM J. Optim. 28, 333–354.CrossRefGoogle Scholar
Machado, M. P. (2018), On the complexity of the projective splitting and Spingarn’s methods for the sum of two maximal monotone operators, J. Optim. Theory Appl. 178, 153–190.CrossRefGoogle Scholar
Machado, P. and Sicre, M. R. (2023), A projective splitting method for monotone inclusions: Iteration-complexity and application to composite optimization, J. Optim. Theory Appl. 198, 552–587.CrossRefGoogle Scholar
Mahey, P. and Pham, D. T. (1993), Partial regularization of the sum of two maximal monotone operators, RAIRO Modélisation Math. Analyse Numér. 27, 375–392.CrossRefGoogle Scholar
Mahey, P., Oualibouch, S. and Tao, P. Dinh (1995), Proximal decomposition on the graph of a maximal monotone operator, SIAM J. Optim. 5, 454–466.CrossRefGoogle Scholar
Malitsky, Y. and Tam, M. K. (2023), Resolvent splitting for sums of monotone operators with minimal lifting, Math. Program. A201, 231–262.CrossRefGoogle Scholar
Mann, W. R. (1953), Mean value methods in iteration, Proc. Amer. Math. Soc. 4, 506–510.CrossRefGoogle Scholar
Martinet, B. (1970), Régularisation d’inéquations variationnelles par approximations successives, Rev. Fr. Inform. Rech. Opér. 4, 154–158.Google Scholar
Martinet, B. (1972), Détermination approchée d’un point fixe d’une application pseudo-contractante: Cas de l’application prox, C. R. Acad. Sci. Paris A274, 163–165.Google Scholar
Martínez-Legaz, J. E. and Seeger, A. (1994), A general cone decomposition theory based on efficiency, Math. Program. 65, 1–20.CrossRefGoogle Scholar
Mercier, B. (1979), Topics in Finite Element Solution of Elliptic Problems, Vol. 63 of Lectures on Mathematics, Tata Institute of Fundamental Research, Bombay.Google Scholar
Mercier, B. (1980), Inéquations Variationnelles de la Mécanique, Vol. 80.01 of Publications Mathématiques d’Orsay, Université de Paris-XI, Orsay, France.Google Scholar
Micchelli, C. A., Morales, J. M. and Pontil, M. (2013), Regularizers for structured sparsity, Adv. Comput. Math. 38, 455–489.CrossRefGoogle Scholar
Millar, W. (1951), Some general theorems for non-linear systems possessing resistance, London Edin. Dublin Philos. Mag. 42, 1150–1160.CrossRefGoogle Scholar
Minty, G. J. (1961), Solving steady-state nonlinear networks of ‘monotone’ elements, IRE Trans. Circuit Theory 8, 99–104.CrossRefGoogle Scholar
Minty, G. J. (1962), Monotone (nonlinear) operators in Hilbert space, Duke Math. J. 29, 341–346.CrossRefGoogle Scholar
Minty, G. J. (1963), On a ‘monotonicity’ method for the solution of nonlinear equations in Banach spaces, Proc. Nat. Acad. Sci. USA 50, 1038–1041.CrossRefGoogle ScholarPubMed
Minty, G. J. (1964), On the monotonicity of the gradient of a convex function, Pacific J. Math. 14, 243–247.CrossRefGoogle Scholar
Minty, G. J. (1969), On some aspects of the theory of monotone operators, in Theory and Applications of Monotone Operators (Ghizzetti, A., ed.), Edizioni Oderisi, pp. 67–82.Google Scholar
Mishchenko, K., Iutzeler, F. and Malick, J. (2020), A distributed flexible delay-tolerant proximal gradient algorithm, SIAM J. Optim. 30, 933–959.CrossRefGoogle Scholar
Mizoguchi, T. and Yamada, I. (2019), Hypercomplex tensor completion via convex optimization, IEEE Trans. Signal Process. 67, 4078–4092.CrossRefGoogle Scholar
Mokhtari, A., Gürbüzbalaban, M. and Ribeiro, A. (2018), Surpassing gradient descent provably: A cyclic incremental method with linear convergence rate, SIAM J. Optim. 28, 1420–1447.CrossRefGoogle Scholar
Moreau, J. J. (1962), Fonctions convexes duales et points proximaux dans un espace hilbertien, C. R. Acad. Sci. Paris Sér. A Math. 255, 2897–2899.Google Scholar
Moreau, J. J. (1965), Proximité et dualité dans un espace hilbertien, Bull. Soc. Math. France 93, 273–299.CrossRefGoogle Scholar
Moreau, J. J. (1966–1967), Fonctionnelles Convexes, Vol. 2 of Séminaire Jean Leray sur les Équations aux Dérivées Partielles, Collège de France, Paris.Google Scholar
Mosco, U. (1972), Dual variational inequalities, J. Math. Anal. Appl. 40, 202–206.CrossRefGoogle Scholar
Motzkin, T. S. and Schoenberg, I. J. (1954), The relaxation method for linear inequalities, Canad. J. Math. 6, 393–404.CrossRefGoogle Scholar
Moudafi, A. (2000), On the regularization of the sum of two maximal monotone operators, Nonlinear Anal. 42, 1203–1208.CrossRefGoogle Scholar
Moudafi, A. and Théra, M. (1999), Proximal and dynamical approaches to equilibrium problems, in Ill-Posed Variational Problems and Regularization Techniques, Vol. 477 of Lecture Notes in Economics and Mathematical Systems, Springer, pp. 187–201.CrossRefGoogle Scholar
Nemirovski, A. (2004), Prox-method with rate of convergence O(1/t) for variational inequalities with Lipschitz continuous monotone operators and smooth convex-concave saddle point problems, SIAM J. Optim. 15, 229–251.CrossRefGoogle Scholar
Neubauer, A. (1988), Tikhonov-regularization of ill-posed linear operator equations on closed convex sets, J. Approx. Theory 53, 304–320.CrossRefGoogle Scholar
Nguyen, Q. V. (2017), Forward–backward splitting with Bregman distances, Vietnam J. Math. 45, 519–539.CrossRefGoogle Scholar
O’Connor, D. and Vandenberghe, L. (2014), Primal–dual decomposition by operator splitting and applications to image deblurring, SIAM J. Imaging Sci. 7, 1724–1754.CrossRefGoogle Scholar
Oliveira, D. E., Wolkowicz, H. and Xu, Y. (2018), ADMM for the SDP relaxation of the QAP, Math. Program. Comput. 10, 631–658.CrossRefGoogle Scholar
Papadakis, N., Peyré, G. and Oudet, E. (2014), Optimal transport with proximal splitting, SIAM J. Imaging Sci. 7, 212–238.CrossRefGoogle Scholar
Papakonstantinou, J. M. and Tapia, R. A. (2013), Origin and evolution of the secant method in one dimension, Amer. Math. Monthly 120, 500–518.CrossRefGoogle Scholar
Pascali, D. and Sburlan, S. (1978), Nonlinear Mappings of Monotone Type, Editura Academiei, Bucharest.CrossRefGoogle Scholar
Passty, G. B. (1979), Ergodic convergence to a zero of the sum of monotone operators in Hilbert space, J. Math. Anal. Appl. 72, 383–390.CrossRefGoogle Scholar
Pathak, R. and Wainwright, M. J. (2020), FedSplit: An algorithmic framework for fast federated optimization, in Advances in Neural Information Processing Systems 33 (Larochelle, H. et al., eds), Curran Associates, pp. 7057–7066.Google Scholar
Peaceman, D. W. and Rachford, H. H. (1955), The numerical solution of parabolic and elliptic differential equations, J. Soc. Indust. Appl. Math. 3, 28–41.CrossRefGoogle Scholar
Pennanen, T. (2000), Dualization of generalized equations of maximal monotone type, SIAM J. Optim. 10, 809–835.CrossRefGoogle Scholar
Pennanen, T. (2002), A splitting method for composite mappings, Numer. Funct. Anal. Optim. 23, 875–890.CrossRefGoogle Scholar
Pesquet, J.-C. and Repetti, A. (2015), A class of randomized primal–dual algorithms for distributed optimization, J. Nonlinear Convex Anal. 16, 2453–2490.Google Scholar
Pesquet, J.-C., Repetti, A., Terris, M. and Wiaux, Y. (2021), Learning maximally monotone operators for image recovery, SIAM J. Imaging Sci. 14, 1206–1237.CrossRefGoogle Scholar
Petryshyn, W. V. (1966), On the extension and solution of nonlinear operator equations, Illinois J. Math. 10, 255–274.CrossRefGoogle Scholar
Phillips, D. L. (1962), A technique for the numerical solution of certain integral equations of the first kind, J. Assoc. Comput. Mach. 9, 84–97.CrossRefGoogle Scholar
Phillips, R. S. (1959), Dissipative operators and hyperbolic systems of partial differential equations, Trans. Amer. Math. Soc. 90, 193–254.CrossRefGoogle Scholar
Pierra, G. (1976), Éclatement de contraintes en parallèle pour la minimisation d’une forme quadratique, in Optimization Techniques: Modeling and Optimization in the Service of Man 2, Vol. 41 of Lecture Notes in Computer Science, Springer, pp. 200–218.CrossRefGoogle Scholar
Pierra, G. (1984), Decomposition through formalization in a product space, Math. Program. 28, 96–115.CrossRefGoogle Scholar
Polyak, B. T. (1964), Some methods of speeding up the convergence of iteration methods, USSR Comput. Math. Math. Phys. 4, 1–17.CrossRefGoogle Scholar
Potter, L. C. and Arun, K. S. (1993), A dual approach to linear inverse problems with convex constraints, SIAM J. Control Optim. 31, 1080–1092.CrossRefGoogle Scholar
Powell, M. J. D. (1969), A method for nonlinear constraints in minimization problems, in Optimization (Fletcher, R., ed.), Academic, pp. 283–298.Google Scholar
Qin, X. and An, N. T. (2019), Smoothing algorithms for computing the projection onto a Minkowski sum of convex sets, Comput. Optim. Appl. 74, 821–850.CrossRefGoogle Scholar
Raguet, H. (2019), A note on the forward–Douglas–Rachford splitting for monotone inclusion and convex optimization, Optim. Lett. 13, 717–740.CrossRefGoogle Scholar
Raguet, H. and Landrieu, L. (2015), Preconditioning of a generalized forward–backward splitting and application to optimization on graphs, SIAM J. Imaging Sci. 8, 2706–2739.CrossRefGoogle Scholar
Raguet, H., Fadili, J. and Peyré, G. (2013), A generalized forward–backward splitting, SIAM J. Imaging Sci. 6, 1199–1226.CrossRefGoogle Scholar
Raik, E. (1967), Fejér type methods in Hilbert space, Eesti NSV Tead. Akad. Toimetised Füüs.-Mat. 16, 286–293.Google Scholar
Raik, E. (1969), A class of iterative methods with Fejér-monotone sequences, Eesti NSV Tead.
.Akad. Toimetised Füüs.-Mat 18, 22–26.Google Scholar
Reich, S., Truong, M. T. and Mai, T. N. H. (2020), The split feasibility problem with multiple output sets in Hilbert spaces, Optim. Lett. 14, 2335–2353.CrossRefGoogle Scholar
Renaud, A. and Cohen, G. (1997), An extension of the auxiliary problem principle to nonsymmetric auxiliary operators, ESAIM Control Optim. Calc. Var. 2, 281–306.CrossRefGoogle Scholar
Robinson, S. M. (1998), A reduction method for variational inequalities, Math. Program. 80, 161–169.CrossRefGoogle Scholar
Robinson, S. M. (1999), Composition duality and maximal monotonicity, Math. Program. 85, 1–13.CrossRefGoogle Scholar
Robinson, S. M.(2001), Generalized duality in variational analysis, in Advances in Convex Analysis and Global Optimization (Hadjisavvas, N. and Pardalos, P. M., eds), Kluwer, pp. 205–219.CrossRefGoogle Scholar
Rockafellar, R. T. (1967), Duality and stability in extremum problems involving convex functions, Pacific J. Math. 21, 167–187.CrossRefGoogle Scholar
Rockafellar, R. T. (1969), Convex functions and duality in optimization problems and dynamics, in Mathematical Systems Theory and Economics I (Kuhn, H. W. and Szegö, G. P., eds), Springer, pp. 117–141.Google Scholar
Rockafellar, R. T. (1970b), Monotone operators associated with saddle-functions and minimax problems, in Nonlinear Functional Analysis, Part 1 (Browder, F. E., ed.), AMS, pp. 241–250.CrossRefGoogle Scholar
Rockafellar, R. T. (1971), Saddle-points and convex analysis, in Differential Games and Related Topics (Kuhn, H. W. and Szegö, G. P., eds), North-Holland, pp. 109–127.Google Scholar
Rockafellar, R. T. (1973), The multiplier method of Hestenes and Powell applied to convex programming, J. Optim. Theory Appl. 12, 555–562.CrossRefGoogle Scholar
Rockafellar, R. T. (1976a), Augmented Lagrangians and applications of the proximal point algorithm in convex programming, Math. Oper. Res. 1, 97–116.CrossRefGoogle Scholar
Rockafellar, R. T. (1976b), Monotone operators and the proximal point algorithm, SIAM J. Control Optim. 14, 877–898.CrossRefGoogle Scholar
Rockafellar, R. T. (1995), Monotone relations and network equilibrium, in Variational Inequalities and Network Equilibrium Problems (Giannessi, F. and Maugeri, A., eds), Plenum, pp. 271–288.Google Scholar
Rockafellar, R. T. (2024), Generalizations of the proximal method of multipliers in convex optimization, Comput. Optim. Appl. 87, 219–247.CrossRefGoogle Scholar
Rockafellar, R. T. and Sun, J. (2019), Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging, Math. Program. A174, 453–471.CrossRefGoogle Scholar
Rockafellar, R. T. and Wets, R. J. B. (1991), Scenarios and policy aggregation in optimization under uncertainty, Math. Oper. Res. 16, 1–29.CrossRefGoogle Scholar
Ryu, E. K. (2020), Uniqueness of DRS as the 2 operator resolvent-splitting and impossibility of 3 operator resolvent-splitting, Math. Program. A182, 233–273.CrossRefGoogle Scholar
Ryu, E. K. and Vũ, B. C. (2020), Finding the forward–Douglas–Rachford-forward method, J. Optim. Theory Appl. 184, 858–876.CrossRefGoogle Scholar
Ryu, E. K., Liu, Y. and Yin, W. (2019), Douglas–Rachford splitting and ADMM for pathological convex optimization, Comput. Optim. Appl. 74, 747–778.CrossRefGoogle Scholar
Ryu, E. K., Taylor, A. B., Bergeling, C. and Giselsson, P. (2020), Operator splitting performance estimation: Tight contraction factors and optimal parameter selection, SIAM J. Optim. 30, 2251–2271.CrossRefGoogle Scholar
Salzo, S. and Villa, S. (2022), Parallel random block-coordinate forward–backward algorithm: A unified convergence analysis, Math. Program. A193, 225–269.CrossRefGoogle Scholar
Seeger, A. (1998), Alternating projection and decomposition with respect to two convex sets, Math. Japon. 47, 273–280.Google Scholar
Shefi, R. and Teboulle, M. (2014), Rate of convergence analysis of decomposition methods based on the proximal method of multipliers for convex minimization, SIAM J. Optim. 24, 269–297.CrossRefGoogle Scholar
Showalter, R. E. (1997), Monotone Operators in Banach Space and Nonlinear Partial Differential Equations, American Mathematical Society.Google Scholar
Sibony, M. (1970), Méthodes itératives pour les équations et inéquations aux dérivées partielles non linéaires de type monotone, Calcolo 7, 65–183.CrossRefGoogle Scholar
Sicre, M. R. (2020), On the complexity of a hybrid proximal extragradient projective method for solving monotone inclusion problems, Comput. Optim. Appl. 76, 991–1019.CrossRefGoogle Scholar
Singh, S., Weiss, G. and Tucsnak, M. (2022), A class of incrementally scattering-passive nonlinear systems, Automatica 142, art. 110369.CrossRefGoogle Scholar
Solodov, M. V. (2004), A class of decomposition methods for convex optimization and monotone variational inclusions via the hybrid inexact proximal point framework, Optim. Methods Softw. 19, 557–575.CrossRefGoogle Scholar
Solodov, M. V. and Svaiter, B. F. (1999a), A hybrid approximate extragradient-proximal point algorithm using the enlargement of a maximal monotone operator, Set-Valued Var.
.Anal 7, 323–345.CrossRefGoogle Scholar
Solodov, M. V. and Svaiter, B. F. (1999b), A hybrid projection-proximal point algorithm, J. Convex Anal. 6, 59–70.Google Scholar
Solodov, M. V. and Svaiter, B. F. (2000), Forcing strong convergence of proximal point iterations in a Hilbert space, Math. Program. A87, 189–202.CrossRefGoogle Scholar
Solodov, M. V. and Svaiter, B. F. (2001), A unified framework for some inexact proximal point algorithms, Numer. Funct. Anal. Optim. 22, 1013–1035.CrossRefGoogle Scholar
Spingarn, J. E. (1983), Partial inverse of a monotone operator, Appl. Math. Optim. 10, 247–265.CrossRefGoogle Scholar
Spingarn, J. E. (1985), Applications of the method of partial inverses to convex programming: Decomposition, Math. Program. 32, 199–223.CrossRefGoogle Scholar
Spingarn, J. E. (1987), A projection method for least-squares solutions to overdetermined systems of linear inequalities, Linear Algebra Appl. 86, 211–236.CrossRefGoogle Scholar
Steidl, G. and Teuber, T. (2010), Removing multiplicative noise by Douglas–Rachford splitting methods, J. Math. Imaging Vision 36, 168–184.CrossRefGoogle Scholar
Svaiter, B. F. (2011), On weak convergence of the Douglas–Rachford method, SIAM J. Control Optim. 49, 280–287.CrossRefGoogle Scholar
Svaiter, B. F. (2014), A class of Fejér convergent algorithms, approximate resolvents and the hybrid proximal-extragradient method, J. Optim. Theory Appl. 162, 133–153.CrossRefGoogle Scholar
Teboulle, M. (1992), Entropic proximal mappings with applications to nonlinear programming, Math. Oper. Res. 17, 670–690.CrossRefGoogle Scholar
Teboulle, M. (2018), A simplified view of first order methods for optimization, Math. Program. B170, 67–96.CrossRefGoogle Scholar
Tellegen, B. D. H. (1948), The gyrator, a new electric network element, Philips Res. Rept. 3, 81–101.Google Scholar
Thekumparampil, K. K., Jain, P., Netrapalli, P. and Oh, S. (2019), Efficient algorithms for smooth minimax optimization, in Advances in Neural Information Processing Systems 32 (Wallach, H. et al., eds), Curran Associates.Google Scholar
Traoré, C., Salzo, S. and Villa, S. (2023), Convergence of an asynchronous block-coordinate forward–backward algorithm for convex composite optimization, Comput. Optim. Appl. 86, 303–344.CrossRefGoogle Scholar
Tseng, P. (1990), Further applications of a splitting algorithm to decomposition in variational inequalities and convex programming, Math. Program. 48, 249–263.CrossRefGoogle Scholar
Tseng, P. (1991), Applications of a splitting algorithm to decomposition in convex programming and variational inequalities, SIAM J. Control Optim. 29, 119–138.CrossRefGoogle Scholar
Tseng, P. (2000), A modified forward–backward splitting method for maximal monotone mappings, SIAM J. Control Optim. 38, 431–446.CrossRefGoogle Scholar
Vaĭnberg, M. M. (1956), Variatsionnye Metody Issledovaniya Nelineinykh Operatorov, Gosudarstv. Izdat. Tehn.-Teor. Lit., Moscow. English translation: Variational Methods for the Study of Non-Linear Operators, Holden-Day (1964).Google Scholar
Vaĭnberg, M. M. (1959), New theorems for non-linear operators and equations, Dokl. Akad. Nauk SSSR 129, 1199–1202.Google Scholar
Vaĭnberg, M. M. (1960), On the convergence of the method of steepest descent for nonlinear equations, Dokl. Akad. Nauk SSSR 130, 9–12.Google Scholar
Vaĭnberg, M. M. (1961), On the convergence of the process of steepest descent for nonlinear equations, Sibirsk. Mat. Zh. 2, 201–220.Google Scholar
Vaĭnberg, M. M. (1972), Variational Method and Method of Monotone Operators in the Theory of Nonlinear Equations, Nauka. English translation: Wiley (1973).Google Scholar
Vaĭnberg, M. M. and Kačurovskiĭ, R. I. (1959), On the variational theory of nonlinear operators and equations, Dokl. Akad. Nauk SSSR 129, 1199–1202.Google Scholar
Vaiter, S., Peyré, G. and Fadili, J. (2018), Model consistency of partly smooth regularizers, IEEE Trans. Inform. Theory 64, 1725–1737.CrossRefGoogle Scholar
Veinott, A. F. (1967), The supporting hyperplane method for unimodal programming, Oper. Res. 15, 147–152.CrossRefGoogle Scholar
Vese, L. A. and Osher, S. J. (2004), Image denoising and decomposition with total variation minimization and oscillatory functions, J. Math. Imaging Vision 20, 7–18.CrossRefGoogle Scholar
Villa, S., Rosasco, L., Mosci, S. and Verri, A. (2014), Proximal methods for the latent group lasso penalty, Comput. Optim. Appl. 58, 381–407.CrossRefGoogle Scholar
Vishik, M. I. (1961), Boundary-value problems for quasilinear strongly elliptic systems of equations having divergence form, Soviet Math. Dokl. 2, 643–647.Google Scholar
Vũ, B. C. (2013), A splitting algorithm for dual monotone inclusions involving cocoercive operators, Adv. Comput. Math. 38, 667–681.CrossRefGoogle Scholar
Wang, X., Zhang, J. and Zhang, W. (2020), The distance between convex sets with Minkowski sum structure: Application to collision detection, Comput. Optim. Appl. 77, 465–490.CrossRefGoogle Scholar
Winston, E. and Kolter, J. Z. (2020), Monotone operator equilibrium networks, in Advances in Neural Information Processing Systems 33 (Larochelle, H. et al., eds), Curran Associates, pp. 10718–10728.Google Scholar
Won, J.-H., Xu, J. and Lange, K. (2019), Projection onto Minkowski sums with application to constrained learning, in Proceedings of the 36th International Conference on Machine Learning (Chaudhuri, K. and Salakhutdinov, R., eds), Vol. 97 of Proceedings of Machine Learning Research, PMLR, pp. 3642–3651.Google Scholar
Wright, S. J. and Recht, B. (2022), Optimization for Data Analysis, Cambridge University Press.CrossRefGoogle Scholar
Xue, F. (2023a), Equivalent resolvents of Douglas–Rachford splitting and other operator splitting algorithms: A unified degenerate proximal point analysis, Optimization. Available at doi:10.1080/02331934.2023.2231005.CrossRefGoogle Scholar
Xue, F. (2023b), A generalized forward–backward splitting operator: Degenerate analysis and applications, Comput. Appl. Math. 42, art. 9.CrossRefGoogle Scholar
Yan, X. and Bien, J. (2021), Rare feature selection in high dimensions, J. Amer. Statist. Assoc. 116, 887–900.CrossRefGoogle Scholar
Yi, P. and Ching, S. (2020), Synthesis of recurrent neural dynamics for monotone inclusion with application to Bayesian inference, Neural Networks 131, 231–241.CrossRefGoogle ScholarPubMed
Yoon, T. and Ryu, E. K. (2021), Accelerated algorithms for smooth convex-concave minimax problems with
$\mathcal{O}\left(1/{k}^2\right)$
rate on squared gradient norm, in Proceedings of the 38th International Conference on Machine Learning (Meila, M. and Zhang, T., eds), Vol. 139 of Proceedings of Machine Learning Research, PMLR, pp. 12098–12109.Google Scholar
rate on squared gradient norm, in Proceedings of the 38th International Conference on Machine Learning (Meila, M. and Zhang, T., eds), Vol. 139 of Proceedings of Machine Learning Research, PMLR, pp. 12098–12109.Google ScholarYoula, D. C. (1987), Mathematical theory of image restoration by the method of convex projections, in Image Recovery: Theory and Application (Stark, H., ed.), Academic Press, pp. 29–77.Google Scholar
Yu, Y., Peng, J., Han, X. and Cui, A. (2017), A primal Douglas–Rachford splitting method for the constrained minimization problem in compressive sensing, Circuits Syst. Signal Process. 36, 4022–4049.CrossRefGoogle Scholar
Zames, G. (1966a), On the input–output stability of time-varying nonlinear feedback systems part I: Conditions derived using concepts of loop gain, conicity, and positivity, IEEE Trans. Automat. Control 11, 228–238.CrossRefGoogle Scholar
Zames, G. (1966b), On the input–output stability of time-varying nonlinear feedback systems part II: Conditions involving circles in the frequency plane and sector nonlinearities, IEEE Trans. Automat. Control 11, 465–476.CrossRefGoogle Scholar
Zames, G. and Falb, P. L. (1968), Stability conditions for systems with monotone and slope-restricted nonlinearities, SIAM J. Control 6, 89–108.CrossRefGoogle Scholar
Zarantonello, E. H. (1960), Solving functional equations by contractive averaging. Mathematical Research Center technical summary report no. 160, University of Wisconsin, Madison.Google Scholar
Zarantonello, E. H. (1964), The closure of the numerical range contains the spectrum, Bull. Amer. Math. Soc. 70, 781–787.CrossRefGoogle Scholar
Zarantonello, E. H., ed. (1971), Contributions to Nonlinear Functional Analysis, Academic.Google Scholar
Zeidler, E. (1990), Nonlinear Functional Analysis and its Applications II/B: Nonlinear Monotone Operators, Springer.Google Scholar