-
Approaches to iterative algorithms for solving nonlinear equations with an application in tomographic absorption spectroscopy
Authors:
F. J. Aragón-Artacho,
W. Cai,
Y. Censor,
A. Gibali,
C. Shui,
D. Torregrosa-Belén
Abstract:
In this paper we propose an approach for solving systems of nonlinear equations without computing function derivatives. Motivated by the application area of tomographic absorption spectroscopy, which is a highly-nonlinear problem with variables coupling, we consider a situation where straightforward translation to a fixed point problem is not possible because the operators that represent the relev…
▽ More
In this paper we propose an approach for solving systems of nonlinear equations without computing function derivatives. Motivated by the application area of tomographic absorption spectroscopy, which is a highly-nonlinear problem with variables coupling, we consider a situation where straightforward translation to a fixed point problem is not possible because the operators that represent the relevant systems of nonlinear equations are not self-map**s, i.e., they operate between spaces of different dimensions. To overcome this difficulty we suggest an "alternating common fixed points algorithm" that acts alternatingly on the different vector variables. This approach translates the original problem to a common fixed point problem for which iterative algorithms are abound and exhibits a viable alternative to translation to an optimization problem, which usually requires derivatives information. However, to apply any of these iterative algorithms requires to ascertain the conditions that appear in their convergence theorems. To circumvent the need to verify conditions for convergence, we propose and motivate a derivative-free algorithm that better suits the tomographic absorption spectroscopy problem at hand and is even further improved by applying to it the superiorization approach. This is presented along with experimental results that demonstrate our approach.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Superiorization: The asymmetric roles of feasibility-seeking and objective function reduction
Authors:
Yair Censor
Abstract:
The superiorization methodology can be thought of as lying conceptually between feasibility-seeking and constrained minimization. It is not trying to solve the full-fledged constrained minimization problem composed from the modeling constraints and the chosen objective function. Rather, the task is to find a feasible point which is "superior" (in a well-defined manner) with respect to the objectiv…
▽ More
The superiorization methodology can be thought of as lying conceptually between feasibility-seeking and constrained minimization. It is not trying to solve the full-fledged constrained minimization problem composed from the modeling constraints and the chosen objective function. Rather, the task is to find a feasible point which is "superior" (in a well-defined manner) with respect to the objective function, to one returned by a feasibility-seeking only algorithm. We telegraphically review the superiorization methodology and where it stands today and propose a rigorous formulation of its, yet only partially resolved, guarantee problem. The real-world situation in an application field is commonly represented by constraints defined by the modeling process and the data, obtained from measurements or otherwise dictated by the model-user. The feasibility-seeking problem requires to find a point in the intersection of all constraints without using any objective function to aim at any specific feasible point. At the heart of the superiorization methodology lies the modeler desire to use an objective function, that is exogenous to the constraints, in order to seek a feasible solution that will have lower (not necessarily minimal) objective function value. This aim is less demanding than full-fledged constrained minimization but more demanding than plain feasibility-seeking. Putting emphasis on the need to satisfy the constraints, because they represent the real-world situation, one recognizes the "asymmetric roles of feasibility-seeking and objective function reduction", namely, that fulfilling the constraints is the main task while reduction of the exogenous objective function plays only a secondary role. There are two research directions in the superiorization methodology: Weak superiorization and strong superiorization.
△ Less
Submitted 30 December, 2022;
originally announced December 2022.
-
Superiorization as a novel strategy for linearly constrained inverse radiotherapy treatment planning
Authors:
Florian Barkmann,
Yair Censor,
Niklas Wahl
Abstract:
We apply the superiorization methodology to the intensity-modulated radiation therapy (IMRT) treatment planning problem. In superiorization, linear voxel dose inequality constraints are the fundamental modeling tool within which a feasibility-seeking projection algorithm will seek a feasible point. This algorithm is then perturbed with gradient descent steps to reduce a nonlinear objective functio…
▽ More
We apply the superiorization methodology to the intensity-modulated radiation therapy (IMRT) treatment planning problem. In superiorization, linear voxel dose inequality constraints are the fundamental modeling tool within which a feasibility-seeking projection algorithm will seek a feasible point. This algorithm is then perturbed with gradient descent steps to reduce a nonlinear objective function. Within the open-source inverse planning toolkit matRad, we implement a prototypical algorithmic framework for superiorization using the well-established Agmon, Motzkin, and Schoenberg (AMS) feasibility-seeking projection algorithm and common nonlinear dose optimization objective functions. Based on this prototype, we apply superiorization to intensity-modulated radiation therapy treatment planning and compare its performance with feasibility-seeking and nonlinear constrained optimization. For these comparisons, we use the TG119 water phantom and a head-and-neck patient of the CORT dataset. Bare feasibility-seeking with AMS confirms previous studies, showing it can find solutions that are nearly equivalent to those found by the established piece-wise least-squares optimization approach. The superiorization prototype solved the linearly constrained planning problem with similar performance to that of a general-purpose nonlinear constrained optimizer while showing smooth convergence in both constraint proximity and objective function reduction. Superiorization is a useful alternative to constrained optimization in radiotherapy inverse treatment planning. Future extensions with other approaches to feasibility-seeking, e.g., with dose-volume constraints and more sophisticated perturbations, may unlock its full potential for high-performant inverse treatment planning.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
The superiorization method with restarted perturbations for split minimization problems with an application to radiotherapy treatment planning
Authors:
Francisco J. Aragón-Artacho,
Yair Censor,
Aviv Gibali,
David Torregrosa-Belén
Abstract:
In this paper we study the split minimization problem that consists of two constrained minimization problems in two separate spaces that are connected via a linear operator that maps one space into the other. To handle the data of such a problem we develop a superiorization approach that can reach a feasible point with reduced (not necessarily minimal) objective function values. The superiorizatio…
▽ More
In this paper we study the split minimization problem that consists of two constrained minimization problems in two separate spaces that are connected via a linear operator that maps one space into the other. To handle the data of such a problem we develop a superiorization approach that can reach a feasible point with reduced (not necessarily minimal) objective function values. The superiorization methodology is based on interlacing the iterative steps of two separate and independent iterative processes by perturbing the iterates of one process according to the steps dictated by the other process. We include in our developed method two novel elements. The first one is the permission to restart the perturbations in the superiorized algorithm which results in a significant acceleration and increases the computational efficiency. The second element is the ability to independently superiorize subvectors. This caters to the needs of real-world applications, as demonstrated here for a problem in intensity-modulated radiation therapy treatment planning.
△ Less
Submitted 3 May, 2024; v1 submitted 12 July, 2022;
originally announced July 2022.
-
Developments in Mathematical Algorithms and Computational Tools for Proton CT and Particle Therapy Treatment Planning
Authors:
Yair Censor,
Keith E. Schubert,
Reinhard W. Schulte
Abstract:
We summarize recent results and ongoing activities in mathematical algorithms and computer science methods related to proton computed tomography (pCT) and intensity-modulated particle therapy (IMPT) treatment planning. Proton therapy necessitates a high level of delivery accuracy to exploit the selective targeting imparted by the Bragg peak. For this purpose, pCT utilizes the proton beam itself to…
▽ More
We summarize recent results and ongoing activities in mathematical algorithms and computer science methods related to proton computed tomography (pCT) and intensity-modulated particle therapy (IMPT) treatment planning. Proton therapy necessitates a high level of delivery accuracy to exploit the selective targeting imparted by the Bragg peak. For this purpose, pCT utilizes the proton beam itself to create images. The technique works by sending a low-intensity beam of protons through the patient and measuring the position, direction, and energy loss of each exiting proton. The pCT technique allows reconstruction of the volumetric distribution of the relative stop** power (RSP) of the patient tissues for use in treatment planning and pre-treatment range verification. We have investigated new ways to make the reconstruction both efficient and accurate. Better accuracy of RSP also enables more robust inverse approaches to IMPT. For IMPT, we developed a framework for performing intensity-modulation of the proton pencil beams. We expect that these developments will lead to additional project work in the years to come, which requires a regular exchange between experts in the fields of mathematics, computer science, and medical physics. We have initiated such an exchange by organizing annual workshops on pCT and IMPT algorithm and technology developments. This report is, admittedly, tilted toward our interdisciplinary work and methods. We offer a comprehensive overview of results, problems, and challenges in pCT and IMPT with the aim of making other scientists wanting to tackle such issues and to strengthen their interdisciplinary collaboration by bringing together cutting-edge know-how from medicine, computer science, physics, and mathematics to bear on medical physics problems at hand.
△ Less
Submitted 21 August, 2021;
originally announced August 2021.
-
Dynamic string-averaging CQ-methods for the split feasibility problem with percentage violation constraints arising in radiation therapy treatment planning
Authors:
Mark Brooke,
Yair Censor,
Aviv Gibali
Abstract:
In this paper we study a feasibility-seeking problem with percentage violation constraints. These are additional constraints, that are appended to an existing family of constraints, which single out certain subsets of the existing constraints and declare that up to a specified fraction of the number of constraints in each subset is allowed to be violated by up to a specified percentage of the exis…
▽ More
In this paper we study a feasibility-seeking problem with percentage violation constraints. These are additional constraints, that are appended to an existing family of constraints, which single out certain subsets of the existing constraints and declare that up to a specified fraction of the number of constraints in each subset is allowed to be violated by up to a specified percentage of the existing bounds. Our motivation to investigate problems with percentage violation constraints comes from the field of radiation therapy treatment planning wherein the fully-discretized inverse planning problem is formulated as a split feasibility problem and the percentage violation constraints give rise to non-convex constraints. Following the CQ algorithm of Byrne (2002, Inverse Problems, Vol. 18, pp. 441-53), we develop a string-averaging CQ method that uses only projections onto the individual sets which are half-spaces represented by linear inequalities. The question of extending our theoretical results to the non-convex sets case is still open. We describe how our results apply to radiation therapy treatment planning and provide a numerical example.
△ Less
Submitted 4 January, 2021; v1 submitted 27 November, 2019;
originally announced November 2019.
-
An analysis of the superiorization method via the principle of concentration of measure
Authors:
Yair Censor,
Eliahu Levy
Abstract:
The superiorization methodology is intended to work with input data of constrained minimization problems, i.e., a target function and a constraints set. However, it is based on an antipodal way of thinking to the thinking that leads constrained minimization methods. Instead of adapting unconstrained minimization algorithms to handling constraints, it adapts feasibility-seeking algorithms to reduce…
▽ More
The superiorization methodology is intended to work with input data of constrained minimization problems, i.e., a target function and a constraints set. However, it is based on an antipodal way of thinking to the thinking that leads constrained minimization methods. Instead of adapting unconstrained minimization algorithms to handling constraints, it adapts feasibility-seeking algorithms to reduce (not necessarily minimize) target function values. This is done while retaining the feasibility-seeking nature of the algorithm and without paying a high computational price. A guarantee that the local target function reduction steps properly accumulate to a global target function value reduction is still missing in spite of an ever-growing body of publications that supply evidence of the success of the superiorization method in various problems. We propose an analysis based on the principle of concentration of measure that attempts to alleviate the guarantee question of the superiorization method.
△ Less
Submitted 1 September, 2019;
originally announced September 2019.
-
Derivative-Free Superiorization: Principle and Algorithm
Authors:
Yair Censor,
Edgar Garduño,
Elias S. Helou,
Gabor T. Herman
Abstract:
The superiorization methodology is intended to work with input data of constrained minimization problems, that is, a target function and a set of constraints. However, it is based on an antipodal way of thinking to what leads to constrained minimization methods. Instead of adapting unconstrained minimization algorithms to handling constraints, it adapts feasibility-seeking algorithms to reduce (no…
▽ More
The superiorization methodology is intended to work with input data of constrained minimization problems, that is, a target function and a set of constraints. However, it is based on an antipodal way of thinking to what leads to constrained minimization methods. Instead of adapting unconstrained minimization algorithms to handling constraints, it adapts feasibility-seeking algorithms to reduce (not necessarily minimize) target function values. This is done by inserting target-function-reducing perturbations into a feasibility-seeking algorithm while retaining its feasibility-seeking ability and without paying a high computational price. A superiorized algorithm that employs component-wise target function reduction steps is presented. This enables derivative-free superiorization (DFS), meaning that superiorization can be applied to target functions that have no calculable partial derivatives or subgradients. The numerical behavior of our derivative-free superiorization algorithm is illustrated on a data set generated by simulating a problem of image reconstruction from projections. We present a tool (we call it a proximity-target curve) for deciding which of two iterative methods is "better" for solving a particular problem. The plots of proximity-target curves of our experiments demonstrate the advantage of the proposed derivative-free superiorization algorithm.
△ Less
Submitted 23 October, 2020; v1 submitted 27 August, 2019;
originally announced August 2019.
-
Derivative-free superiorization with component-wise perturbations
Authors:
Yair Censor,
Howard Heaton,
Reinhard Schulte
Abstract:
Superiorization reduces, not necessarily minimizes, the value of a target function while seeking constraints-compatibility. This is done by taking a solely feasibility-seeking algorithm, analyzing its perturbations resilience, and proactively perturbing its iterates accordingly to steer them toward a feasible point with reduced value of the target function. When the perturbation steps are computat…
▽ More
Superiorization reduces, not necessarily minimizes, the value of a target function while seeking constraints-compatibility. This is done by taking a solely feasibility-seeking algorithm, analyzing its perturbations resilience, and proactively perturbing its iterates accordingly to steer them toward a feasible point with reduced value of the target function. When the perturbation steps are computationally efficient, this enables generation of a superior result with essentially the same computational cost as that of the original feasibility-seeking algorithm. In this work, we refine previous formulations of the superiorization method to create a more general framework, enabling target function reduction steps that do not require partial derivatives of the target function. In perturbations that use partial derivatives the step-sizes in the perturbation phase of the superiorization method are chosen independently from the choice of the nonascent directions. This is no longer true when component-wise perturbations are employed. In that case, the step-sizes must be linked to the choice of the nonascent direction in every step. Besides presenting and validating these notions, we give a computational demonstration of superiorization with component-wise perturbations for a problem of computerized tomography image reconstruction.
△ Less
Submitted 31 March, 2018;
originally announced April 2018.
-
An Improved Method of Total Variation Superiorization Applied to Reconstruction in Proton Computed Tomography
Authors:
Blake Schultze,
Yair Censor,
Paniz Karbasi,
Keith E. Schubert,
Reinhard W. Schulte
Abstract:
Previous work showed that total variation superiorization (TVS) improves reconstructed image quality in proton computed tomography (pCT). The structure of the TVS algorithm has evolved since then and this work investigated if this new algorithmic structure provides additional benefits to pCT image quality. Structural and parametric changes introduced to the original TVS algorithm included: (1) inc…
▽ More
Previous work showed that total variation superiorization (TVS) improves reconstructed image quality in proton computed tomography (pCT). The structure of the TVS algorithm has evolved since then and this work investigated if this new algorithmic structure provides additional benefits to pCT image quality. Structural and parametric changes introduced to the original TVS algorithm included: (1) inclusion or exclusion of TV reduction requirement, (2) a variable number, $N$, of TV perturbation steps per feasibility-seeking iteration, and (3) introduction of a perturbation kernel $0<α<1$. The structural change of excluding the TV reduction requirement check tended to have a beneficial effect for $3\le N\le 6$ and allows full parallelization of the TVS algorithm. Repeated perturbations per feasibility-seeking iterations reduced total variation (TV) and material dependent standard deviations for $3\le N\le 6$. The perturbation kernel $α$, equivalent to $α=0.5$ in the original TVS algorithm, reduced TV and standard deviations as $α$ was increased beyond $α=0.5$, but negatively impacted reconstructed relative stop** power (RSP) values for $α>0.75$. The reductions in TV and standard deviations allowed feasibility-seeking with a larger relaxation parameter $λ$ than previously used, without the corresponding increases in standard deviations experienced with the original TVS algorithm. This work demonstrates that the modifications related to the evolution of the original TVS algorithm provide benefits in terms of both pCT image quality and computational efficiency for appropriately chosen parameter values.
△ Less
Submitted 17 January, 2019; v1 submitted 3 March, 2018;
originally announced March 2018.
-
Sparsity constrained split feasibility for dose-volume constraints in inverse planning of intensity-modulated photon or proton therapy
Authors:
S. Penfold,
R. Zalas,
M. Casiraghi,
M. Brooke,
Y. Censor,
R. Schulte
Abstract:
A split feasibility formulation for the inverse problem of intensity-modulated radiation therapy (IMRT) treatment planning with dose-volume constraints (DVCs) included in the planning algorithm is presented. It involves a new type of sparsity constraint that enables the inclusion of a percentage-violation constraint in the model problem and its handling by continuous (as opposed to integer) method…
▽ More
A split feasibility formulation for the inverse problem of intensity-modulated radiation therapy (IMRT) treatment planning with dose-volume constraints (DVCs) included in the planning algorithm is presented. It involves a new type of sparsity constraint that enables the inclusion of a percentage-violation constraint in the model problem and its handling by continuous (as opposed to integer) methods. We propose an iterative algorithmic framework for solving such a problem by applying the feasibility-seeking CQ-algorithm of Byrne combined with the automatic relaxation method (ARM) that uses cyclic projections. Detailed implementation instructions are furnished. Functionality of the algorithm was demonstrated through the creation of an intensity-modulated proton therapy plan for a simple 2D C-shaped geometry and also for a realistic base-of-skull chordoma treatment site. Monte Carlo simulations of proton pencil beams of varying energy were conducted to obtain dose distributions for the 2D test case. A research release of the Pinnacle3 proton treatment planning system was used to extract pencil beam doses for a clinical base-of-skull chordoma case. In both cases the beamlet doses were calculated to satisfy dose-volume constraints according to our new algorithm. Examination of the dose-volume histograms following inverse planning with our algorithm demonstrated that it performed as intended. The application of our proposed algorithm to dose-volume constraint inverse planning was successfully demonstrated. Comparison with optimized dose distributions from the research release of the Pinnacle3 treatment planning system showed the algorithm could achieve equivalent or superior results.
△ Less
Submitted 25 February, 2017;
originally announced February 2017.
-
Techniques in Iterative Proton CT Image Reconstruction
Authors:
Scott Penfold,
Yair Censor
Abstract:
This is a review paper on some of the physics, modeling, and iterative algorithms in proton computed tomography (pCT) image reconstruction. The primary challenge in pCT image reconstruction lies in the degraded spatial resolution resulting from multiple Coulomb scattering within the imaged object. Analytical models such as the most likely path (MLP) have been proposed to predict the scattered traj…
▽ More
This is a review paper on some of the physics, modeling, and iterative algorithms in proton computed tomography (pCT) image reconstruction. The primary challenge in pCT image reconstruction lies in the degraded spatial resolution resulting from multiple Coulomb scattering within the imaged object. Analytical models such as the most likely path (MLP) have been proposed to predict the scattered trajectory from measurements of individual proton location and direction before and after the object. Iterative algorithms provide a flexible tool with which to incorporate these models into image reconstruction. The modeling leads to a large and sparse linear system of equations that can efficiently be solved by projection methods-based iterative algorithms. Such algorithms perform projections of the iterates onto the hyperlanes that are represented by the linear equations of the system. They perform these projections in possibly various algorithmic structures, such as block-iterative projections (BIP), string-averaging projections (SAP). These algorithmic schemes allow flexibility of choosing blocks, strings, and other parameters. They also cater for parallel implementations which are apt to further save clock time in computations. Experimental results are presented which compare some of those algorithmic options.
△ Less
Submitted 29 October, 2015;
originally announced October 2015.
-
String-Averaging Expectation-Maximization for Maximum Likelihood Estimation in Emission Tomography
Authors:
E. S. Helou,
Y. Censor,
T. -B. Chen,
I-L. Chern,
Á. R. De Pierro,
M. Jiang,
H. H. -S. Lu
Abstract:
We study the maximum likelihood model in emission tomography and propose a new family of algorithms for its solution, called String-Averaging Expectation-Maximization (SAEM). In the String-Averaging algorithmic regime, the index set of all underlying equations is split into subsets, called "strings," and the algorithm separately proceeds along each string, possibly in parallel. Then, the end-point…
▽ More
We study the maximum likelihood model in emission tomography and propose a new family of algorithms for its solution, called String-Averaging Expectation-Maximization (SAEM). In the String-Averaging algorithmic regime, the index set of all underlying equations is split into subsets, called "strings," and the algorithm separately proceeds along each string, possibly in parallel. Then, the end-points of all strings are averaged to form the next iterate. SAEM algorithms with several strings presents better practical merits than the classical Row-Action Maximum-Likelihood Algorithm (RAMLA). We present numerical experiments showing the effectiveness of the algorithmic scheme in realistic situations. Performance is evaluated from the computational cost and reconstruction quality viewpoints. A complete convergence theory is also provided.
△ Less
Submitted 11 February, 2014;
originally announced February 2014.
-
Performance of Hull-Detection Algorithms For Proton Computed Tomography Reconstruction
Authors:
Blake Schultze,
Micah Witt,
Yair Censor,
Reinhard Schulte,
Keith Evan Schubert
Abstract:
Proton computed tomography (pCT) is a novel imaging modality developed for patients receiving proton radiation therapy. The purpose of this work was to investigate hull-detection algorithms used for preconditioning of the large and sparse linear system of equations that needs to be solved for pCT image reconstruction. The hull-detection algorithms investigated here included silhouette/space carvin…
▽ More
Proton computed tomography (pCT) is a novel imaging modality developed for patients receiving proton radiation therapy. The purpose of this work was to investigate hull-detection algorithms used for preconditioning of the large and sparse linear system of equations that needs to be solved for pCT image reconstruction. The hull-detection algorithms investigated here included silhouette/space carving (SC), modified silhouette/space carving (MSC), and space modeling (SM). Each was compared to the cone-beam version of filtered backprojection (FBP) used for hull-detection. Data for testing these algorithms included simulated data sets of a digital head phantom and an experimental data set of a pediatric head phantom obtained with a pCT scanner prototype at Loma Linda University Medical Center. SC was the fastest algorithm, exceeding the speed of FBP by more than 100 times. FBP was most sensitive to the presence of noise. Ongoing work will focus on optimizing threshold parameters in order to define a fast and efficient method for hull-detection in pCT image reconstruction.
△ Less
Submitted 7 February, 2014;
originally announced February 2014.
-
Feasibility-Seeking and Superiorization Algorithms Applied to Inverse Treatment Planning in Radiation Therapy
Authors:
R. Davidi,
Y. Censor,
R. W. Schulte,
S. Geneser,
L. Xing
Abstract:
We apply the recently proposed superiorization methodology (SM) to the inverse planning problem in radiation therapy. The inverse planning problem is represented here as a constrained minimization problem of the total variation (TV) of the intensity vector over a large system of linear two-sided inequalities. The SM can be viewed conceptually as lying between feasibility-seeking for the constraint…
▽ More
We apply the recently proposed superiorization methodology (SM) to the inverse planning problem in radiation therapy. The inverse planning problem is represented here as a constrained minimization problem of the total variation (TV) of the intensity vector over a large system of linear two-sided inequalities. The SM can be viewed conceptually as lying between feasibility-seeking for the constraints and full-fledged constrained minimization of the objective function subject to these constraints. It is based on the discovery that many feasibility-seeking algorithms (of the projection methods variety) are perturbation-resilient, and can be proactively steered toward a feasible solution of the constraints with a reduced, thus superiorized, but not necessarily minimal, objective function value.
△ Less
Submitted 6 February, 2014;
originally announced February 2014.
-
Superiorization: An optimization heuristic for medical physics
Authors:
G. T. Herman,
E. Garduño,
R. Davidi,
Y. Censor
Abstract:
Purpose: To describe and mathematically validate the superiorization methodology, which is a recently-developed heuristic approach to optimization, and to discuss its applicability to medical physics problem formulations that specify the desired solution (of physically given or otherwise obtained constraints) by an optimization criterion. Methods: The underlying idea is that many iterative algorit…
▽ More
Purpose: To describe and mathematically validate the superiorization methodology, which is a recently-developed heuristic approach to optimization, and to discuss its applicability to medical physics problem formulations that specify the desired solution (of physically given or otherwise obtained constraints) by an optimization criterion. Methods: The underlying idea is that many iterative algorithms for finding such a solution are perturbation resilient in the sense that, even if certain kinds of changes are made at the end of each iterative step, the algorithm still produces a constraints-compatible solution. This property is exploited by using permitted changes to steer the algorithm to a solution that is not only constraints-compatible, but is also desirable according to a specified optimization criterion. The approach is very general, it is applicable to many iterative procedures and optimization criteria used in medical physics. Results: The main practical contribution is a procedure for automatically producing from any given iterative algorithm its superiorized version, which will supply solutions that are superior according to a given optimization criterion. It is shown that if the original iterative algorithm satisfies certain mathematical conditions, then the output of its superiorized version is guaranteed to be as constraints-compatible as the output of the original algorithm, but it is superior to the latter according to the optimization criterion. This intuitive description is made precise in the paper and the stated claims are rigorously proved. Superiorization is illustrated on simulated computerized tomography data of a head cross-section and, in spite of its generality, superiorization is shown to be competitive to an optimization algorithm that is specifically designed to minimize total variation.
△ Less
Submitted 31 July, 2012;
originally announced August 2012.
-
Convergence and Perturbation Resilience of Dynamic String-Averaging Projection Methods
Authors:
Yair Censor,
Alexander J. Zaslavski
Abstract:
We consider the convex feasibility problem (CFP) in Hilbert space and concentrate on the study of string-averaging projection (SAP) methods for the CFP, analyzing their convergence and their perturbation resilience. In the past, SAP methods were formulated with a single predetermined set of strings and a single predetermined set of weights. Here we extend the scope of the family of SAP methods to…
▽ More
We consider the convex feasibility problem (CFP) in Hilbert space and concentrate on the study of string-averaging projection (SAP) methods for the CFP, analyzing their convergence and their perturbation resilience. In the past, SAP methods were formulated with a single predetermined set of strings and a single predetermined set of weights. Here we extend the scope of the family of SAP methods to allow iteration-index-dependent variable strings and weights and term such methods dynamic string-averaging projection (DSAP) methods. The bounded perturbation resilience of DSAP methods is relevant and important for their possible use in the framework of the recently developed superiorization heuristic methodology for constrained minimization problems.
△ Less
Submitted 1 June, 2012;
originally announced June 2012.
-
Extrapolation and Local Acceleration of an Iterative Process for Common Fixed Point Problems
Authors:
Andrzej Cegielski,
Yair Censor
Abstract:
We consider sequential iterative processes for the common fixed point problem of families of cutter operators on a Hilbert space. These are operators that have the property that, for any point x\inH, the hyperplane through Tx whose normal is x-Tx always "cuts" the space into two half-spaces one of which contains the point x while the other contains the (assumed nonempty) fixed point set of T. We d…
▽ More
We consider sequential iterative processes for the common fixed point problem of families of cutter operators on a Hilbert space. These are operators that have the property that, for any point x\inH, the hyperplane through Tx whose normal is x-Tx always "cuts" the space into two half-spaces one of which contains the point x while the other contains the (assumed nonempty) fixed point set of T. We define and study generalized relaxations and extrapolation of cutter operators and construct extrapolated cyclic cutter operators. In this framework we investigate the Dos Santos local acceleration method in a unified manner and adopt it to a composition of cutters. For these we conduct convergence analysis of successive iteration algorithms.
△ Less
Submitted 19 April, 2012;
originally announced April 2012.
-
A von Neumann Alternating Method for Finding Common Solutions to Variational Inequalities
Authors:
Yair Censor,
Aviv Gibali,
Simeon Reich
Abstract:
Modifying von Neumann's alternating projections algorithm, we obtain an alternating method for solving the recently introduced Common Solutions to Variational Inequalities Problem (CSVIP). For simplicity, we mainly confine our attention to the two-set CSVIP, which entails finding common solutions to two unrelated variational inequalities in Hilbert space.
Modifying von Neumann's alternating projections algorithm, we obtain an alternating method for solving the recently introduced Common Solutions to Variational Inequalities Problem (CSVIP). For simplicity, we mainly confine our attention to the two-set CSVIP, which entails finding common solutions to two unrelated variational inequalities in Hilbert space.
△ Less
Submitted 3 February, 2012;
originally announced February 2012.
-
Total variation superiorization schemes in proton computed tomography image reconstruction
Authors:
S. N. Penfold,
R. W. Schulte,
Y. Censor,
A. B. Rosenfeld
Abstract:
Purpose: Iterative projection reconstruction algorithms are currently the preferred reconstruction method in proton computed tomography (pCT). However, due to inconsistencies in the measured data arising from proton energy straggling and multiple Coulomb scattering, noise in the reconstructed image increases with successive iterations. In the current work, we investigated the use of total variatio…
▽ More
Purpose: Iterative projection reconstruction algorithms are currently the preferred reconstruction method in proton computed tomography (pCT). However, due to inconsistencies in the measured data arising from proton energy straggling and multiple Coulomb scattering, noise in the reconstructed image increases with successive iterations. In the current work, we investigated the use of total variation superiorization (TVS) schemes that can be applied as an algorithmic add-on to perturbation-resilient iterative projection algorithms for pCT image reconstruction. Methods: The block-iterative diagonally relaxed orthogonal projections (DROP) algorithm was used for reconstructing Geant4 Monte Carlo simulated pCT data sets. Two TVS schemes added on to DROP were investigated; the first carried out the superiorization steps once per cycle and the second once per block. Simplifications of these schemes, involving the elimination of the computationally expensive feasibility proximity checking step of the TVS framework, were also investigated. The modulation transfer function and contrast discrimination function were used to quantify spatial and density resolution, respectively. Results: With both TVS schemes, superior spatial and density resolution was achieved compared to the standard DROP algorithm. Eliminating the feasibility proximity check improved the image quality, in particular image noise, in the once-per-block superiorization, while also halving image reconstruction time. Overall, the greatest image quality was observed when carrying out the superiorization once-per-block and eliminating the feasibility proximity check. Conclusions: The low contrast imaging made possible with TVS holds a promise for its incorporation into our future pCT studies.
△ Less
Submitted 8 October, 2010;
originally announced October 2010.
-
Perturbation Resilience and Superiorization of Iterative Algorithms
Authors:
Y. Censor,
R. Davidi,
G. T. Herman
Abstract:
Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little demand on computer resources. For other problems, such as finding that point in the intersection at which the value of a given function is optimal, algorithms ten…
▽ More
Iterative algorithms aimed at solving some problems are discussed. For certain problems, such as finding a common point in the intersection of a finite number of convex sets, there often exist iterative algorithms that impose very little demand on computer resources. For other problems, such as finding that point in the intersection at which the value of a given function is optimal, algorithms tend to need more computer memory and longer execution time. A methodology is presented whose aim is to produce automatically for an iterative algorithm of the first kind a "superiorized version" of it that retains its computational efficiency but nevertheless goes a long way towards solving an optimization problem. This is possible to do if the original algorithm is "perturbation resilient," which is shown to be the case for various projection algorithms for solving the consistent convex feasibility problem. The superiorized versions of such algorithms use perturbations that drive the process in the direction of the optimizer of the given function. After presenting these intuitive ideas in a precise mathematical form, they are illustrated in image reconstruction from projections for two different projection algorithms superiorized for the function whose value is the total variation of the image.
△ Less
Submitted 1 May, 2010;
originally announced May 2010.
