Feedback control for optimal process operation

The process industries are characterized by a large number of continuously operating plants, for which optimal operation is of economic importance. However, optimal operation is particularly difficult to achieve when the process model used in the optimization is inaccurate or in the presence of process disturbances. In highly automated plants, optimal operation is typically addressed by a decision hierarchy involving several levels that include plant scheduling, real-time optimization (RTO), and process control. At the RTO level, medium-term decisions are made by considering economic objectives explicitly. This step typically relies on an optimizer that determines the optimal steady-state operating point under slowly changing conditions such as catalyst decay or changes in raw material quality. This optimal operating point is characterized by setpoints that are passed to lower-level controllers. Model-based RTO typically involves nonlinear first-principles models that describe the steady-state behavior of the plant. Since accurate models are rarely available in industrial applications, RTO typically proceeds using an iterative two-step approach, namely a parameter estimation step followed by an optimization step. The idea is to repeatedly estimate selected uncertain model parameters and use the updated model to generate new inputs via optimization. This way, the model is expected to yield a better description of the plant at its current operating point. The classical two-step approach works well provided that (i) there is little structural plant-model mismatch, and (ii) the changing operating conditions provide sufficient excitation for estimating the uncertain model parameters. Unfortunately, such conditions are rarely met in practice and, in the presence of plant-model mismatch, the algorithm might not converge to the plant optimum, or worse, to a feasible operating point. As far as feasibility is concerned, the updated model should be able to match the plant constraints. Alternatively, feasibility can be enforced without requiring the solution of a parameter estimation problem by adding plant-model bias terms to the model outputs. These biases are obtained by subtracting the model outputs from the measured plant outputs. A bias-update scheme, where the bias terms are used to modify the constraints in the steady-state optimization problem, has been used in industry. However, the analysis of this scheme has received little attention in the research community. In the context of this thesis, such an RTO scheme is referred to as constraint adaptation. The constraint-adaptation scheme is studied, and its local convergence properties are analyzed. Constraint adaptation guarantees reaching a feasible operating point upon convergence. However, the constraints might be violated during the iterations of the algorithm, even when starting the adaptation from within the feasible region. Constraint violations can be avoided by controlling the constraints in the optimization problem, which is done at the process control level by means of model predictive control (MPC). The approach for integrating constraint adaptation with MPC described in this thesis places high emphasis on how constraints are handled. An alternative constraint-adaptation scheme is proposed, which permits one to move the constraint setpoints gradually in the constraint controller. The constraint-adaptation scheme, with and without the constraint controller, is illustrated in simulation through the real-time optimization of a fuel-cell system. It is desirable for a RTO scheme to achieve both feasibility and optimality. Optimality can be achieved if the underlying process model is able to predict not only the constraint values of the plant, but also the gradients of the cost and constraint functions. In the presence of structural plant-model mismatch, this typically requires the use of experimental plant gradient information. Methods integrating parameter estimation with a modified optimization problem that uses plant gradient information have been studied in the literature. The approach studied in this thesis, denoted modifier adaptation, does not require parameter estimation. In addition to the modifiers used in constraint adaptation, gradient-modifier terms based on the difference between the estimated and predicted gradient values are added to the cost and constraint functions in the optimization problem. With this, a point that satisfies the first-order necessary conditions of optimality for the plant is obtained upon convergence. The modifier-adaptation scheme is analyzed in terms of model adequacy and local convergence conditions. Different filtering strategies are discussed. The constraint-adaptation and modifier-adaptation RTO approaches are illustrated experimentally on a three-tank system. Finite-difference techniques can be used to estimate experimental gradients. The dual modifier-adaptation approach studied in this thesis drives the process towards optimality, while paying attention to the accuracy of the estimated gradients. The gradients are estimated from the successive operating points generated by the optimization algorithm. A novel upper bound on the gradient estimation error is developed, which is used as a constraint for locating the next operating point.

/pdf/modifier-adaptation-methodology-for-real-time-optimization-44af71dgbd.pdf

Modifier-Adaptation Methodology for Real-Time Optimization

Reinforcement learning (RL) is a powerful tool to perform data-driven optimal control without relying on a model of the system. However, RL struggles to provide hard guarantees on the behavior of the resulting control scheme. In contrast, nonlinear model predictive control (NMPC) and economic NMPC (ENMPC) are standard tools for the closed-loop optimal control of complex systems with constraints and limitations, and benefit from a rich theory to assess their closed-loop behavior. Unfortunately, the performance of (E)NMPC hinges on the quality of the model underlying the control scheme. In this paper, we show that an (E)NMPC scheme can be tuned to deliver the optimal policy of the real system even when using a wrong model. This result also holds for real systems having stochastic dynamics. This entails that ENMPC can be used as a new type of function approximator within RL. Furthermore, we investigate our results in the context of ENMPC and formally connect them to the concept of dissipativity, which is central for the ENMPC stability. Finally, we detail how these results can be used to deploy classic RL tools for tuning (E)NMPC schemes. We apply these tools on both, a classical linear MPC setting and a standard nonlinear example, from the ENMPC literature.

pdf/data-driven-economic-nmpc-using-reinforcement-learning-4d5ci2p9bb.pdf

Data-Driven Economic NMPC Using Reinforcement Learning

A Dual Modifier-Adaptation Approach for Real-Time Optimization

Design cost: a systematic approach to technology selection for model-based real-time optimization systems.

It is shown in this paper how simple linear steady state models can be constructed for use with a modified two-step algorithm to determine the optimum operating condition of a process. The models are formed in terms of pseudo gain and bias parameters. A number of the bias parameters can be estimated by comparison of the model and process outputs while the remaining model parameters are able to be set with only a minimal amount of prior knowledge of process relations. Besides possible savings in modelling effort, such simple models are computationally more convenient than more complex models for on-line optimization applications. The models exploit the power of the modified two-step procedure to ensure that the optimum operating condition is approached, in spite of model inaccuracies. Two applications are presented to illustrate the performance of the modified two-step algorithm when using a simple linear model. First, a linear process with a quadratic performance index is analysed and it is demonstrated h...

Simple models for integrated optimization and parameter estimation

The paper reports an investigation, performed via computer simulation, into the application of goal and model coordination to the decentralized control of a chemical plant consisting of an exothermic reactor, cooler, decanter and distillation column. Theoretical knowledge of the plant is employed to simplify the mathematical model and produce a decomposed structure consisting of a production subsystem and a separation subsystem with a considerable reduction in the number of interconnection variables. The investigation shows how a feasible control scheme based on model coordination can be implemented where the objective is to maximize the net return per hour. The control scheme contains facilities for overcoming the problem which occurs when the coordination unit specifies non-feasible interconnection variables. Simulation results are presented to illustrate the practicality of the control scheme.

Hierarchical control and decomposition of a chemical plant

In this paper an algorithm is described which uses a steady-state mode! to determine the optimum operating point of a process. The model, which is not required to be an accurate representation of the real process, contains parameters to be estimated and the algorithm involves an iterative procedure between the two problems of system optimization and parameter estimation. Lagrangian analysis is employed to account for the interaction between the two problems, resulting in a procedure which may be regarded as a modified two-step approach in which the optimization objective index includes an extra term. The extra term contains a comparison between model and real process output derivatives and ensures that the optimal steady-state operating condition is achieved in spite of model inaccuracies. The algorithm is shown to perform satisfactorily in a digital simulation study concerned with determining food flow rate and temperature controller set points to maximize the net rate of return from an exothermic chemic...

An algorithm for steady-state system optimization and parameter estimation

Popular Tasks used by Researchers

How can I help with your research?

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

We encountered an error while loading the panel. Please try refreshing the page.

Something went wrong

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

Anyone with the link can view this chat. You can switch it back to private anytime.

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

P. D. Roberts

Author Tools

Chat about Author

Papers

Simple models for integrated optimization and parameter estimation

Hierarchical control and decomposition of a chemical plant

An algorithm for steady-state system optimization and parameter estimation