We consider a robust optimal investment–reinsurance problem to minimize the goal-reaching probability that the value of the wealth process reaches a low barrier before a high goal for an ambiguity-averse insurer. The insurer invests its surplus in a constrained financial market, where the proportion of borrowed amount to the current wealth level is no more than a given constant, and short-selling is prohibited. We assume that the insurer purchases per-claim reinsurance to transfer its risk exposure to a reinsurer whose premium is computed according to the mean–variance premium principle. Using the stochastic control approach based on the Hamilton–Jacobi–Bellman equation, we derive robust optimal investment–reinsurance strategies and the corresponding value functions. We conclude that the behavior of borrowing typically occurs with a lower wealth level. Finally, numerical examples are given to illustrate our results.

A numerical method is proposed for a class of one-dimensional stochastic control problems with unbounded state space. This method solves an infinite-dimensional linear program, equivalent to the original formulation based on a stochastic differential equation, using a finite element approximation. The discretization scheme itself and the necessary assumptions are discussed, and a convergence argument for the method is presented. Its performance is illustrated by examples featuring long-term average and infinite horizon discounted costs, and additional optimization constraints.

In this paper, we consider a joint drift rate control and two-sided impulse control problem in which the system manager adjusts the drift rate as well as the instantaneous relocation for a Brownian motion, with the objective of minimizing the total average state-related cost and control cost. The system state can be negative. Assuming that instantaneous upward and downward relocations take a different cost structure, which consists of both a setup cost and a variable cost, we prove that the optimal control policy takes an $\left\{ {\!\left( {{s^{\ast}},{q^{\ast}},{Q^{\ast}},{S^{\ast}}} \right),\!\left\{ {{\mu ^{\ast}}(x)\,:\,x \in [ {{s^{\ast}},{S^{\ast}}}]} \right\}} \right\}$ form. Specifically, the optimal impulse control policy is characterized by a quadruple $\left( {{s^{\ast}},{q^{\ast}},{Q^{\ast}},{S^{\ast}}} \right)$, under which the system state will be immediately relocated upwardly to ${q^{\ast}}$ once it drops to ${s^{\ast}}$ and be immediately relocated downwardly to ${Q^{\ast}}$ once it rises to ${S^{\ast}}$; the optimal drift rate control policy will depend solely on the current system state, which is characterized by a function ${\mu ^{\ast}}\!\left( \cdot \right)$ for the system state staying in $[ {{s^{\ast}},{S^{\ast}}}]$. By analyzing an associated free boundary problem consisting of an ordinary differential equation and several free boundary conditions, we obtain these optimal policy parameters and show the optimality of the proposed policy using a lower-bound approach. Finally, we investigate the effect of the system parameters on the optimal policy parameters as well as the optimal system’s long-run average cost numerically.

We consider De Finetti’s control problem for absolutely continuous strategies with control rates bounded by a concave function and prove that a generalized mean-reverting strategy is optimal in a Brownian model. In order to solve this problem, we need to deal with a nonlinear Ornstein–Uhlenbeck process. Despite the level of generality of the bound imposed on the rate, an explicit expression for the value function is obtained up to the evaluation of two functions. This optimal control problem has, as special cases, those solved in Jeanblanc-Picqué and Shiryaev (1995) and Renaud and Simard (2021) when the control rate is bounded by a constant and a linear function, respectively.

We extend the classical setting of an optimal stopping problem under full information to include problems with an unknown state. The framework allows the unknown state to influence (i) the drift of the underlying process, (ii) the payoff functions, and (iii) the distribution of the time horizon. Since the stopper is assumed to observe the underlying process and the random horizon, this is a two-source learning problem. Assigning a prior distribution for the unknown state, standard filtering theory can be employed to embed the problem in a Markovian framework with one additional state variable representing the posterior of the unknown state. We provide a convenient formulation of this Markovian problem, based on a measure change technique that decouples the underlying process from the new state variable. Moreover, we show by means of several novel examples that this reduced formulation can be used to solve problems explicitly.

This work concerns Markov decision chains on a denumerable state space endowed with a bounded cost function. The performance of a control policy is assessed by a long-run average criterion as measured by a risk-seeking decision maker with constant risk-sensitivity. Besides standard continuity–compactness conditions, the framework of the paper is determined by the following conditions: (i) the state process is communicating under each stationary policy, and (ii) the simultaneous Doeblin condition holds. Within this framework it is shown that (i) the optimal superior and inferior limit average value functions coincide and are constant, and (ii) the optimal average cost is characterized via an extended version of the Collatz–Wielandt formula in the theory of positive matrices.

Consider a Brownian motion on the circumference of the unit circle, which jumps to the opposite point of the circumference at incident times of an independent Poisson process of rate $\lambda$. We examine the problem of coupling two copies of this ‘jumpy Brownian motion’ started from different locations, so as to optimise certain functions of the coupling time. We describe two intuitive co-adapted couplings (‘Mirror’ and ‘Synchronous’) which differ only when the two processes are directly opposite one another, and show that the question of which strategy is best depends upon the jump rate $\lambda$ in a non-trivial way. We also provide an explicit description of a (non-co-adapted) maximal coupling for any jump rate in the case that the two jumpy Brownian motions begin at antipodal points of the circle.

We consider an insurance company modelling its surplus process by a Brownian motion with drift. Our target is to maximise the expected exponential utility of discounted dividend payments, given that the dividend rates are bounded by some constant. The utility function destroys the linearity and the time-homogeneity of the problem considered. The value function depends not only on the surplus, but also on time. Numerical considerations suggest that the optimal strategy, if it exists, is of a barrier type with a nonlinear barrier. In the related article of Grandits et al. (Scand. Actuarial J. 2, 2007), it has been observed that standard numerical methods break down in certain parameter cases, and no closed-form solution has been found. For these reasons, we offer a new method allowing one to estimate the distance from an arbitrary smooth-enough function to the value function. Applying this method, we investigate the goodness of the most obvious suboptimal strategies—payout on the maximal rate, and constant barrier strategies—by measuring the distance from their performance functions to the value function.

We study an optimal reinsurance problem for a diffusion model, in which the drift of the claim follows an Ornstein–Uhlenbeck process. The aim of the insurer is to maximize the expected exponential utility of its terminal wealth. We consider two cases: full information and partial information. Full information occurs when the insurer directly observes the drift; partial information occurs when the insurer observes only its claims. By applying stochastic control and by solving the corresponding Hamilton–Jacobi–Bellman equations, we find the value function and the optimal reinsurance strategy under both full and partial information. We determine a relationship between the value function and reinsurance strategy under full information with the value function and reinsurance strategy under partial information.

We consider a dual risk model with constant expense rate and i.i.d. exponentially distributed gains $C_i$ ( $i=1,2,\dots$ ) that arrive according to a renewal process with general interarrival times. We add to this classical dual risk model the proportional gain feature; that is, if the surplus process just before the ith arrival is at level u, then for $a>0$ the capital jumps up to the level $(1+a)u+C_i$ . The ruin probability and the distribution of the time to ruin are determined. We furthermore identify the value of discounted cumulative dividend payments, for the case of a Poisson arrival process of proportional gains. In the dividend calculations, we also consider a random perturbation of our basic risk process modeled by an independent Brownian motion with drift.

In this paper we estimate the expected error of a stochastic approximation algorithm where the maximum of a function is found using finite differences of a stochastic representation of that function. An error estimate of the order $n^{-1/5}$ for the nth iteration is achieved using suitable parameters. The novelty with respect to previous studies is that we allow the stochastic representation to be discontinuous and to consist of possibly dependent random variables (satisfying a mixing condition).

In this article we consider the estimation of the log-normalization constant associated to a class of continuous-time filtering models. In particular, we consider ensemble Kalman–Bucy filter estimates based upon several nonlinear Kalman–Bucy diffusions. Using new conditional bias results for the mean of the aforementioned methods, we analyze the empirical log-scale normalization constants in terms of their $\mathbb{L}_n$ -errors and $\mathbb{L}_n$ -conditional bias. Depending on the type of nonlinear Kalman–Bucy diffusion, we show that these are bounded above by terms such as $\mathsf{C}(n)\left[t^{1/2}/N^{1/2} + t/N\right]$ or $\mathsf{C}(n)/N^{1/2}$ ( $\mathbb{L}_n$ -errors) and $\mathsf{C}(n)\left[t+t^{1/2}\right]/N$ or $\mathsf{C}(n)/N$ ( $\mathbb{L}_n$ -conditional bias), where t is the time horizon, N is the ensemble size, and $\mathsf{C}(n)$ is a constant that depends only on n, not on N or t. Finally, we use these results for online static parameter estimation for the above filtering models and implement the methodology for both linear and nonlinear models.

This paper studies a mixed singular/switching stochastic control problem for a multidimensional diffusion with multiple regimes on a bounded domain. Using probabilistic partial differential equation and penalization techniques, we show that the value function associated with this problem agrees with the solution to a Hamilton–Jacobi–Bellman equation. In this way, we see that the regularity of the value function is $ \textrm{C}^{0,1}\cap \textrm{W}^{2,\infty}_{\textrm{loc}}$ .

We study an intertemporal consumption and portfolio choice problem under Knightian uncertainty in which agent’s preferences exhibit local intertemporal substitution. We also allow for market frictions in the sense that the pricing functional is nonlinear. We prove existence and uniqueness of the optimal consumption plan, and we derive a set of sufficient first-order conditions for optimality. With the help of a backward equation, we are able to determine the structure of optimal consumption plans. We obtain explicit solutions in a stationary setting in which the financial market has different risk premia for short and long positions.

We solve non-Markovian optimal switching problems in discrete time on an infinite horizon, when the decision-maker is risk-aware and the filtration is general, and establish existence and uniqueness of solutions for the associated reflected backward stochastic difference equations. An example application to hydropower planning is provided.

A moment constraint that limits the number of dividends in an optimal dividend problem is suggested. This leads to a new type of time-inconsistent stochastic impulse control problem. First, the optimal solution in the precommitment sense is derived. Second, the problem is formulated as an intrapersonal sequential dynamic game in line with Strotz’s consistent planning. In particular, the notions of pure dividend strategies and a (strong) subgame-perfect Nash equilibrium are adapted. An equilibrium is derived using a smooth fit condition. The equilibrium is shown to be strong. The uncontrolled state process is a fairly general diffusion.

A diffusion approximation to a risk process under dynamic proportional reinsurance is considered. The goal is to minimise the discounted time in drawdown; that is, the time where the distance of the present surplus to the running maximum is larger than a given level $d > 0$ . We calculate the value function and determine the optimal reinsurance strategy. We conclude that the drawdown measure stabilises process paths but has a drawback as it also prevents surpassing the initial maximum. That is, the insurer is, under the optimal strategy, not interested in any more profits. We therefore suggest using optimisation criteria that do not avoid future profits.

This paper studies a composite problem involving decision-making about the optimal entry time and dynamic consumption afterwards. In Stage 1, the investor has access to full market information subject to some information costs and needs to choose an optimal stopping time to initiate Stage 2; in Stage 2, the investor terminates the costly full information acquisition and starts dynamic investment and consumption under partial observation of free public stock prices. Habit formation preferences are employed, in which past consumption affects the investor’s current decisions. Using the stochastic Perron method, the value function of the composite problem is proved to be the unique viscosity solution of some variational inequalities.

We consider the optimal portfolio and consumption problem for a jump-diffusion process with regime switching. Under the criterion of maximizing the expected discounted total utility of consumption, two methods, namely, the dynamic programming principle and the stochastic maximum principle, are used to obtain the optimal result for the general objective function, which is the solution to a system of partial differential equations. Furthermore, we investigate the power utility as a specific example and analyse the existence and uniqueness of the optimal solution. Under the constraints of no-short-selling and nonnegative consumption, closed-form expressions for the optimal strategy and the value function are derived. Besides, some comparisons between the optimal results for the jump-diffusion model and the pure diffusion model are carried out. Finally, we discuss our optimal results in some special cases.