We use the changes of a Brownian motion to model randomness. We build other stochastic processes using those changes. The general idea is The mathematical foundations for our construction were created by K. Ito. The key concepts are the Ito integral, Ito processes, and Ito’s formula (also called Ito’s lemma). Using these foundations, we can build quite general processes from changes in Brownian motions, including processes with non-normal distributions.
3.1 Examples
We begin with some simple examples. Consider a discrete partition of a time interval: with equally spaced times. Let denote the difference between successive times.
First, let’s drop the randomness entirely. Consider the equation for a constant . Thus, we have “change mean,” where the mean is proportional to the previous value with proportionality factor . Figure 3.1 presents a plot of , for particular values of , , and .
If we increase , making smaller, then converges to the solution of the ordinary differential equation Equation 3.2 has a known solution, which is To verify this, we only need to differentiate defined in Equation 3.3: The function presented in Equation 3.3 is also shown in Figure 3.1.
Theory Extra
To see how one might guess that Equation 3.3 is the solution of Equation 3.2, we can examine the logarithm of . A general rule gives us , so . We can integrate both sides of this to obtain . Now, rearranging and exponentiating gives . Later, we follow similar steps to see that Equation 3.6 is the solution of Equation 3.5.
Figure 3.1: The functions satisfying Equation 3.1 (difference equation) and Equation 3.3 (differential equation) for X0 = 1, mu = 1, and Delta t = 0.1.
Now, let’s include randomness. Let’s make the noise proportional to the value of , So, let be a standard Brownian motion and consider the equation where is another constant, and . A solution of this equation has random paths, due to the random noise . An example of a path is shown in Figure 3.2. Ito showed how we can take the limit of this equation as we make smaller and make sense of the equation The solution of Equation 3.5 is We can show that defined in Equation 3.6 satisfies Equation 3.5 by differentiating, as we showed that defined in Equation 3.3 satisfies Equation 3.2. However, we first need to explain Ito’s formula, which is a formula for differentiating functions of Brownian motions and, more generally, functions of Ito processes. An approximate path of is shown in Figure 3.2. It is generated by taking very small, just as we generated approximate paths of Brownian motions in Chapter 2.
Figure 3.2: Paths of the processes satisfying Equation 3.4 (difference equation) and Equation 3.6 (differential equation) for X0 = 1, mu = 1, Delta t = 0.1, and sigma = 1.
The functions and processes defined in this section have important interpretations. Equation 3.1 can be rewritten to say that the percent change in is . This could represent the value of a savings account that earns interest of in each period of length . This is the common way of calculating, for example, monthly interest, where is called the annual rate of interest and would be . The limiting Equation 3.3 is called continuous compounding of interest.
Similarly, Equation 3.4 can be rewritten to say that the percent change in is . This represents a random rate of return – for example, the return of a stock. The expected rate of return in this case is , and the variance of the rate of return is . The limiting Equation 3.3 is called continuous compounding of returns.
3.2 Ito Processes
The meaning of Equation 3.2 is that, for all , We assume the reader is familiar with integrals, so we do not explain this further. The function of time defined in Equation 3.3 satisfies this equation. Similarly, the meaning of Equation 3.5 is that, for all , The first integral in this formula is an ordinary integral. The second is an Ito integral, which is to be explained. The sum of an ordinary integral and an Ito integral is called an Ito process. An Ito process always has continuous paths.
Let’s depart from the example of the previous section and consider a process satisfying, for all , where and can be stochastic processes. The example of the previous section fits this form, because we could take and . The definition of the Ito integral is relatively complicated. It is enough for our purposes to know that it can be approximated by a discrete sum given a partition when is large and the time between successive dates is small. The Ito integral exists provided does not anticipate the future (so is independent of the increment ) and provided does not explode to in finite time, so for all , with probability one.
We also write Equation 3.7 as We interpret this as “change mean noise” with being the mean and being the mean-zero random noise. The quantity is also called the drift of the process at time . The coefficient is called the diffusion coefficient of at time . If and are constant, it is standard to refer to an Ito process as a –Brownian motion. When they are constant, we obtain
An Ito process as in Equation 3.7 can be a martingale only if . This should seem sensible, because is the expected change in , and a process is a martingale only if its expected change is zero. This observation plays a fundamental role in deriving asset pricing formulas. Conversely, if and for each , then the Ito process is a continuous martingale, and the variance of its date– value, calculated with the information available at date , is:
3.3 Quadratic and Joint Variation of Ito Processes
To compute the quadratic variation of an Ito process, we use the following simple and important rules (for the sake of brevity, we drop the subscript from here and sometimes later). These rules should be regarded as mnemonic devices. The calculations we do with them lead to the correct results, but the objects have no real mathematical meaning.
Important Principle
We apply these rules to compute the quadratic variation of any Ito proces as follows:
Important Principle
If for a Brownian motion , then To compute the quadratic variation of the Ito process over any particular period of time, we integrate over that period as1]
Now consider two Ito processes:
where and are standard Brownian motions. We calculate the product of differentials of Ito processes as follows.
Important Principle
If and are Ito processes as in Equation 3.14 and Equation 3.15, then where is the correlation process of the two Brownian motions.
The real meaning of this rule is that it is possible to calculate the joint variation (i.e., limit of sum of products of changes) of the two Ito processes from to as The last integral in this equation is the correct formula for the quadratic variation. As with squaring differentials, taking products of differentials is a mnemonic device to get us to the correct formula.2
3.4 Introduction to Ito’s Formula
First we recall some facts of the ordinary calculus. If and with and being continuously differentiable functions, then This implies that, for each , Substituting , we can also write this as or, in differential form, What people frequently remember about integrals from their calculus courses is that there are a lot of tricky substitutions that can be made to simplify the calculation of various integrals. We won’t need those in this book. All we will use are equations of the form of Equation 3.18, which is a special case of the Fundamental Theorem of Calculus, which says that a function is the integral of its derivative. Intuitively, we can think of Equation 3.18 as saying that the change in over a discrete interval (from to ) is the continuous sum (integral) of its infinitesimal changes.
We will contrast Equation 3.18 with the following special case of Ito’s formula for the calculus of Ito processes.
Important Principle
If is a Brownian motion and for a twice-continuously differentiable function , then
Comparing Equation 3.20 to Equation 3.19, we see that Ito’s formula has an extra term involving the second derivative .
Equation 3.20 implies that is an Ito process with drift and diffusion coefficient . The real meaning of Equation 3.20 is the integrated form: Thus, the change in over a discrete interval is again the continuous sum of its infinitesimal changes, but now the infinitesimal changes are given by Equation 3.20. Note that the first integral in Equation 3.21 is an Ito integral.
To gain some intuition for the extra term in Ito’s formula, we return to the ordinary calculus. Given dates , the derivative defines a linear approximation of the change in from to ; that is, setting and , we have the approximation A better approximation is given by the second-order Taylor series expansion An interpretation of Equation 3.18 is that the linear approximation works perfectly for infinitesimal time periods , because we can compute the change in over the time interval by summing up the infinitesimal changes . In other words, the second-order term vanishes when we consider very short time periods.
The second-order Taylor series expansion in the case of is For example, given a partition of the time interval , we have, with the same notation we have used earlier,
If we make the time intervals shorter, letting , then we cannot expect that the extra term here will disappear, leading to the result of the ordinary calculus shown in Equation 3.18, because we know that whereas for the continuously differentiable function , the same limit is zero. In fact it seems sensible to interpret the limit of as . This is perfectly consistent with Ito’s formula: if we take the limit in Equation 3.22, replacing the limit of with , we obtain Equation 3.21.
To see the accuracy of Ito’s approximation over different time steps, as well as the impact of the second-derivative term , we encourage readers to interact with the plot below. It examines the function (for which we have and ). It simulates an approximate path of a Brownian motion as we have done before. It then compares the true value of to the Ito expansion using the discretization Notice that the discretization is just a second-order Taylor series expansion. The discretization approximates the true value better if we take larger and smaller. The important take-away from the figure is that the cumulative second-derivative terms in the discretization do not vanish as we take larger but instead continue to contribute significantly to the approximation.
Figure 3.3: Accuracy of Ito Approximation
3.5 Functions of Time and a Brownian Motion
We extend the example in the previous section slightly. Consider a process defined as for some function . The following rule states that is an Ito process with drift equal to and diffusion coefficient equal to . This is what we need to remember to make calculations. The real meaning of is , so we can (and will) substitute that in the following rule, but it may be easier to remember . This becomes more important when we consider more complex examples in the next sections.
Important Principle
If is continuously differentiable in and twice continuously differentiable in and for a standard Brownian motion , then
Now consider the more general case where is an Ito process. As explained before, this means that for some stochastic processes and , where is a standard Brownian motion. Then, from our previous rules, . Ito’s formula in this more general case takes the same form as Calculation Rule , replacing the Brownian motion with the Ito process .
Important Principle
If is continuously differentiable in and twice continuously differentiable in and where is an Ito process, then
We can write Equation 3.25 in terms of and terms by substituting from Equation 3.24 and using . This produces
Here are some important examples of Ito’s formula.
Key Result
If for a constant , then This is equivalent to {#ito-powerformula}
Key Result
If , then
Key Result
If , then
Example
We showed in the previous Example that defined in Equation 3.6 satisfies Equation 3.5, but it is also useful to see how we can start from Equation 3.5 and deduce that Equation 3.6 is the solution. We can do that by taking logarithms. Set . Then, using Equation 3.27 and substituting from Equation 3.5, we have There is no on the right-hand side of this, so we can simply integrate to compute as Exponentiating gives Equation 3.6.
3.7 Functions of Time and Multiple Ito Processes
Using Equation 3.16 for products of differentials, we can state Ito’s formula for a function of time and two Ito processes as follows.
Important Principle
If where and are Ito processes and is continuously differentiable in and twice continuously differentiable in and , then
This is analogous to a second-order Taylor series expansion in the variables and . A similar formula applies to functions of more two Ito processes. We just need to include a term for each , each and each .
Here are some important examples. We switch notation from and to and and from to so we can drop the subscripts. These formulas follow from Equation 3.28 by taking or .
Key Result
If , then . We can write this as
Key Result
If , then
The following is a special case of Equation 3.29 that we encounter often.
Key Result
Let for some (possibly random) process and define for any Ito process . Equation 3.29 gives us This is the same as in the usual calculus.
3.8 Exercises
Exercise 3.1 Ito’s Lemma can be used in different ways to get the same answer. For example, let and use Ito’s lemma on the function . Alternatively, let . Use Ito’s lemma on .
Exercise 3.2 Let . Use Ito’s lemma to find . What is the expected value and variance of ?
In a more formal mathematical presentation, one normally writes for what we are writing here as . This is the differential of the quadratic variation process, and the quadratic variation through date is Our mnenomic device of squaring differentials leads us to the correct formula.↩︎
A somewhat more precise definition than our previous description of the stochastic integral is when Equation 3.9 holds, the stochastic integral is the (unique) martingale with joint variation with any other Ito process given by Equation 3.17.↩︎