TransWikia.com

The Principle of Optimality and the Bellman Equation

Economics Asked by EB3112 on January 24, 2021

I endeavour to prove that a Bellman equation exists for a dynamic optimisation problem:

$ max Sigmabeta^s U(C_t)$

Subject to the following constraints.

$C_t + K_{t+1}= F(K_F, E_F,S_t)$

$E_t = F_E(K_E,E_2,R_t, R_{t+1})$

$S_t = Sigma(1-d)E_t$

$R_{t+1}=R_t -E_t$

And the Bellman equation is given:

$V_t (K_t,R_t,E_t)= max_{C_1,K_2,E_1,E_t} {U(C_t)+beta V_{t+1}(K_{t+1},R_{t+1},E_{t+1}) + lambda_2 (F_2 (K_2,E_t-E_1)-E_t)}$

Is anyone able to prove the existence of this Bellman from the initial problem?

One Answer

Recall that the Principle of Optimality states that the solution to Our Bellman Functional Equation is the same as the solution to the sequential problem if:

Assumption 1: $Gamma(x)$ (our set of feasible values) is non-empty for all $xin X$.

Assumption 2:$lim_{trightarrowinfty}sum_{t=0}^infty beta^t F(x_t,x_{t+1}) $ exists for all $tilde{x}in Pi(x_0)$ ($Pi(x_0)$ being the correspondence of $x$ considering an initial $x_0$)

Assumption 3:$|V^*(x)<infty|$ for all $x in X$.

Assumption 4: For any $x_0$, there exists a plan $tilde{x}in Pi(x_0)$ such that $u(tilde{x})=V^*(x_0)$.

In your story here since $beta<0$ we know that this is bounded all we are doing is adding an additional constraint. This is equivalent to writing the legrangian: $$mathcal{L}=sum_{t=0}^infty{beta^tu(c_t)+sum_ilambda_{t,i}(F(K_{t+1},E_t-E_{i,t+1})-E_{j,t+1}}$$

Again I may not be iterating the whole story because there are two sectors here but this is how I'd go about thinking about if the principle of optimality is satisfied.

Hope this helps

Edit: After looking at your addendum im guessing the proceedure would be the same

$$V_t(k_t)=max_{c_t}{u(c_t)+lambda [F(K_{t+1},E_t-E_{i,t+1})-E_{j,t+1}]}+max_{c_{t+1},...,c_{T}}{sum_{t+1} [beta^{t+1}u(c_{t+1})+sum_ilambda_{it}[F(K_{t+1},E_t-E_{i,t+1})-E_{j,t+1}]]} $$

or $$V_t(k_t)=max_{c_t}{u(c_t)+lambda [F(K_{t+1},E_t-E_{i,t+1})-E_{j,t+1}]+V(k_{t+1})}$$

Answered by EconJohn on January 24, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP