Abstract: This paper gives a mathematical definition for the "caution" and "probing", and presents a decomposition theorem for nonlinear discrete-time stochastic systems. Under some assumptions, the problem of finding the closed-loop optimal control can be decomposed into three problems:the deterministic optimal feedback, cautious optimal and probing optimal control problems.