Stochastic optimization offers a means of considering the objectives and constrains with stochastic parameters. However, it is generally difficult to solve the stochastic optimization problem by employing conventional methods for nonlinear programming when the number of random variables involved is very large. Neural network models and algorithms were applied to solve the stochastic optimization problem on the basis of the stability theory. Stability for stochastic programs was discussed. If random vector sequence converges to the random vector in the original problem in distribution, the optimal value of the corresponding approximation problems converges to the optimal value of the original stochastic optimization problem.