This paper proposes a recursive algorithm estimating coefficients of thc linear stochastic control system (ARX system) driven by a martingale difference sequence, while adaptively stabilizing the system without introducing extal excitation signal. The system is allowed to be unstable and of nonminimum-phase. The estimates derived for the coefficients of both closed-loop and open-loop systems are strongly consistent.